Max level shown:
1 [ Nov 19 01:28:18 Enabled. ]
2 [ Nov 19 01:28:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 19 01:28:18 Method "start" exited with status 0. ]
4 [ Nov 19 01:28:18 Rereading configuration. ]
5 [ Nov 19 01:28:18 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-19T01:28:18.661ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-19T01:28:18.661ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-19T01:28:18.715ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-19T01:28:18.715ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-19T01:28:18.828ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-19T01:28:18.837ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-19T01:28:18.845ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-19T01:28:19.446ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-19T01:28:19.584ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-19T01:28:19.584ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-19T01:28:19.584ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-19T01:28:19.585ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-19T01:28:19.585ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-11-19T01:28:19.585ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-11-19T01:28:19.588ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-19T01:28:19.588ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-19T01:28:19.588ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-19T01:28:19.588ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-19T01:28:19.588ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-19T01:28:19.588ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-19T01:28:19.588ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-19T01:28:19.588ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-19T01:28:19.588ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-19T01:28:19.598ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-19T01:28:19.598ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool)
322024-11-19T01:28:19.697ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal }
332024-11-19T01:28:20.169ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-19T01:28:20.169ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-19T01:28:20.169ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-19T01:28:20.169ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-19T01:28:20.169ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-19T01:28:20.169ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-19T01:28:20.169ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-19T01:28:20.177ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-19T01:28:20.177ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool)
422024-11-19T01:28:20.265ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal }
432024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
472024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
482024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
522024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
542024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
552024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
562024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
592024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
602024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
612024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
622024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
762024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
772024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
782024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-11-19T01:28:20.739ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-11-19T01:28:20.739ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-11-19T01:28:20.739ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-19T01:28:20.739ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-19T01:28:20.739ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-19T01:28:20.739ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-19T01:28:20.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-19T01:28:20.739ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-19T01:28:20.739ZINFOSledAgent (bootstore): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-11-19T01:28:20.739ZINFOSledAgent (bootstore): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-11-19T01:28:20.739ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-19T01:28:20.739ZINFOSledAgent (bootstore): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-11-19T01:28:20.740ZINFOSledAgent (bootstore): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-11-19T01:28:20.740ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-19T01:28:20.740ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-19T01:28:20.740ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-19T01:28:20.750ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-11-19T01:28:20.750ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1350, tv_nsec: 659638244 } time_to_next_cleanup = 599.999921259s
1142024-11-19T01:28:20.750ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-11-19T01:28:20.750ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-19T01:28:20.750ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-11-19T01:28:20.753ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-11-19T01:28:20.753ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-19T01:28:20.755ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-19T01:28:20.755ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-19T01:28:20.755ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-19T01:28:20.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-19T01:28:20.755ZINFOSledAgent (RSS): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-11-19T01:28:20.756ZINFOSledAgent (RSS): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-11-19T01:28:20.756ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-19T01:28:20.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-19T01:28:20.756ZINFOSledAgent (RSS): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-11-19T01:28:20.756ZINFOSledAgent (RSS): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-11-19T01:28:20.756ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-19T01:28:20.756ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-19T01:28:20.756ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-19T01:28:20.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-19T01:28:20.756ZINFOSledAgent (RSS): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-11-19T01:28:20.756ZINFOSledAgent (RSS): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-11-19T01:28:20.756ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 302245ee-8785-4baf-86ed-0823410907ec (sled), rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-11-19T01:28:20.756ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1372024-11-19T01:28:20.756ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-11-19T01:28:20.756ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-11-19T01:28:20.756ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-11-19T01:28:20.756ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-11-19T01:28:20.757ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 302245ee-8785-4baf-86ed-0823410907ec (sled), rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-11-19T01:28:20.757ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1432024-11-19T01:28:20.757ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1442024-11-19T01:28:20.762ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1452024-11-19T01:28:20.767ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-11-19T01:28:20.767ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-11-19T01:28:20.772ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1482024-11-19T01:28:20.772ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1492024-11-19T01:28:20.772ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:55464
1502024-11-19T01:28:20.772ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 302245ee-8785-4baf-86ed-0823410907ec (sled), rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1512024-11-19T01:28:20.772ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1522024-11-19T01:28:20.772ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1532024-11-19T01:28:20.772ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-11-19T01:28:20.772ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1582024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1622024-11-19T01:28:20.772ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1632024-11-19T01:28:20.772ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1642024-11-19T01:28:20.788ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1652024-11-19T01:28:20.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1662024-11-19T01:28:20.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1672024-11-19T01:28:20.832ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:408 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
1682024-11-19T01:28:20.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-19T01:28:20.832ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
1702024-11-19T01:28:20.832ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1712024-11-19T01:28:20.836ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 125.03774ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0463049d-a3fb-4aaf-946b-0b17c00f8bb7", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0463049d-a3fb-4aaf-946b-0b17c00f8bb7" } file = clients/ddm-admin-client/src/lib.rs:177
1722024-11-19T01:28:20.846ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_d5fbaf8a-2201-4229-ba29-5652e47649ac/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1732024-11-19T01:28:20.868ZINFOSledAgent: successfully created encrypted zvol: name="oxi_d5fbaf8a-2201-4229-ba29-5652e47649ac/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1742024-11-19T01:28:20.868ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_d5fbaf8a-2201-4229-ba29-5652e47649ac/swap" file = sled-agent/src/swap_device.rs:96
1752024-11-19T01:28:20.874ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:435 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
1762024-11-19T01:28:20.874ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1772024-11-19T01:28:20.874ZINFOSledAgent (BackingFs): Ensuring dataset oxi_d5fbaf8a-2201-4229-ba29-5652e47649ac/backing/fmd file = sled-agent/src/backing_fs.rs:138
1782024-11-19T01:28:20.962ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-11-19T01:28:20.962ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 82.878571ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "54a3b2bc-031e-44e4-a7ec-1d4e21c6dab1", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "54a3b2bc-031e-44e4-a7ec-1d4e21c6dab1" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-11-19T01:28:20.965ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1812024-11-19T01:28:21.046ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-11-19T01:28:21.047ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.688506ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "042189af-e709-4416-ae33-aed7b9c1ad01", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "042189af-e709-4416-ae33-aed7b9c1ad01" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-11-19T01:28:21.151ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-11-19T01:28:21.152ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 213.544196ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9acea62d-4cd8-4e4a-a5d3-83166e6ed746", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9acea62d-4cd8-4e4a-a5d3-83166e6ed746" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-11-19T01:28:21.185ZINFOSledAgent (BackingFs): Mounting oxi_d5fbaf8a-2201-4229-ba29-5652e47649ac/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1862024-11-19T01:28:21.198ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1872024-11-19T01:28:21.198ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1882024-11-19T01:28:21.198ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1892024-11-19T01:28:21.198ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1902024-11-19T01:28:21.367ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-11-19T01:28:21.368ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 291.451461ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a3fed29c-daa6-4f47-8602-38ead508d516", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a3fed29c-daa6-4f47-8602-38ead508d516" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-11-19T01:28:21.661ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-19T01:28:21.661ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 158.546398ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0081ae66-aaf6-4382-b99a-c0e73f54ffe6", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0081ae66-aaf6-4382-b99a-c0e73f54ffe6" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-19T01:28:21.820ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-19T01:28:21.821ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 430.103563ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8ccef1bf-1e37-487d-a61a-2bbbbfa3516c", "content-length": "124", "date": "Tue, 19 Nov 2024 01:28:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8ccef1bf-1e37-487d-a61a-2bbbbfa3516c" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-19T01:28:21.929ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
1972024-11-19T01:28:21.936ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:49546 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
1982024-11-19T01:28:21.936ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
1992024-11-19T01:28:21.936ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:49546 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 302245ee-8785-4baf-86ed-0823410907ec sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2002024-11-19T01:28:21.937ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 190.137647ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2012024-11-19T01:28:21.939ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2022024-11-19T01:28:21.939ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2032024-11-19T01:28:21.939ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2042024-11-19T01:28:21.939ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2052024-11-19T01:28:22.128ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 300.330606ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2062024-11-19T01:28:22.251ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2072024-11-19T01:28:22.431ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.340436593s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2082024-11-19T01:28:23.774ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.425147509s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2092024-11-19T01:28:24.469ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2102024-11-19T01:28:24.469ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2112024-11-19T01:28:24.469ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2122024-11-19T01:28:24.469ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2132024-11-19T01:28:24.469ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2142024-11-19T01:28:24.469ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2152024-11-19T01:28:24.471ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2162024-11-19T01:28:24.472ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2172024-11-19T01:28:24.472ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='e775bb0f-d2b5-4c13-b4f1-f5a61d1d3098'/> <propval type="astring" name="rack_id" value='cbab7bfb-8e8e-44f1-a93b-b95de3b50f49'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe25:38f3'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='cbab7bfb-8e8e-44f1-a93b-b95de3b50f49'/> <propval type="astring" name="sled_id" value='302245ee-8785-4baf-86ed-0823410907ec'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='302245ee-8785-4baf-86ed-0823410907ec'/> <propval type="astring" name="rack_uuid" value='cbab7bfb-8e8e-44f1-a93b-b95de3b50f49'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='302245ee-8785-4baf-86ed-0823410907ec'/> <propval type="astring" name="rack_uuid" value='cbab7bfb-8e8e-44f1-a93b-b95de3b50f49'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2182024-11-19T01:28:24.472ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2192024-11-19T01:28:24.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 67.66785ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-11-19T01:28:24.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 58.797311ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-11-19T01:28:25.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 166.678637ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-11-19T01:28:25.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 243.479077ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-11-19T01:28:25.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 463.779816ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-11-19T01:28:26.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 864.861499ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-11-19T01:28:26.279ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.985558275s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2262024-11-19T01:28:27.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.166870704s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-19T01:28:28.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 946.625378ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-19T01:28:29.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.118809942s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-19T01:28:31.272ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/nexus.rs:527 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2302024-11-19T01:28:31.302ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2312024-11-19T01:28:31.302ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2322024-11-19T01:28:31.303ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2332024-11-19T01:28:31.303ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2342024-11-19T01:28:31.303ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2352024-11-19T01:28:31.303ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-11-19T01:28:31.304ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2372024-11-19T01:28:31.304ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2382024-11-19T01:28:31.304ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2392024-11-19T01:28:31.304ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2402024-11-19T01:28:31.304ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:55464
2412024-11-19T01:28:31.488ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-11-19T01:28:31.488ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2432024-11-19T01:28:31.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-11-19T01:28:31.488ZINFOSledAgent (RSS): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2452024-11-19T01:28:31.488ZINFOSledAgent (RSS): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2462024-11-19T01:28:31.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-11-19T01:28:31.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2482024-11-19T01:28:31.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-11-19T01:28:31.488ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-11-19T01:28:31.494ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2512024-11-19T01:28:31.494ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2522024-11-19T01:28:31.494ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2532024-11-19T01:28:31.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40313
2542024-11-19T01:28:31.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-19T01:28:31.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-19T01:28:31.760ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:188
2572024-11-19T01:28:31.760ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:188
2582024-11-19T01:28:31.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40313 req_id = 03b4aeff-a5ea-4d46-843f-7416008d716f response_code = 200 uri = /inventory
2592024-11-19T01:28:31.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49061
2602024-11-19T01:28:31.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49061 req_id = 0743add3-5aa0-4f53-ab51-e6545df728a9 response_code = 200 uri = /sled-role
2612024-11-19T01:28:31.791ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-19T01:28:31.791ZINFOSledAgent (RSS): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2632024-11-19T01:28:31.791ZINFOSledAgent (RSS): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2642024-11-19T01:28:31.791ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2652024-11-19T01:28:31.823ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7a768045-2376-47c5-84f3-13d6dcdb19be, pool_id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8bfdfb89-1386-4800-bf5c-82a14043d30c, pool_id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: d8f10418-f97c-4f3f-b547-e2360d4286e5, pool_id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: eec0cfef-f901-4506-ac4e-845e1dbcc4e1, pool_id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: dc6c4c13-9f10-4dc4-ac40-9ed8ab8cb9b3, pool_id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 99a75581-979f-49ba-b739-d9e3909116ce, pool_id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 482751d1-3b8c-4da8-a558-b457d4ce2b6c, pool_id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 73cfa9ec-7be4-4801-b3d6-de3d566d4ff6, pool_id: e2481975-3977-496e-a270-5d45680952af (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 44653b49-4c52-4d11-92a8-7619edecdacc, pool_id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2662024-11-19T01:28:31.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57678
2672024-11-19T01:28:31.823ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2682024-11-19T01:28:31.823ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7a768045-2376-47c5-84f3-13d6dcdb19be, pool_id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 8bfdfb89-1386-4800-bf5c-82a14043d30c, pool_id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: d8f10418-f97c-4f3f-b547-e2360d4286e5, pool_id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: eec0cfef-f901-4506-ac4e-845e1dbcc4e1, pool_id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: dc6c4c13-9f10-4dc4-ac40-9ed8ab8cb9b3, pool_id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 99a75581-979f-49ba-b739-d9e3909116ce, pool_id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 482751d1-3b8c-4da8-a558-b457d4ce2b6c, pool_id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 73cfa9ec-7be4-4801-b3d6-de3d566d4ff6, pool_id: e2481975-3977-496e-a270-5d45680952af (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 44653b49-4c52-4d11-92a8-7619edecdacc, pool_id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2692024-11-19T01:28:31.823ZINFOSledAgent (StorageManager): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2702024-11-19T01:28:31.823ZINFOSledAgent (StorageManager): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2712024-11-19T01:28:31.823ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2722024-11-19T01:28:31.823ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2732024-11-19T01:28:31.823ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2742024-11-19T01:28:31.823ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2752024-11-19T01:28:31.823ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2762024-11-19T01:28:31.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2772024-11-19T01:28:31.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2782024-11-19T01:28:31.980ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2792024-11-19T01:28:31.980ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool)
2802024-11-19T01:28:32.201ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2812024-11-19T01:28:32.269ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.121611354s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2822024-11-19T01:28:32.299ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }
2832024-11-19T01:28:32.304ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
2842024-11-19T01:28:32.308ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2852024-11-19T01:28:32.308ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2862024-11-19T01:28:32.308ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2872024-11-19T01:28:32.308ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2882024-11-19T01:28:32.308ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-11-19T01:28:32.309ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-11-19T01:28:32.309ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2912024-11-19T01:28:32.346ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2922024-11-19T01:28:32.354ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone file = sled-storage/src/dataset.rs:303
2932024-11-19T01:28:32.531ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_516208ff-c30f-4aff-8e5a-1912725b8a19 file = sled-storage/src/dataset.rs:389
2942024-11-19T01:28:32.539ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2952024-11-19T01:28:32.539ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2962024-11-19T01:28:32.539ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2972024-11-19T01:28:32.539ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2982024-11-19T01:28:32.539ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2992024-11-19T01:28:32.549ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3002024-11-19T01:28:32.549ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool)
3012024-11-19T01:28:32.643ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }
3022024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3032024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3042024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3052024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3062024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3072024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3082024-11-19T01:28:32.650ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3092024-11-19T01:28:32.684ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3102024-11-19T01:28:32.692ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone file = sled-storage/src/dataset.rs:303
3112024-11-19T01:28:32.860ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 file = sled-storage/src/dataset.rs:389
3122024-11-19T01:28:32.868ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3132024-11-19T01:28:32.868ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3142024-11-19T01:28:32.868ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3152024-11-19T01:28:32.868ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3162024-11-19T01:28:32.868ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3172024-11-19T01:28:32.878ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3182024-11-19T01:28:32.878ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool)
3192024-11-19T01:28:32.971ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }
3202024-11-19T01:28:32.980ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3212024-11-19T01:28:32.980ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3222024-11-19T01:28:32.980ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3232024-11-19T01:28:32.980ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3242024-11-19T01:28:32.980ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3252024-11-19T01:28:32.981ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3262024-11-19T01:28:32.981ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3272024-11-19T01:28:33.018ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3282024-11-19T01:28:33.027ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone file = sled-storage/src/dataset.rs:303
3292024-11-19T01:28:33.204ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 file = sled-storage/src/dataset.rs:389
3302024-11-19T01:28:33.212ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3312024-11-19T01:28:33.212ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3322024-11-19T01:28:33.212ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3332024-11-19T01:28:33.212ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3342024-11-19T01:28:33.212ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3352024-11-19T01:28:33.221ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3362024-11-19T01:28:33.221ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool)
3372024-11-19T01:28:33.316ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }
3382024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3392024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3402024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3412024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3422024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3432024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3442024-11-19T01:28:33.324ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3452024-11-19T01:28:33.328ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
3462024-11-19T01:28:33.361ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3472024-11-19T01:28:33.370ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone file = sled-storage/src/dataset.rs:303
3482024-11-19T01:28:33.544ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c file = sled-storage/src/dataset.rs:389
3492024-11-19T01:28:33.552ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3502024-11-19T01:28:33.552ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3512024-11-19T01:28:33.552ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3522024-11-19T01:28:33.552ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3532024-11-19T01:28:33.552ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3542024-11-19T01:28:33.561ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3552024-11-19T01:28:33.561ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4db3afbb-2372-4910-937c-04a030c788e8 (zpool)
3562024-11-19T01:28:33.654ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }
3572024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3582024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3592024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3602024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3612024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3622024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3632024-11-19T01:28:33.662ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3642024-11-19T01:28:33.699ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3652024-11-19T01:28:33.707ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone file = sled-storage/src/dataset.rs:303
3662024-11-19T01:28:33.880ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4db3afbb-2372-4910-937c-04a030c788e8 file = sled-storage/src/dataset.rs:389
3672024-11-19T01:28:33.888ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3682024-11-19T01:28:33.888ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3692024-11-19T01:28:33.888ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3702024-11-19T01:28:33.888ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3712024-11-19T01:28:33.888ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3722024-11-19T01:28:33.898ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3732024-11-19T01:28:33.898ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool)
3742024-11-19T01:28:33.992ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }
3752024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3762024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3772024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3782024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3792024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3802024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3812024-11-19T01:28:34.000ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3822024-11-19T01:28:34.036ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3832024-11-19T01:28:34.045ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_76d71a82-bade-4cd6-841f-df791cc1a175/crypt/zone file = sled-storage/src/dataset.rs:303
3842024-11-19T01:28:34.222ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_76d71a82-bade-4cd6-841f-df791cc1a175 file = sled-storage/src/dataset.rs:389
3852024-11-19T01:28:34.230ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3862024-11-19T01:28:34.230ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3872024-11-19T01:28:34.230ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3882024-11-19T01:28:34.230ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3892024-11-19T01:28:34.230ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3902024-11-19T01:28:34.240ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3912024-11-19T01:28:34.240ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ab199b91-015a-4655-9e04-9df66d150eb1 (zpool)
3922024-11-19T01:28:34.343ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }
3932024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3942024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3952024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3962024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3972024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3982024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3992024-11-19T01:28:34.351ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4002024-11-19T01:28:34.355ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4012024-11-19T01:28:34.387ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4022024-11-19T01:28:34.395ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone file = sled-storage/src/dataset.rs:303
4032024-11-19T01:28:34.568ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ab199b91-015a-4655-9e04-9df66d150eb1 file = sled-storage/src/dataset.rs:389
4042024-11-19T01:28:34.576ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4052024-11-19T01:28:34.576ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4062024-11-19T01:28:34.576ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4072024-11-19T01:28:34.576ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4082024-11-19T01:28:34.576ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4092024-11-19T01:28:34.586ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4102024-11-19T01:28:34.586ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e2481975-3977-496e-a270-5d45680952af (zpool)
4112024-11-19T01:28:34.703ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }
4122024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4132024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4142024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4152024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4162024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4172024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4182024-11-19T01:28:34.711ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4192024-11-19T01:28:34.747ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4202024-11-19T01:28:34.755ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e2481975-3977-496e-a270-5d45680952af/crypt/zone file = sled-storage/src/dataset.rs:303
4212024-11-19T01:28:34.928ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e2481975-3977-496e-a270-5d45680952af file = sled-storage/src/dataset.rs:389
4222024-11-19T01:28:34.935ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4232024-11-19T01:28:34.936ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4242024-11-19T01:28:34.936ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4252024-11-19T01:28:34.936ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4262024-11-19T01:28:34.936ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4272024-11-19T01:28:34.945ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4282024-11-19T01:28:34.945ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool)
4292024-11-19T01:28:35.043ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }
4302024-11-19T01:28:35.050ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4312024-11-19T01:28:35.051ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4322024-11-19T01:28:35.051ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4332024-11-19T01:28:35.051ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4342024-11-19T01:28:35.051ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4352024-11-19T01:28:35.051ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4362024-11-19T01:28:35.051ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4372024-11-19T01:28:35.087ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4382024-11-19T01:28:35.095ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone file = sled-storage/src/dataset.rs:303
4392024-11-19T01:28:35.272ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e file = sled-storage/src/dataset.rs:389
4402024-11-19T01:28:35.280ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4412024-11-19T01:28:35.280ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4422024-11-19T01:28:35.280ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-11-19T01:28:35.280ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d5fbaf8a-2201-4229-ba29-5652e47649ac (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5c454e00-8a58-4633-b736-9493cda9d7a0 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4442024-11-19T01:28:35.280ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4452024-11-19T01:28:35.280ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4462024-11-19T01:28:35.280ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4472024-11-19T01:28:35.280ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4482024-11-19T01:28:35.280ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4492024-11-19T01:28:35.280ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4502024-11-19T01:28:35.280ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4512024-11-19T01:28:35.280ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4522024-11-19T01:28:35.280ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4532024-11-19T01:28:35.280ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4542024-11-19T01:28:35.280ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4552024-11-19T01:28:35.280ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4562024-11-19T01:28:35.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3457674 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57678 req_id = 92c378a9-bb5e-4234-b11d-cf2471dc7532 response_code = 200 uri = /omicron-physical-disks
4572024-11-19T01:28:35.313ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00aafb3e-3d0d-4dd4-a4e2-b05e51ea7af6 (dataset): DatasetConfig { id: 00aafb3e-3d0d-4dd4-a4e2-b05e51ea7af6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02cee255-de9a-4154-a5ea-74eacc20f355 (dataset): DatasetConfig { id: 02cee255-de9a-4154-a5ea-74eacc20f355 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 066c6453-55df-423c-b52d-ca47fbe5098b (dataset): DatasetConfig { id: 066c6453-55df-423c-b52d-ca47fbe5098b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0aadf00d-4332-4a46-af5c-2bcbad6e5c3f (dataset): DatasetConfig { id: 0aadf00d-4332-4a46-af5c-2bcbad6e5c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b74ac1c-2d19-4fbc-a3f5-0bf6a3983eb8 (dataset): DatasetConfig { id: 0b74ac1c-2d19-4fbc-a3f5-0bf6a3983eb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1210f234-563d-42f2-ab3e-c6099056e007 (dataset): DatasetConfig { id: 1210f234-563d-42f2-ab3e-c6099056e007 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17c2cde1-8d64-427c-836a-5ea820cfdc3b (dataset): DatasetConfig { id: 17c2cde1-8d64-427c-836a-5ea820cfdc3b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ba4e4af-2ec4-4cf2-9cad-fc7bb3f17ab8 (dataset): DatasetConfig { id: 1ba4e4af-2ec4-4cf2-9cad-fc7bb3f17ab8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1bb5173e-c83d-4432-a425-ba04658f1088 (dataset): DatasetConfig { id: 1bb5173e-c83d-4432-a425-ba04658f1088 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1be7994d-73be-4800-82d7-b84073bfaf82 (dataset): DatasetConfig { id: 1be7994d-73be-4800-82d7-b84073bfaf82 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 250ed88c-42ed-4e85-9ebb-01ae2fbd6e24 (dataset): DatasetConfig { id: 250ed88c-42ed-4e85-9ebb-01ae2fbd6e24 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2542be7f-e358-405f-a59b-de0d5d28a4ea (dataset): DatasetConfig { id: 2542be7f-e358-405f-a59b-de0d5d28a4ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2683f80a-9daf-45d2-87a5-6d601b892ff2 (dataset): DatasetConfig { id: 2683f80a-9daf-45d2-87a5-6d601b892ff2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26b430b6-5771-4f29-a02d-a3c49510100e (dataset): DatasetConfig { id: 26b430b6-5771-4f29-a02d-a3c49510100e (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2704fa1f-2bdd-4489-82bf-2526d713324d (dataset): DatasetConfig { id: 2704fa1f-2bdd-4489-82bf-2526d713324d (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 290e29ef-8597-4d86-aaf5-981c31b85752 (dataset): DatasetConfig { id: 290e29ef-8597-4d86-aaf5-981c31b85752 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d73a5de-1065-484c-a146-100493651800 (dataset): DatasetConfig { id: 3d73a5de-1065-484c-a146-100493651800 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e689390-c9b2-46bf-a719-04ff445316a3 (dataset): DatasetConfig { id: 3e689390-c9b2-46bf-a719-04ff445316a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 402cf715-b7a4-48ae-a338-f2d26c0740e0 (dataset): DatasetConfig { id: 402cf715-b7a4-48ae-a338-f2d26c0740e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40538722-168a-43c4-afce-6ec340ea2836 (dataset): DatasetConfig { id: 40538722-168a-43c4-afce-6ec340ea2836 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48b15dd8-30d1-404e-9cde-04fe6cb12b30 (dataset): DatasetConfig { id: 48b15dd8-30d1-404e-9cde-04fe6cb12b30 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 574fa260-15ba-46a7-9d24-328f57254fa5 (dataset): DatasetConfig { id: 574fa260-15ba-46a7-9d24-328f57254fa5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 584d36cb-4826-4b48-8882-5e72941f6588 (dataset): DatasetConfig { id: 584d36cb-4826-4b48-8882-5e72941f6588 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d2d0480-7ea3-4c82-acf7-d8772a908571 (dataset): DatasetConfig { id: 5d2d0480-7ea3-4c82-acf7-d8772a908571 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d831469-c0bc-4614-af64-198caa676e72 (dataset): DatasetConfig { id: 5d831469-c0bc-4614-af64-198caa676e72 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 631b355b-1061-4a32-bf13-0c5225575cd4 (dataset): DatasetConfig { id: 631b355b-1061-4a32-bf13-0c5225575cd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69f5b43b-fcf6-4d4b-ba33-59df5f88d8e8 (dataset): DatasetConfig { id: 69f5b43b-fcf6-4d4b-ba33-59df5f88d8e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d46a46d-0f4c-44e6-9da1-56030056bf08 (dataset): DatasetConfig { id: 6d46a46d-0f4c-44e6-9da1-56030056bf08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eba5008-9b4a-4756-a930-9d4e236ccf84 (dataset): DatasetConfig { id: 6eba5008-9b4a-4756-a930-9d4e236ccf84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71f4c708-3e23-4fd4-b984-06f00ceecd80 (dataset): DatasetConfig { id: 71f4c708-3e23-4fd4-b984-06f00ceecd80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76924113-f909-40f8-ab25-1d48b735d955 (dataset): DatasetConfig { id: 76924113-f909-40f8-ab25-1d48b735d955 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78ed650c-320b-4551-a8a9-a6f66818fee6 (dataset): DatasetConfig { id: 78ed650c-320b-4551-a8a9-a6f66818fee6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 799736fc-7cef-4349-881b-b3d129047563 (dataset): DatasetConfig { id: 799736fc-7cef-4349-881b-b3d129047563 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a1101ad-5bdc-486c-9168-9b90710fe0d5 (dataset): DatasetConfig { id: 7a1101ad-5bdc-486c-9168-9b90710fe0d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a215f22-bf24-415b-8f91-45a727a6a25d (dataset): DatasetConfig { id: 7a215f22-bf24-415b-8f91-45a727a6a25d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cc654ac-c31d-46d0-865c-e9259a69a6cd (dataset): DatasetConfig { id: 7cc654ac-c31d-46d0-865c-e9259a69a6cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ddda738-e2b1-4a61-985a-05a4de364324 (dataset): DatasetConfig { id: 7ddda738-e2b1-4a61-985a-05a4de364324 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 806d89d3-e7c8-4578-af54-415dffb1407d (dataset): DatasetConfig { id: 806d89d3-e7c8-4578-af54-415dffb1407d (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80dfe649-ddbd-4e63-afd2-fa2f60c3b8a8 (dataset): DatasetConfig { id: 80dfe649-ddbd-4e63-afd2-fa2f60c3b8a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83996443-df4c-42aa-ad55-2d81eea69641 (dataset): DatasetConfig { id: 83996443-df4c-42aa-ad55-2d81eea69641 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a0c1b73-e29f-40eb-8b0c-186e20732b33 (dataset): DatasetConfig { id: 8a0c1b73-e29f-40eb-8b0c-186e20732b33 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8eb3b792-d9b0-4226-9f54-7225b683841d (dataset): DatasetConfig { id: 8eb3b792-d9b0-4226-9f54-7225b683841d (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f009052-0f57-4aba-8490-be1f72359244 (dataset): DatasetConfig { id: 8f009052-0f57-4aba-8490-be1f72359244 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95b262db-2e9e-438f-aa37-dcb01d6a61d9 (dataset): DatasetConfig { id: 95b262db-2e9e-438f-aa37-dcb01d6a61d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0499de8-13d1-4494-9100-2a688e5342df (dataset): DatasetConfig { id: a0499de8-13d1-4494-9100-2a688e5342df (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a385116d-a29d-4b6c-8991-350e379e23df (dataset): DatasetConfig { id: a385116d-a29d-4b6c-8991-350e379e23df (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4a52d1a-9dfe-44c8-b343-6058e93130e5 (dataset): DatasetConfig { id: a4a52d1a-9dfe-44c8-b343-6058e93130e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa2c9589-3434-4799-aa5f-8c3ecdf4b3fd (dataset): DatasetConfig { id: aa2c9589-3434-4799-aa5f-8c3ecdf4b3fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adc33823-dcec-432e-a4e7-be1e241ba164 (dataset): DatasetConfig { id: adc33823-dcec-432e-a4e7-be1e241ba164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b02c7dec-9868-415d-89a4-fcb4dc4e4b78 (dataset): DatasetConfig { id: b02c7dec-9868-415d-89a4-fcb4dc4e4b78 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8182e12-e9d9-452f-8bae-e35df28464d4 (dataset): DatasetConfig { id: b8182e12-e9d9-452f-8bae-e35df28464d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcdc3823-fc13-4175-81c0-d41ce6bf6fb4 (dataset): DatasetConfig { id: bcdc3823-fc13-4175-81c0-d41ce6bf6fb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bf0751e5-d50c-4de8-a2a5-4e2bdae7929f (dataset): DatasetConfig { id: bf0751e5-d50c-4de8-a2a5-4e2bdae7929f (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c09c9e6b-dba7-4893-bff8-1720e6c9e3e7 (dataset): DatasetConfig { id: c09c9e6b-dba7-4893-bff8-1720e6c9e3e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3a53535-a3e0-4358-8381-2e16c8dc3c65 (dataset): DatasetConfig { id: d3a53535-a3e0-4358-8381-2e16c8dc3c65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d42592b7-ea15-4df5-b2dd-a2c9966badf6 (dataset): DatasetConfig { id: d42592b7-ea15-4df5-b2dd-a2c9966badf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d449eff5-dfe6-4c45-9f5f-b8aae0a82b05 (dataset): DatasetConfig { id: d449eff5-dfe6-4c45-9f5f-b8aae0a82b05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dc87cb44-88aa-4865-b2e1-3adc09f3e403 (dataset): DatasetConfig { id: dc87cb44-88aa-4865-b2e1-3adc09f3e403 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd951bb1-97f6-4752-867c-eebeadd80a92 (dataset): DatasetConfig { id: dd951bb1-97f6-4752-867c-eebeadd80a92 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, de49d877-ca5f-4dab-be80-aca2db5b18aa (dataset): DatasetConfig { id: de49d877-ca5f-4dab-be80-aca2db5b18aa (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df8fdab0-6f8c-446e-b72b-669ca80649ff (dataset): DatasetConfig { id: df8fdab0-6f8c-446e-b72b-669ca80649ff (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e08f3a4f-7235-4087-bed6-e974af66efdc (dataset): DatasetConfig { id: e08f3a4f-7235-4087-bed6-e974af66efdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e438f1bd-4573-40b8-a3d0-1704b94dde58 (dataset): DatasetConfig { id: e438f1bd-4573-40b8-a3d0-1704b94dde58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e5ff750e-9034-47ab-bf3d-2d5a1b9c44c1 (dataset): DatasetConfig { id: e5ff750e-9034-47ab-bf3d-2d5a1b9c44c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faa9c2ef-c75f-4376-b316-4d3cebfe09cd (dataset): DatasetConfig { id: faa9c2ef-c75f-4376-b316-4d3cebfe09cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc123d7e-2a47-445f-8ab9-80fccd1d081d (dataset): DatasetConfig { id: fc123d7e-2a47-445f-8ab9-80fccd1d081d (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4582024-11-19T01:28:35.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42836
4592024-11-19T01:28:35.313ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4602024-11-19T01:28:35.316ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00aafb3e-3d0d-4dd4-a4e2-b05e51ea7af6 (dataset): DatasetConfig { id: 00aafb3e-3d0d-4dd4-a4e2-b05e51ea7af6 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02cee255-de9a-4154-a5ea-74eacc20f355 (dataset): DatasetConfig { id: 02cee255-de9a-4154-a5ea-74eacc20f355 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 066c6453-55df-423c-b52d-ca47fbe5098b (dataset): DatasetConfig { id: 066c6453-55df-423c-b52d-ca47fbe5098b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0aadf00d-4332-4a46-af5c-2bcbad6e5c3f (dataset): DatasetConfig { id: 0aadf00d-4332-4a46-af5c-2bcbad6e5c3f (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b74ac1c-2d19-4fbc-a3f5-0bf6a3983eb8 (dataset): DatasetConfig { id: 0b74ac1c-2d19-4fbc-a3f5-0bf6a3983eb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1210f234-563d-42f2-ab3e-c6099056e007 (dataset): DatasetConfig { id: 1210f234-563d-42f2-ab3e-c6099056e007 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17c2cde1-8d64-427c-836a-5ea820cfdc3b (dataset): DatasetConfig { id: 17c2cde1-8d64-427c-836a-5ea820cfdc3b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ba4e4af-2ec4-4cf2-9cad-fc7bb3f17ab8 (dataset): DatasetConfig { id: 1ba4e4af-2ec4-4cf2-9cad-fc7bb3f17ab8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1bb5173e-c83d-4432-a425-ba04658f1088 (dataset): DatasetConfig { id: 1bb5173e-c83d-4432-a425-ba04658f1088 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1be7994d-73be-4800-82d7-b84073bfaf82 (dataset): DatasetConfig { id: 1be7994d-73be-4800-82d7-b84073bfaf82 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 250ed88c-42ed-4e85-9ebb-01ae2fbd6e24 (dataset): DatasetConfig { id: 250ed88c-42ed-4e85-9ebb-01ae2fbd6e24 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2542be7f-e358-405f-a59b-de0d5d28a4ea (dataset): DatasetConfig { id: 2542be7f-e358-405f-a59b-de0d5d28a4ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2683f80a-9daf-45d2-87a5-6d601b892ff2 (dataset): DatasetConfig { id: 2683f80a-9daf-45d2-87a5-6d601b892ff2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26b430b6-5771-4f29-a02d-a3c49510100e (dataset): DatasetConfig { id: 26b430b6-5771-4f29-a02d-a3c49510100e (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2704fa1f-2bdd-4489-82bf-2526d713324d (dataset): DatasetConfig { id: 2704fa1f-2bdd-4489-82bf-2526d713324d (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 290e29ef-8597-4d86-aaf5-981c31b85752 (dataset): DatasetConfig { id: 290e29ef-8597-4d86-aaf5-981c31b85752 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d73a5de-1065-484c-a146-100493651800 (dataset): DatasetConfig { id: 3d73a5de-1065-484c-a146-100493651800 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e689390-c9b2-46bf-a719-04ff445316a3 (dataset): DatasetConfig { id: 3e689390-c9b2-46bf-a719-04ff445316a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 402cf715-b7a4-48ae-a338-f2d26c0740e0 (dataset): DatasetConfig { id: 402cf715-b7a4-48ae-a338-f2d26c0740e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40538722-168a-43c4-afce-6ec340ea2836 (dataset): DatasetConfig { id: 40538722-168a-43c4-afce-6ec340ea2836 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48b15dd8-30d1-404e-9cde-04fe6cb12b30 (dataset): DatasetConfig { id: 48b15dd8-30d1-404e-9cde-04fe6cb12b30 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 574fa260-15ba-46a7-9d24-328f57254fa5 (dataset): DatasetConfig { id: 574fa260-15ba-46a7-9d24-328f57254fa5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 584d36cb-4826-4b48-8882-5e72941f6588 (dataset): DatasetConfig { id: 584d36cb-4826-4b48-8882-5e72941f6588 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d2d0480-7ea3-4c82-acf7-d8772a908571 (dataset): DatasetConfig { id: 5d2d0480-7ea3-4c82-acf7-d8772a908571 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d831469-c0bc-4614-af64-198caa676e72 (dataset): DatasetConfig { id: 5d831469-c0bc-4614-af64-198caa676e72 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 631b355b-1061-4a32-bf13-0c5225575cd4 (dataset): DatasetConfig { id: 631b355b-1061-4a32-bf13-0c5225575cd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69f5b43b-fcf6-4d4b-ba33-59df5f88d8e8 (dataset): DatasetConfig { id: 69f5b43b-fcf6-4d4b-ba33-59df5f88d8e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d46a46d-0f4c-44e6-9da1-56030056bf08 (dataset): DatasetConfig { id: 6d46a46d-0f4c-44e6-9da1-56030056bf08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eba5008-9b4a-4756-a930-9d4e236ccf84 (dataset): DatasetConfig { id: 6eba5008-9b4a-4756-a930-9d4e236ccf84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71f4c708-3e23-4fd4-b984-06f00ceecd80 (dataset): DatasetConfig { id: 71f4c708-3e23-4fd4-b984-06f00ceecd80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76924113-f909-40f8-ab25-1d48b735d955 (dataset): DatasetConfig { id: 76924113-f909-40f8-ab25-1d48b735d955 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78ed650c-320b-4551-a8a9-a6f66818fee6 (dataset): DatasetConfig { id: 78ed650c-320b-4551-a8a9-a6f66818fee6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 799736fc-7cef-4349-881b-b3d129047563 (dataset): DatasetConfig { id: 799736fc-7cef-4349-881b-b3d129047563 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a1101ad-5bdc-486c-9168-9b90710fe0d5 (dataset): DatasetConfig { id: 7a1101ad-5bdc-486c-9168-9b90710fe0d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a215f22-bf24-415b-8f91-45a727a6a25d (dataset): DatasetConfig { id: 7a215f22-bf24-415b-8f91-45a727a6a25d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cc654ac-c31d-46d0-865c-e9259a69a6cd (dataset): DatasetConfig { id: 7cc654ac-c31d-46d0-865c-e9259a69a6cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ddda738-e2b1-4a61-985a-05a4de364324 (dataset): DatasetConfig { id: 7ddda738-e2b1-4a61-985a-05a4de364324 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 806d89d3-e7c8-4578-af54-415dffb1407d (dataset): DatasetConfig { id: 806d89d3-e7c8-4578-af54-415dffb1407d (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80dfe649-ddbd-4e63-afd2-fa2f60c3b8a8 (dataset): DatasetConfig { id: 80dfe649-ddbd-4e63-afd2-fa2f60c3b8a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83996443-df4c-42aa-ad55-2d81eea69641 (dataset): DatasetConfig { id: 83996443-df4c-42aa-ad55-2d81eea69641 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a0c1b73-e29f-40eb-8b0c-186e20732b33 (dataset): DatasetConfig { id: 8a0c1b73-e29f-40eb-8b0c-186e20732b33 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8eb3b792-d9b0-4226-9f54-7225b683841d (dataset): DatasetConfig { id: 8eb3b792-d9b0-4226-9f54-7225b683841d (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f009052-0f57-4aba-8490-be1f72359244 (dataset): DatasetConfig { id: 8f009052-0f57-4aba-8490-be1f72359244 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 95b262db-2e9e-438f-aa37-dcb01d6a61d9 (dataset): DatasetConfig { id: 95b262db-2e9e-438f-aa37-dcb01d6a61d9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0499de8-13d1-4494-9100-2a688e5342df (dataset): DatasetConfig { id: a0499de8-13d1-4494-9100-2a688e5342df (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a385116d-a29d-4b6c-8991-350e379e23df (dataset): DatasetConfig { id: a385116d-a29d-4b6c-8991-350e379e23df (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4a52d1a-9dfe-44c8-b343-6058e93130e5 (dataset): DatasetConfig { id: a4a52d1a-9dfe-44c8-b343-6058e93130e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa2c9589-3434-4799-aa5f-8c3ecdf4b3fd (dataset): DatasetConfig { id: aa2c9589-3434-4799-aa5f-8c3ecdf4b3fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adc33823-dcec-432e-a4e7-be1e241ba164 (dataset): DatasetConfig { id: adc33823-dcec-432e-a4e7-be1e241ba164 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b02c7dec-9868-415d-89a4-fcb4dc4e4b78 (dataset): DatasetConfig { id: b02c7dec-9868-415d-89a4-fcb4dc4e4b78 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8182e12-e9d9-452f-8bae-e35df28464d4 (dataset): DatasetConfig { id: b8182e12-e9d9-452f-8bae-e35df28464d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcdc3823-fc13-4175-81c0-d41ce6bf6fb4 (dataset): DatasetConfig { id: bcdc3823-fc13-4175-81c0-d41ce6bf6fb4 (dataset), name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bf0751e5-d50c-4de8-a2a5-4e2bdae7929f (dataset): DatasetConfig { id: bf0751e5-d50c-4de8-a2a5-4e2bdae7929f (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c09c9e6b-dba7-4893-bff8-1720e6c9e3e7 (dataset): DatasetConfig { id: c09c9e6b-dba7-4893-bff8-1720e6c9e3e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3a53535-a3e0-4358-8381-2e16c8dc3c65 (dataset): DatasetConfig { id: d3a53535-a3e0-4358-8381-2e16c8dc3c65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d42592b7-ea15-4df5-b2dd-a2c9966badf6 (dataset): DatasetConfig { id: d42592b7-ea15-4df5-b2dd-a2c9966badf6 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d449eff5-dfe6-4c45-9f5f-b8aae0a82b05 (dataset): DatasetConfig { id: d449eff5-dfe6-4c45-9f5f-b8aae0a82b05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, dc87cb44-88aa-4865-b2e1-3adc09f3e403 (dataset): DatasetConfig { id: dc87cb44-88aa-4865-b2e1-3adc09f3e403 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dd951bb1-97f6-4752-867c-eebeadd80a92 (dataset): DatasetConfig { id: dd951bb1-97f6-4752-867c-eebeadd80a92 (dataset), name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, de49d877-ca5f-4dab-be80-aca2db5b18aa (dataset): DatasetConfig { id: de49d877-ca5f-4dab-be80-aca2db5b18aa (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df8fdab0-6f8c-446e-b72b-669ca80649ff (dataset): DatasetConfig { id: df8fdab0-6f8c-446e-b72b-669ca80649ff (dataset), name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e08f3a4f-7235-4087-bed6-e974af66efdc (dataset): DatasetConfig { id: e08f3a4f-7235-4087-bed6-e974af66efdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e438f1bd-4573-40b8-a3d0-1704b94dde58 (dataset): DatasetConfig { id: e438f1bd-4573-40b8-a3d0-1704b94dde58 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e5ff750e-9034-47ab-bf3d-2d5a1b9c44c1 (dataset): DatasetConfig { id: e5ff750e-9034-47ab-bf3d-2d5a1b9c44c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faa9c2ef-c75f-4376-b316-4d3cebfe09cd (dataset): DatasetConfig { id: faa9c2ef-c75f-4376-b316-4d3cebfe09cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc123d7e-2a47-445f-8ab9-80fccd1d081d (dataset): DatasetConfig { id: fc123d7e-2a47-445f-8ab9-80fccd1d081d (dataset), name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4612024-11-19T01:28:35.316ZINFOSledAgent (StorageManager): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4622024-11-19T01:28:35.316ZINFOSledAgent (StorageManager): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4632024-11-19T01:28:35.316ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4642024-11-19T01:28:35.316ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-11-19T01:28:35.316ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone" } file = sled-storage/src/manager.rs:1331
4662024-11-19T01:28:35.357ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4672024-11-19T01:28:35.384ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-11-19T01:28:35.384ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf" } file = sled-storage/src/manager.rs:1331
4692024-11-19T01:28:35.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-11-19T01:28:35.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/debug"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/debug" } file = sled-storage/src/manager.rs:1331
4712024-11-19T01:28:35.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-11-19T01:28:35.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4732024-11-19T01:28:35.641ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-11-19T01:28:35.641ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b" } file = sled-storage/src/manager.rs:1331
4752024-11-19T01:28:35.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-11-19T01:28:35.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crucible" } file = sled-storage/src/manager.rs:1331
4772024-11-19T01:28:35.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-11-19T01:28:35.830ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4792024-11-19T01:28:35.920ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-11-19T01:28:35.920ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4812024-11-19T01:28:36.011ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-11-19T01:28:36.011ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone/oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone/oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45" } file = sled-storage/src/manager.rs:1331
4832024-11-19T01:28:36.112ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-11-19T01:28:36.112ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5" } file = sled-storage/src/manager.rs:1331
4852024-11-19T01:28:36.211ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-11-19T01:28:36.211ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7" } file = sled-storage/src/manager.rs:1331
4872024-11-19T01:28:36.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-11-19T01:28:36.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone/oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone/oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1" } file = sled-storage/src/manager.rs:1331
4892024-11-19T01:28:36.359ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
4902024-11-19T01:28:36.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-11-19T01:28:36.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4db3afbb-2372-4910-937c-04a030c788e8/crypt/debug"), full_name: "oxp_4db3afbb-2372-4910-937c-04a030c788e8/crypt/debug" } file = sled-storage/src/manager.rs:1331
4922024-11-19T01:28:36.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-11-19T01:28:36.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crucible" } file = sled-storage/src/manager.rs:1331
4942024-11-19T01:28:36.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-11-19T01:28:36.563ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2481975-3977-496e-a270-5d45680952af/crypt/zone"), full_name: "oxp_e2481975-3977-496e-a270-5d45680952af/crypt/zone" } file = sled-storage/src/manager.rs:1331
4962024-11-19T01:28:36.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-11-19T01:28:36.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone/oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone/oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda" } file = sled-storage/src/manager.rs:1331
4982024-11-19T01:28:36.730ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-11-19T01:28:36.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b" } file = sled-storage/src/manager.rs:1331
5002024-11-19T01:28:36.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-11-19T01:28:36.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/debug"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/debug" } file = sled-storage/src/manager.rs:1331
5022024-11-19T01:28:36.900ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-11-19T01:28:36.900ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91" } file = sled-storage/src/manager.rs:1331
5042024-11-19T01:28:37.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-11-19T01:28:37.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5062024-11-19T01:28:37.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-11-19T01:28:37.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/debug"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/debug" } file = sled-storage/src/manager.rs:1331
5082024-11-19T01:28:37.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-11-19T01:28:37.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/debug"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/debug" } file = sled-storage/src/manager.rs:1331
5102024-11-19T01:28:37.234ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-11-19T01:28:37.234ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5122024-11-19T01:28:37.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-11-19T01:28:37.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone"), full_name: "oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5142024-11-19T01:28:37.364ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
5152024-11-19T01:28:37.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-11-19T01:28:37.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5172024-11-19T01:28:37.489ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-11-19T01:28:37.489ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone/oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e"), full_name: "oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone/oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e" } file = sled-storage/src/manager.rs:1331
5192024-11-19T01:28:37.587ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-11-19T01:28:37.587ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4db3afbb-2372-4910-937c-04a030c788e8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5212024-11-19T01:28:37.678ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-11-19T01:28:37.678ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5232024-11-19T01:28:37.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-11-19T01:28:37.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone/oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5"), full_name: "oxp_4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone/oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5" } file = sled-storage/src/manager.rs:1331
5252024-11-19T01:28:37.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-11-19T01:28:37.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5272024-11-19T01:28:37.936ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-11-19T01:28:37.936ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e" } file = sled-storage/src/manager.rs:1331
5292024-11-19T01:28:38.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-11-19T01:28:38.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone/oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone/oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5" } file = sled-storage/src/manager.rs:1331
5312024-11-19T01:28:38.140ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-11-19T01:28:38.140ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410" } file = sled-storage/src/manager.rs:1331
5332024-11-19T01:28:38.239ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-11-19T01:28:38.239ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crucible" } file = sled-storage/src/manager.rs:1331
5352024-11-19T01:28:38.330ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-11-19T01:28:38.330ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4db3afbb-2372-4910-937c-04a030c788e8/crucible" } file = sled-storage/src/manager.rs:1331
5372024-11-19T01:28:38.366ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
5382024-11-19T01:28:38.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-11-19T01:28:38.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone" } file = sled-storage/src/manager.rs:1331
5402024-11-19T01:28:38.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-11-19T01:28:38.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone/oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d"), full_name: "oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/zone/oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d" } file = sled-storage/src/manager.rs:1331
5422024-11-19T01:28:38.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5432024-11-19T01:28:38.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b" } file = sled-storage/src/manager.rs:1331
5442024-11-19T01:28:38.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-11-19T01:28:38.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2481975-3977-496e-a270-5d45680952af/crypt/zone/oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73"), full_name: "oxp_e2481975-3977-496e-a270-5d45680952af/crypt/zone/oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73" } file = sled-storage/src/manager.rs:1331
5462024-11-19T01:28:38.777ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-11-19T01:28:38.777ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/zone/oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3" } file = sled-storage/src/manager.rs:1331
5482024-11-19T01:28:38.876ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-11-19T01:28:38.876ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e2481975-3977-496e-a270-5d45680952af/crucible" } file = sled-storage/src/manager.rs:1331
5502024-11-19T01:28:38.964ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-11-19T01:28:38.964ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_76d71a82-bade-4cd6-841f-df791cc1a175/crucible" } file = sled-storage/src/manager.rs:1331
5522024-11-19T01:28:39.052ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-11-19T01:28:39.052ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5542024-11-19T01:28:39.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-11-19T01:28:39.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone/oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone/oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab" } file = sled-storage/src/manager.rs:1331
5562024-11-19T01:28:39.242ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-11-19T01:28:39.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone/oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045"), full_name: "oxp_4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone/oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045" } file = sled-storage/src/manager.rs:1331
5582024-11-19T01:28:39.342ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-11-19T01:28:39.342ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crucible" } file = sled-storage/src/manager.rs:1331
5602024-11-19T01:28:39.368ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
5612024-11-19T01:28:39.430ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5622024-11-19T01:28:39.430ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crucible" } file = sled-storage/src/manager.rs:1331
5632024-11-19T01:28:39.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5642024-11-19T01:28:39.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5652024-11-19T01:28:39.608ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5662024-11-19T01:28:39.608ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crucible" } file = sled-storage/src/manager.rs:1331
5672024-11-19T01:28:39.723ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-11-19T01:28:39.723ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1" } file = sled-storage/src/manager.rs:1331
5692024-11-19T01:28:39.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-11-19T01:28:39.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a" } file = sled-storage/src/manager.rs:1331
5712024-11-19T01:28:39.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-11-19T01:28:39.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/debug"), full_name: "oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crypt/debug" } file = sled-storage/src/manager.rs:1331
5732024-11-19T01:28:39.992ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-11-19T01:28:39.992ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/76d71a82-bade-4cd6-841f-df791cc1a175/crypt/zone/oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e"), full_name: "oxp_76d71a82-bade-4cd6-841f-df791cc1a175/crypt/zone/oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e" } file = sled-storage/src/manager.rs:1331
5752024-11-19T01:28:40.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-11-19T01:28:40.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5772024-11-19T01:28:40.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-11-19T01:28:40.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone"), full_name: "oxp_4db3afbb-2372-4910-937c-04a030c788e8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5792024-11-19T01:28:40.253ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-11-19T01:28:40.253ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone/oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone/oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd" } file = sled-storage/src/manager.rs:1331
5812024-11-19T01:28:40.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-11-19T01:28:40.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/76d71a82-bade-4cd6-841f-df791cc1a175/crypt/debug"), full_name: "oxp_76d71a82-bade-4cd6-841f-df791cc1a175/crypt/debug" } file = sled-storage/src/manager.rs:1331
5832024-11-19T01:28:40.370ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
5842024-11-19T01:28:40.428ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5852024-11-19T01:28:40.428ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2481975-3977-496e-a270-5d45680952af/crypt/zone/oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6"), full_name: "oxp_e2481975-3977-496e-a270-5d45680952af/crypt/zone/oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6" } file = sled-storage/src/manager.rs:1331
5862024-11-19T01:28:40.527ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5872024-11-19T01:28:40.527ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e2481975-3977-496e-a270-5d45680952af/crypt/debug"), full_name: "oxp_e2481975-3977-496e-a270-5d45680952af/crypt/debug" } file = sled-storage/src/manager.rs:1331
5882024-11-19T01:28:40.594ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5892024-11-19T01:28:40.594ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e" } file = sled-storage/src/manager.rs:1331
5902024-11-19T01:28:40.691ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5912024-11-19T01:28:40.691ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone"), full_name: "oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/zone" } file = sled-storage/src/manager.rs:1331
5922024-11-19T01:28:40.758ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5932024-11-19T01:28:40.758ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/76d71a82-bade-4cd6-841f-df791cc1a175/crypt/zone"), full_name: "oxp_76d71a82-bade-4cd6-841f-df791cc1a175/crypt/zone" } file = sled-storage/src/manager.rs:1331
5942024-11-19T01:28:40.791ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5952024-11-19T01:28:40.791ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5962024-11-19T01:28:40.798ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5972024-11-19T01:28:40.798ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5982024-11-19T01:28:40.840ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5992024-11-19T01:28:40.840ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/debug"), full_name: "oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/debug" } file = sled-storage/src/manager.rs:1331
6002024-11-19T01:28:40.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012024-11-19T01:28:40.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone/oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099" } file = sled-storage/src/manager.rs:1331
6022024-11-19T01:28:40.953ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6032024-11-19T01:28:40.953ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6042024-11-19T01:28:40.999ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6052024-11-19T01:28:40.999ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6062024-11-19T01:28:41.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6072024-11-19T01:28:41.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3"), full_name: "oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/zone/oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3" } file = sled-storage/src/manager.rs:1331
6082024-11-19T01:28:41.050ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6092024-11-19T01:28:41.050ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6102024-11-19T01:28:41.070ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6112024-11-19T01:28:41.070ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6122024-11-19T01:28:41.143ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6132024-11-19T01:28:41.143ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6142024-11-19T01:28:41.145ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6152024-11-19T01:28:41.145ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone"), full_name: "oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/zone" } file = sled-storage/src/manager.rs:1331
6162024-11-19T01:28:41.224ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6172024-11-19T01:28:41.227ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6182024-11-19T01:28:41.228ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6192024-11-19T01:28:41.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5914769 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42836 req_id = 20506433-a3dd-4be3-bf0a-b8f8f110b155 response_code = 200 uri = /datasets
6202024-11-19T01:28:41.234ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6212024-11-19T01:28:41.234ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6222024-11-19T01:28:41.273ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6232024-11-19T01:28:41.273ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6242024-11-19T01:28:41.285ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: efd7fee1-3fb4-451f-a329-22d734d942b3 (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1 (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6252024-11-19T01:28:41.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61963
6262024-11-19T01:28:41.286ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6272024-11-19T01:28:41.286ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6282024-11-19T01:28:41.295ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6292024-11-19T01:28:41.295ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/nexus.rs:527 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6302024-11-19T01:28:41.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6312024-11-19T01:28:41.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6322024-11-19T01:28:41.342ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6332024-11-19T01:28:41.342ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6342024-11-19T01:28:41.342ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 1
6352024-11-19T01:28:41.342ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6362024-11-19T01:28:41.351ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6372024-11-19T01:28:41.351ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6382024-11-19T01:28:41.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6392024-11-19T01:28:41.383ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:188
6402024-11-19T01:28:41.383ZINFOSledAgent (ServiceManager): No ledger in /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:188
6412024-11-19T01:28:41.383ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6422024-11-19T01:28:41.388ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6432024-11-19T01:28:41.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6442024-11-19T01:28:41.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6452024-11-19T01:28:41.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6462024-11-19T01:28:41.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6472024-11-19T01:28:41.456ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6482024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6492024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6502024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6512024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6522024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6532024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6542024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6552024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6562024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6572024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6582024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6592024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6602024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6612024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6622024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6632024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6642024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6652024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6662024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6672024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6682024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6692024-11-19T01:28:41.456ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6702024-11-19T01:28:41.490ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1 file = illumos-utils/src/zone.rs:325
6712024-11-19T01:28:41.495ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 file = illumos-utils/src/zone.rs:325
6722024-11-19T01:28:41.499ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3 file = illumos-utils/src/zone.rs:325
6732024-11-19T01:28:41.511ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1 file = illumos-utils/src/zone.rs:363
6742024-11-19T01:28:41.516ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 file = illumos-utils/src/zone.rs:363
6752024-11-19T01:28:41.520ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3 file = illumos-utils/src/zone.rs:363
6762024-11-19T01:28:41.974ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6772024-11-19T01:28:41.974ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6782024-11-19T01:28:42.390ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
6792024-11-19T01:28:43.123ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-11-19T01:28:43.124ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6812024-11-19T01:28:43.124ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
6822024-11-19T01:28:43.611ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-11-19T01:28:43.611ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6842024-11-19T01:28:44.093ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-11-19T01:28:44.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 58.103232ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
6862024-11-19T01:28:44.102ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
6872024-11-19T01:28:44.106ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6882024-11-19T01:28:44.106ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
6892024-11-19T01:28:44.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 117.887819ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
6902024-11-19T01:28:44.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 63.046126ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
6912024-11-19T01:28:44.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 45.299593ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
6922024-11-19T01:28:44.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 134.368301ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
6932024-11-19T01:28:44.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 180.73888ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
6942024-11-19T01:28:44.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 85.780227ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
6952024-11-19T01:28:44.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 215.791901ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
6962024-11-19T01:28:44.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 143.644979ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
6972024-11-19T01:28:44.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 440.929794ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
6982024-11-19T01:28:44.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 266.886945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
6992024-11-19T01:28:44.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 233.595644ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7002024-11-19T01:28:45.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 756.840794ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
7012024-11-19T01:28:45.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 1.003278224s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7022024-11-19T01:28:45.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 755.901947ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
7032024-11-19T01:28:45.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 787.978001ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
7042024-11-19T01:28:45.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 716.236319ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
7052024-11-19T01:28:46.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 936.118302ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7062024-11-19T01:28:46.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 1.032050065s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
7072024-11-19T01:28:46.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 757.068493ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
7082024-11-19T01:28:46.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 655.912255ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7092024-11-19T01:28:47.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 1.180627356s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
7102024-11-19T01:28:47.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 940.17522ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
7112024-11-19T01:28:47.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 1.398259898s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7122024-11-19T01:28:48.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1") failed: Property not found. retry in 949.345048ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
7132024-11-19T01:28:48.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3") failed: Property not found. retry in 1.211564248s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
7142024-11-19T01:28:49.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1") failed: Property not found. retry in 831.602915ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7152024-11-19T01:28:49.916ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_efd7fee1-3fb4-451f-a329-22d734d942b3
7162024-11-19T01:28:49.916ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_1e98d393-d940-4def-ba7c-d8c67ea23aa1
7172024-11-19T01:28:49.916ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1
7182024-11-19T01:28:49.916ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7192024-11-19T01:28:49.916ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7202024-11-19T01:28:49.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8630648 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61963 req_id = 060a556e-66b1-4772-b6c9-f71d90a281df response_code = 204 uri = /omicron-zones
7212024-11-19T01:28:49.918ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7222024-11-19T01:28:50.254ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 50.502318ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7232024-11-19T01:28:50.305ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 125.995578ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7242024-11-19T01:28:50.449ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7252024-11-19T01:28:50.503ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7262024-11-19T01:28:50.551ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7272024-11-19T01:28:50.551ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7282024-11-19T01:28:50.583ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7292024-11-19T01:28:50.584ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7302024-11-19T01:28:50.584ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7312024-11-19T01:28:50.614ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: efd7fee1-3fb4-451f-a329-22d734d942b3 (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1 (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 (service), filesystem_pool: Some(ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2b836f65-e5cf-4810-a941-3674eca3485f, kind: Service { id: 21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 }, name: Name("ntp-21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 44])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7322024-11-19T01:28:50.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39414
7332024-11-19T01:28:50.614ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7342024-11-19T01:28:50.614ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7352024-11-19T01:28:50.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7362024-11-19T01:28:50.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7372024-11-19T01:28:50.692ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7382024-11-19T01:28:50.692ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7392024-11-19T01:28:50.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7402024-11-19T01:28:50.727ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
7412024-11-19T01:28:50.727ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
7422024-11-19T01:28:50.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7432024-11-19T01:28:50.740ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7442024-11-19T01:28:50.774ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7452024-11-19T01:28:50.774ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7462024-11-19T01:28:50.774ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7472024-11-19T01:28:50.804ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 131, 44]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7482024-11-19T01:28:50.804ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7492024-11-19T01:28:50.805ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7502024-11-19T01:28:50.805ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7512024-11-19T01:28:50.805ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7522024-11-19T01:28:50.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7532024-11-19T01:28:50.831ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 file = illumos-utils/src/zone.rs:325
7542024-11-19T01:28:50.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 file = illumos-utils/src/zone.rs:363
7552024-11-19T01:28:51.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7562024-11-19T01:28:51.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7572024-11-19T01:28:51.462ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7582024-11-19T01:28:51.462ZINFOSledAgent (ServiceManager): Booting oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7592024-11-19T01:28:51.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 37.083646ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7602024-11-19T01:28:51.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 142.185102ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7612024-11-19T01:28:51.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 250.011926ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7622024-11-19T01:28:51.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7632024-11-19T01:28:51.976ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7642024-11-19T01:28:52.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 253.2486ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7652024-11-19T01:28:52.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 661.070253ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7662024-11-19T01:28:52.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 1.38507253s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7672024-11-19T01:28:54.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 567.130266ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7682024-11-19T01:28:54.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 1.358315935s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7692024-11-19T01:28:56.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5") failed: Property not found. retry in 612.445503ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7702024-11-19T01:28:56.958ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5
7712024-11-19T01:28:56.958ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722024-11-19T01:28:56.958ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7732024-11-19T01:28:56.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6344610 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39414 req_id = 94fbb149-1763-47ea-b12d-6aaf745ed208 response_code = 204 uri = /omicron-zones
7742024-11-19T01:28:56.961ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7752024-11-19T01:28:56.990ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7762024-11-19T01:28:56.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44856
7772024-11-19T01:28:56.999ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7782024-11-19T01:28:56.999ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44856 req_id = 1d37a7a4-6f05-45ee-9203-68add5dae89c response_code = 500 uri = /timesync
7792024-11-19T01:28:57.001ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7802024-11-19T01:28:57.167ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7812024-11-19T01:28:57.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34138
7822024-11-19T01:28:59.505ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7832024-11-19T01:28:59.776ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7842024-11-19T01:28:59.919ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7852024-11-19T01:29:01.176ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-11-19T01:29:01.176ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008661 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34138 req_id = d5c31d40-81c3-40c9-b564-9d91ab664461 response_code = 500 uri = /timesync
7872024-11-19T01:29:01.178ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7882024-11-19T01:29:01.276ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7892024-11-19T01:29:01.277ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7902024-11-19T01:29:01.360ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7912024-11-19T01:29:01.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49976
7922024-11-19T01:29:01.369ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7932024-11-19T01:29:01.370ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49976 req_id = ba5149eb-eaf3-446a-a153-99b49b49b938 response_code = 500 uri = /timesync
7942024-11-19T01:29:01.371ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7952024-11-19T01:29:01.538ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7962024-11-19T01:29:01.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52488
7972024-11-19T01:29:01.978ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7982024-11-19T01:29:01.978ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
7992024-11-19T01:29:05.589ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8002024-11-19T01:29:05.589ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52488 req_id = 2407d1ed-c062-424e-8cb5-8441a9e6ab15 response_code = 500 uri = /timesync
8012024-11-19T01:29:05.591ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8022024-11-19T01:29:05.798ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8032024-11-19T01:29:05.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59128
8042024-11-19T01:29:05.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59128 req_id = 44456b86-90d7-4075-b89a-09ab836c5634 response_code = 200 uri = /timesync
8052024-11-19T01:29:05.808ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.323987424 } file = sled-agent/src/rack_setup/service.rs:740
8062024-11-19T01:29:05.808ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8072024-11-19T01:29:06.105ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8082024-11-19T01:29:06.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38561
8092024-11-19T01:29:06.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38561 req_id = 0885dcec-714f-4377-b8f4-63c18cf5d36f response_code = 200 uri = /timesync
8102024-11-19T01:29:06.116ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.323153675 } file = sled-agent/src/rack_setup/service.rs:740
8112024-11-19T01:29:06.116ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8122024-11-19T01:29:06.399ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8132024-11-19T01:29:06.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63833
8142024-11-19T01:29:06.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8380 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63833 req_id = e622ca98-612d-457a-9c21-eab724b86445 response_code = 200 uri = /timesync
8152024-11-19T01:29:06.409ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.322355568 } file = sled-agent/src/rack_setup/service.rs:740
8162024-11-19T01:29:06.409ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8172024-11-19T01:29:06.685ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8182024-11-19T01:29:06.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59445
8192024-11-19T01:29:06.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8435 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59445 req_id = a77e457f-beb4-4c36-b244-26526e479038 response_code = 200 uri = /timesync
8202024-11-19T01:29:06.696ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.320729971 } file = sled-agent/src/rack_setup/service.rs:740
8212024-11-19T01:29:06.696ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8222024-11-19T01:29:06.945ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8232024-11-19T01:29:06.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38848
8242024-11-19T01:29:06.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38848 req_id = b11c0f65-469f-4fa3-a23a-e5cca4d07a28 response_code = 200 uri = /timesync
8252024-11-19T01:29:06.955ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.320025623 } file = sled-agent/src/rack_setup/service.rs:740
8262024-11-19T01:29:06.955ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8272024-11-19T01:29:07.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8282024-11-19T01:29:07.000ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8292024-11-19T01:29:07.450ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8302024-11-19T01:29:07.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40753
8312024-11-19T01:29:07.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8550 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40753 req_id = 4f6844be-81a6-4532-80f3-d649723e2230 response_code = 200 uri = /timesync
8322024-11-19T01:29:07.460ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.318654686 } file = sled-agent/src/rack_setup/service.rs:740
8332024-11-19T01:29:07.460ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8342024-11-19T01:29:08.042ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8352024-11-19T01:29:08.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43833
8362024-11-19T01:29:08.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43833 req_id = f44c23b1-dcfa-492a-990c-13c3a51efa78 response_code = 200 uri = /timesync
8372024-11-19T01:29:08.054ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.314022332 } file = sled-agent/src/rack_setup/service.rs:740
8382024-11-19T01:29:08.054ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8392024-11-19T01:29:08.464ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 243.887248ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8402024-11-19T01:29:08.639ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8412024-11-19T01:29:08.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38012
8422024-11-19T01:29:08.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8721 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38012 req_id = 952d80b3-a628-404a-a21c-feff0a65fa58 response_code = 200 uri = /timesync
8432024-11-19T01:29:08.652ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.312399238 } file = sled-agent/src/rack_setup/service.rs:740
8442024-11-19T01:29:08.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8452024-11-19T01:29:09.187ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8462024-11-19T01:29:09.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63373
8472024-11-19T01:29:09.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8681 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63373 req_id = 32c3ec0b-2344-40eb-b3af-788e4bd85ca3 response_code = 200 uri = /timesync
8482024-11-19T01:29:09.200ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979747.709367, correction: -0.307833463 } file = sled-agent/src/rack_setup/service.rs:740
8492024-11-19T01:29:09.200ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8502024-11-19T01:29:09.539ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8512024-11-19T01:29:09.808ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8522024-11-19T01:29:09.923ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8532024-11-19T01:29:09.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37058
8542024-11-19T01:29:09.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37058 req_id = cc1cfecc-5eed-4950-9ada-3195fb0ac7fe response_code = 200 uri = /timesync
8552024-11-19T01:29:09.935ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979749.1630225, correction: -0.303073168 } file = sled-agent/src/rack_setup/service.rs:740
8562024-11-19T01:29:09.935ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8572024-11-19T01:29:09.951ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8582024-11-19T01:29:11.042ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54169
8592024-11-19T01:29:11.042ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54169 req_id = 13bfcb35-de2c-40b0-876b-b33868c138ef response_code = 200 uri = /baseboard
8602024-11-19T01:29:11.305ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8612024-11-19T01:29:11.305ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8622024-11-19T01:29:11.457ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8632024-11-19T01:29:11.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59457
8642024-11-19T01:29:11.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9548 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59457 req_id = 7d2cfcc5-20d6-4ef1-abff-307ae1c18553 response_code = 200 uri = /timesync
8652024-11-19T01:29:11.469ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979750.2713046, correction: -0.29758814 } file = sled-agent/src/rack_setup/service.rs:740
8662024-11-19T01:29:11.469ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8672024-11-19T01:29:12.004ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8682024-11-19T01:29:12.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8692024-11-19T01:29:12.854ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8702024-11-19T01:29:12.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42708
8712024-11-19T01:29:12.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42708 req_id = 98df46f5-78d2-4405-ac3c-9907fb2ab5a0 response_code = 200 uri = /timesync
8722024-11-19T01:29:12.864ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979751.5469997, correction: -0.293493122 } file = sled-agent/src/rack_setup/service.rs:740
8732024-11-19T01:29:12.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8742024-11-19T01:29:14.121ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8752024-11-19T01:29:14.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34905
8762024-11-19T01:29:14.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34905 req_id = d7d5938f-fd43-4886-bea8-092e54431153 response_code = 200 uri = /timesync
8772024-11-19T01:29:14.132ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979752.483565, correction: -0.289932758 } file = sled-agent/src/rack_setup/service.rs:740
8782024-11-19T01:29:14.132ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8792024-11-19T01:29:16.400ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8802024-11-19T01:29:16.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46530
8812024-11-19T01:29:16.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46530 req_id = 76afeafe-9192-45fa-a6b3-57ec0b806fca response_code = 200 uri = /timesync
8822024-11-19T01:29:16.413ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979755.099633, correction: -0.283699751 } file = sled-agent/src/rack_setup/service.rs:740
8832024-11-19T01:29:16.413ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8842024-11-19T01:29:16.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8852024-11-19T01:29:16.975ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8862024-11-19T01:29:17.764ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8872024-11-19T01:29:17.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51817
8882024-11-19T01:29:17.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7973 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51817 req_id = 8ed675f1-dfff-4cf1-b274-941f41213860 response_code = 200 uri = /timesync
8892024-11-19T01:29:17.774ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979757.316968, correction: -0.280168653 } file = sled-agent/src/rack_setup/service.rs:740
8902024-11-19T01:29:17.774ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8912024-11-19T01:29:19.386ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8922024-11-19T01:29:19.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39098
8932024-11-19T01:29:19.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8694 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39098 req_id = 159f8f00-0a44-4686-b28b-0d633418834f response_code = 200 uri = /timesync
8942024-11-19T01:29:19.397ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979757.8994298, correction: -0.275800347 } file = sled-agent/src/rack_setup/service.rs:740
8952024-11-19T01:29:19.397ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8962024-11-19T01:29:19.515ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8972024-11-19T01:29:19.782ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8982024-11-19T01:29:19.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
8992024-11-19T01:29:21.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9002024-11-19T01:29:21.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9012024-11-19T01:29:21.980ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9022024-11-19T01:29:21.980ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9032024-11-19T01:29:23.340ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9042024-11-19T01:29:23.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59043
9052024-11-19T01:29:23.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59043 req_id = 22691865-6796-41e2-a9b1-88e16de5b6ae response_code = 200 uri = /timesync
9062024-11-19T01:29:23.351ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979762.3750925, correction: -0.265052915 } file = sled-agent/src/rack_setup/service.rs:740
9072024-11-19T01:29:23.351ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9082024-11-19T01:29:23.701ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 292.786931ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9092024-11-19T01:29:26.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9102024-11-19T01:29:26.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9112024-11-19T01:29:27.862ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9122024-11-19T01:29:27.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62818
9132024-11-19T01:29:27.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62818 req_id = a350df05-822e-4564-b43d-6b03dd7baee2 response_code = 200 uri = /timesync
9142024-11-19T01:29:27.874ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979767.4826434, correction: -0.252779484 } file = sled-agent/src/rack_setup/service.rs:740
9152024-11-19T01:29:27.874ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9162024-11-19T01:29:29.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9172024-11-19T01:29:29.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9182024-11-19T01:29:29.901ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9192024-11-19T01:29:31.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9202024-11-19T01:29:31.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9212024-11-19T01:29:31.955ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9222024-11-19T01:29:31.955ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9232024-11-19T01:29:33.333ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9242024-11-19T01:29:33.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49075
9252024-11-19T01:29:33.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9ca5a7b-8277-4cd3-8b2d-8913f08b835e response_code = 200 uri = /timesync
9262024-11-19T01:29:33.345ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 852310310, ip_addr: 50.205.57.38, stratum: 2, ref_time: 1731979771.699515, correction: -0.237930983 } file = sled-agent/src/rack_setup/service.rs:740
9272024-11-19T01:29:33.345ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9282024-11-19T01:29:36.924ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9292024-11-19T01:29:36.925ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9302024-11-19T01:29:38.987ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.482170426s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9312024-11-19T01:29:39.163ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9322024-11-19T01:29:39.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47904
9332024-11-19T01:29:39.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9006 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47904 req_id = b3b566dd-fd01-4726-a422-7a1125d18ce3 response_code = 200 uri = /timesync
9342024-11-19T01:29:39.174ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979778.4917002, correction: -0.224330738 } file = sled-agent/src/rack_setup/service.rs:740
9352024-11-19T01:29:39.174ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9362024-11-19T01:29:39.465ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9372024-11-19T01:29:39.732ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9382024-11-19T01:29:39.875ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9392024-11-19T01:29:40.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61709
9402024-11-19T01:29:40.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61709 req_id = e61c8b06-83d9-4506-95bd-9ecb8d986d3b response_code = 200 uri = /baseboard
9412024-11-19T01:29:41.230ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1543194213685851063 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9422024-11-19T01:29:41.231ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5395967824530596132 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9432024-11-19T01:29:41.930ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9442024-11-19T01:29:41.930ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9452024-11-19T01:29:42.687ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9462024-11-19T01:29:42.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38456
9472024-11-19T01:29:42.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8973 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38456 req_id = c7e5ede4-1607-4195-8d56-c550291d89bc response_code = 200 uri = /timesync
9482024-11-19T01:29:42.700ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979781.327165, correction: -0.214724541 } file = sled-agent/src/rack_setup/service.rs:740
9492024-11-19T01:29:42.700ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9502024-11-19T01:29:46.900ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9512024-11-19T01:29:46.900ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9522024-11-19T01:29:47.839ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9532024-11-19T01:29:47.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35755
9542024-11-19T01:29:47.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8999 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35755 req_id = 540e95d1-456a-4064-9d17-9bce13f10df0 response_code = 200 uri = /timesync
9552024-11-19T01:29:47.851ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979786.669827, correction: -0.200714782 } file = sled-agent/src/rack_setup/service.rs:740
9562024-11-19T01:29:47.851ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9572024-11-19T01:29:49.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9582024-11-19T01:29:49.707ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9592024-11-19T01:29:49.849ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9602024-11-19T01:29:51.905ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9612024-11-19T01:29:51.905ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9622024-11-19T01:29:53.292ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9632024-11-19T01:29:53.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34656
9642024-11-19T01:29:53.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34656 req_id = 3e66f56c-7ba5-4f82-87b9-f2bade9ba528 response_code = 200 uri = /timesync
9652024-11-19T01:29:53.303ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979789.6399207, correction: -0.185878292 } file = sled-agent/src/rack_setup/service.rs:740
9662024-11-19T01:29:53.303ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9672024-11-19T01:29:55.460ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.868251171s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9682024-11-19T01:29:56.875ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9692024-11-19T01:29:56.875ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9702024-11-19T01:29:59.416ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12205343594117466016 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9712024-11-19T01:29:59.682ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7673205505297649017 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9722024-11-19T01:29:59.823ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18255154247134491800 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9732024-11-19T01:30:01.333ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9742024-11-19T01:30:01.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61257
9752024-11-19T01:30:01.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9977 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61257 req_id = 0c4667c1-c533-4470-a1d6-5df9e3ecfb59 response_code = 200 uri = /timesync
9762024-11-19T01:30:01.345ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979789.6399207, correction: -0.164039031 } file = sled-agent/src/rack_setup/service.rs:740
9772024-11-19T01:30:01.345ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9782024-11-19T01:30:01.881ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9792024-11-19T01:30:01.881ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9802024-11-19T01:30:06.851ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16099661266490545479 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9812024-11-19T01:30:06.851ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15187233314522025148 reason = Duration(60s) sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9822024-11-19T01:30:10.950ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64428
9832024-11-19T01:30:10.950ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64428 req_id = 1a682a69-811f-48d1-99e9-1eabd8763464 response_code = 200 uri = /baseboard
9842024-11-19T01:30:11.856ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9852024-11-19T01:30:11.856ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9862024-11-19T01:30:13.315ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.61069449s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9872024-11-19T01:30:15.813ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9882024-11-19T01:30:15.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63332
9892024-11-19T01:30:15.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8950 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63332 req_id = 3c2b5c50-71bc-4655-a21a-06c7ac4d1f2b response_code = 200 uri = /timesync
9902024-11-19T01:30:15.825ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979789.6399207, correction: -0.124716453 } file = sled-agent/src/rack_setup/service.rs:740
9912024-11-19T01:30:15.825ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9922024-11-19T01:30:21.830ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9932024-11-19T01:30:21.830ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
9942024-11-19T01:30:24.449ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9952024-11-19T01:30:24.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58533
9962024-11-19T01:30:24.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8453 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58533 req_id = efd44d2a-8875-45b5-9fd9-a20af880e400 response_code = 200 uri = /timesync
9972024-11-19T01:30:24.460ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979789.6399207, correction: -0.101265773 } file = sled-agent/src/rack_setup/service.rs:740
9982024-11-19T01:30:24.460ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9992024-11-19T01:30:31.806ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10002024-11-19T01:30:31.806ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10012024-11-19T01:30:31.911ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.568687248s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10022024-11-19T01:30:40.903ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33150
10032024-11-19T01:30:40.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33150 req_id = 3e760512-1b39-424e-81c2-447df4721fec response_code = 200 uri = /baseboard
10042024-11-19T01:30:41.701ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10052024-11-19T01:30:41.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52753
10062024-11-19T01:30:41.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52753 req_id = 839c8a35-0fb6-4cf2-8234-8570d3bce3d6 response_code = 200 uri = /timesync
10072024-11-19T01:30:41.713ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979789.6399207, correction: -0.054413509 } file = sled-agent/src/rack_setup/service.rs:740
10082024-11-19T01:30:41.713ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10092024-11-19T01:30:41.781ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10102024-11-19T01:30:41.781ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10112024-11-19T01:30:51.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10122024-11-19T01:30:51.756ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10132024-11-19T01:30:58.444ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.353459678s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10142024-11-19T01:31:01.731ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11387292086403576533 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10152024-11-19T01:31:01.731ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3251526579600883032 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10162024-11-19T01:31:02.254ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10172024-11-19T01:31:02.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63880
10182024-11-19T01:31:02.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63880 req_id = 5554576e-19cf-470b-b6ae-e88ee11c0865 response_code = 200 uri = /timesync
10192024-11-19T01:31:02.278ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:29:41.231217422Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5395967824530596132 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10202024-11-19T01:31:02.278ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:30:06.851114965Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16099661266490545479 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10212024-11-19T01:31:02.279ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:29:59.416756083Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12205343594117466016 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10222024-11-19T01:31:02.279ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:29:41.230584095Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1543194213685851063 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10232024-11-19T01:31:02.279ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:30:06.851507052Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15187233314522025148 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10242024-11-19T01:31:02.280ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:29:59.682289444Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7673205505297649017 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10252024-11-19T01:31:02.280ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-19T01:29:59.823122250Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18255154247134491800 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
10262024-11-19T01:31:02.280ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3330918968, ip_addr: 198.137.202.56, stratum: 3, ref_time: 1731979861.793234, correction: 0.000715831 } file = sled-agent/src/rack_setup/service.rs:740
10272024-11-19T01:31:02.280ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10282024-11-19T01:31:02.310ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: efd7fee1-3fb4-451f-a329-22d734d942b3 (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1 (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 (service), filesystem_pool: Some(ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2b836f65-e5cf-4810-a941-3674eca3485f, kind: Service { id: 21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 }, name: Name("ntp-21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 44])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 7fe7da70-47c6-458a-9e5c-e16bfba721cf (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 365c6d6d-7b90-4b73-92e9-59978ac6067a (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } } } }, OmicronZoneConfig { id: c2716362-63ff-42d5-b9df-4e59111bff45 (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } } } }, OmicronZoneConfig { id: c687cb16-184e-49d7-8fd9-f59b7f20cccd (service), filesystem_pool: Some(ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External } } } }, OmicronZoneConfig { id: d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5 (service), filesystem_pool: Some(ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10292024-11-19T01:31:02.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59806
10302024-11-19T01:31:02.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10312024-11-19T01:31:02.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10322024-11-19T01:31:02.347ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10332024-11-19T01:31:02.347ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10342024-11-19T01:31:02.380ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10352024-11-19T01:31:02.380ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10362024-11-19T01:31:02.412ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7fe7da70-47c6-458a-9e5c-e16bfba721cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10372024-11-19T01:31:02.412ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7fe7da70-47c6-458a-9e5c-e16bfba721cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10382024-11-19T01:31:02.443ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 365c6d6d-7b90-4b73-92e9-59978ac6067a, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10392024-11-19T01:31:02.443ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 365c6d6d-7b90-4b73-92e9-59978ac6067a, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10402024-11-19T01:31:02.476ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c2716362-63ff-42d5-b9df-4e59111bff45, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10412024-11-19T01:31:02.476ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c2716362-63ff-42d5-b9df-4e59111bff45, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10422024-11-19T01:31:02.508ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c687cb16-184e-49d7-8fd9-f59b7f20cccd, dataset_name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10432024-11-19T01:31:02.508ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c687cb16-184e-49d7-8fd9-f59b7f20cccd, dataset_name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442024-11-19T01:31:02.544ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5, dataset_name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10452024-11-19T01:31:02.544ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5, dataset_name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10462024-11-19T01:31:02.576ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10472024-11-19T01:31:02.576ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
10482024-11-19T01:31:02.576ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
10492024-11-19T01:31:02.577ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-11-19T01:31:02.659ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10512024-11-19T01:31:02.659ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-11-19T01:31:02.659ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-11-19T01:31:02.659ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10542024-11-19T01:31:02.659ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-11-19T01:31:02.753ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5 file = illumos-utils/src/zone.rs:325
10562024-11-19T01:31:02.757ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a file = illumos-utils/src/zone.rs:325
10572024-11-19T01:31:02.761ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45 file = illumos-utils/src/zone.rs:325
10582024-11-19T01:31:02.765ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf file = illumos-utils/src/zone.rs:325
10592024-11-19T01:31:02.770ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd file = illumos-utils/src/zone.rs:325
10602024-11-19T01:31:02.774ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5 file = illumos-utils/src/zone.rs:363
10612024-11-19T01:31:02.778ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a file = illumos-utils/src/zone.rs:363
10622024-11-19T01:31:02.784ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45 file = illumos-utils/src/zone.rs:363
10632024-11-19T01:31:02.789ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf file = illumos-utils/src/zone.rs:363
10642024-11-19T01:31:02.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd file = illumos-utils/src/zone.rs:363
10652024-11-19T01:31:05.761ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-11-19T01:31:05.761ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7fe7da70-47c6-458a-9e5c-e16bfba721cf'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10672024-11-19T01:31:05.761ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
10682024-11-19T01:31:05.766ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
10692024-11-19T01:31:05.783ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c687cb16-184e-49d7-8fd9-f59b7f20cccd'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-11-19T01:31:05.783ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
10712024-11-19T01:31:05.789ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='365c6d6d-7b90-4b73-92e9-59978ac6067a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-11-19T01:31:05.790ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
10732024-11-19T01:31:05.837ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c2716362-63ff-42d5-b9df-4e59111bff45'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10742024-11-19T01:31:05.837ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
10752024-11-19T01:31:05.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 54.19004ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
10762024-11-19T01:31:05.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 46.961357ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
10772024-11-19T01:31:05.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 62.641132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
10782024-11-19T01:31:05.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 70.132766ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
10792024-11-19T01:31:05.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 52.607979ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
10802024-11-19T01:31:05.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 118.648057ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
10812024-11-19T01:31:06.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 64.875194ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
10822024-11-19T01:31:06.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 52.736763ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
10832024-11-19T01:31:06.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 140.83742ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
10842024-11-19T01:31:06.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 63.539247ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
10852024-11-19T01:31:06.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 121.510709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
10862024-11-19T01:31:06.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 206.415265ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
10872024-11-19T01:31:06.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 221.534328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
10882024-11-19T01:31:06.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 105.163711ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
10892024-11-19T01:31:06.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 232.25494ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
10902024-11-19T01:31:06.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 428.400452ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
10912024-11-19T01:31:07.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 182.378855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
10922024-11-19T01:31:07.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 747.235176ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
10932024-11-19T01:31:07.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 282.842876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
10942024-11-19T01:31:07.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 453.457142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
10952024-11-19T01:31:07.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 940.951458ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
10962024-11-19T01:31:07.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 503.127449ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
10972024-11-19T01:31:07.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 778.937725ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
10982024-11-19T01:31:08.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 1.056751453s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
10992024-11-19T01:31:08.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 848.253963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11002024-11-19T01:31:08.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 820.625896ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11012024-11-19T01:31:08.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.146022856s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11022024-11-19T01:31:08.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 856.446379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11032024-11-19T01:31:09.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.115987436s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11042024-11-19T01:31:09.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 525.846598ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11052024-11-19T01:31:09.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 921.126312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11062024-11-19T01:31:09.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 849.163473ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11072024-11-19T01:31:09.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.322237897s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11082024-11-19T01:31:10.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 698.904887ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11092024-11-19T01:31:10.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 1.261053572s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11102024-11-19T01:31:10.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 608.058481ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11112024-11-19T01:31:10.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.03868452s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11122024-11-19T01:31:10.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53922
11132024-11-19T01:31:10.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53922 req_id = 3b1480e2-8b59-4150-91d4-86712cdaf3d0 response_code = 200 uri = /baseboard
11142024-11-19T01:31:10.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 1.123392885s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11152024-11-19T01:31:11.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 901.345593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11162024-11-19T01:31:11.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 1.041509922s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11172024-11-19T01:31:11.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.207296351s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11182024-11-19T01:31:11.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 1.154503239s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11192024-11-19T01:31:12.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 1.145884434s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11202024-11-19T01:31:12.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.175959119s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11212024-11-19T01:31:12.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 1.267728491s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11222024-11-19T01:31:13.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 696.802557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11232024-11-19T01:31:13.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 990.151178ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11242024-11-19T01:31:13.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 1.453958662s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11252024-11-19T01:31:13.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 946.493201ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11262024-11-19T01:31:13.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 1.142699402s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11272024-11-19T01:31:13.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.10233336s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11282024-11-19T01:31:14.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 1.107101636s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11292024-11-19T01:31:14.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 917.688924ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11302024-11-19T01:31:14.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 1.062183909s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11312024-11-19T01:31:14.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 1.225262163s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11322024-11-19T01:31:14.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.374048194s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11332024-11-19T01:31:15.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 862.051718ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11342024-11-19T01:31:15.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.048521237s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11352024-11-19T01:31:15.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 956.839117ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11362024-11-19T01:31:16.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 677.260565ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11372024-11-19T01:31:16.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 873.287087ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11382024-11-19T01:31:16.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.165508806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11392024-11-19T01:31:16.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 940.268248ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11402024-11-19T01:31:16.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 748.423235ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11412024-11-19T01:31:16.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 1.258376703s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11422024-11-19T01:31:16.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 1.242745587s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11432024-11-19T01:31:17.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 821.8654ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11442024-11-19T01:31:17.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a") failed: Property not found. retry in 1.480523102s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11452024-11-19T01:31:17.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5") failed: Property not found. retry in 855.789343ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11462024-11-19T01:31:18.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45") failed: Property not found. retry in 571.43486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11472024-11-19T01:31:18.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 774.375242ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11482024-11-19T01:31:18.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd") failed: Property not found. retry in 781.997154ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11492024-11-19T01:31:18.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 605.275953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11502024-11-19T01:31:19.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 712.993893ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11512024-11-19T01:31:20.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.145770631s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11522024-11-19T01:31:21.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.40881487s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11532024-11-19T01:31:22.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.165424566s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11542024-11-19T01:31:24.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 702.363423ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11552024-11-19T01:31:25.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.231835524s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11562024-11-19T01:31:26.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.319971109s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11572024-11-19T01:31:27.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 989.182265ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11582024-11-19T01:31:28.827ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 32.535246356s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
11592024-11-19T01:31:28.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 613.834637ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11602024-11-19T01:31:29.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 799.016816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11612024-11-19T01:31:30.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 683.532376ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11622024-11-19T01:31:30.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 922.4035ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11632024-11-19T01:31:32.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf") failed: Property not found. retry in 1.40468896s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11642024-11-19T01:31:33.455ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5
11652024-11-19T01:31:33.455ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_365c6d6d-7b90-4b73-92e9-59978ac6067a
11662024-11-19T01:31:33.455ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c2716362-63ff-42d5-b9df-4e59111bff45
11672024-11-19T01:31:33.455ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_7fe7da70-47c6-458a-9e5c-e16bfba721cf
11682024-11-19T01:31:33.455ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c687cb16-184e-49d7-8fd9-f59b7f20cccd
11692024-11-19T01:31:33.455ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11702024-11-19T01:31:33.494ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11712024-11-19T01:31:33.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31253135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59806 req_id = 0676827a-ce39-45bd-b665-9d726469918c response_code = 204 uri = /omicron-zones
11722024-11-19T01:31:33.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49781
11732024-11-19T01:31:33.691ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3743
11742024-11-19T01:31:36.216ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11752024-11-19T01:31:49.481ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11762024-11-19T01:31:49.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15881084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49781 req_id = d0417b5a-4353-4506-930a-86b14df97eee response_code = 204 uri = /cockroachdb
11772024-11-19T01:31:49.482ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63858
11782024-11-19T01:31:49.482ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63858 req_id = 47a7309e-ce9b-4f02-9811-c6b161e72c7e response_code = 200 uri = /baseboard
11792024-11-19T01:31:49.519ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: efd7fee1-3fb4-451f-a329-22d734d942b3 (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1 (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1 (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 (service), filesystem_pool: Some(ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2b836f65-e5cf-4810-a941-3674eca3485f, kind: Service { id: 21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5 }, name: Name("ntp-21bdf416-49b1-4a72-9ed1-f7a0cef9f6c5"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 44])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 7fe7da70-47c6-458a-9e5c-e16bfba721cf (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 365c6d6d-7b90-4b73-92e9-59978ac6067a (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } } } }, OmicronZoneConfig { id: c2716362-63ff-42d5-b9df-4e59111bff45 (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } } } }, OmicronZoneConfig { id: c687cb16-184e-49d7-8fd9-f59b7f20cccd (service), filesystem_pool: Some(ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External } } } }, OmicronZoneConfig { id: d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5 (service), filesystem_pool: Some(ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 (service), filesystem_pool: Some(ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d9867752-e046-43b5-9e2e-9abcfe9a206e (service), filesystem_pool: Some(ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b8403c47-1584-4cc7-8521-f7e7869f6be7 (service), filesystem_pool: Some(ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: b8761b34-4aa2-43dc-b5b9-6f0770d0c38b (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6642f456-b34f-481a-b944-a6103a98ff7d (service), filesystem_pool: Some(ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: f21cee7f-868d-4f90-82e5-780381d1769b (service), filesystem_pool: Some(ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 12a58e93-842e-43c6-9a83-fe5da94cf6a3 (service), filesystem_pool: Some(ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: fa497751-8795-42d9-9b44-989076dbbfa5 (service), filesystem_pool: Some(ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External } } } }, OmicronZoneConfig { id: f8d33665-e1ef-4076-8304-eb4279a4f099 (service), filesystem_pool: Some(ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External } } } }, OmicronZoneConfig { id: e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda (service), filesystem_pool: Some(ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 981954b7-d527-4910-bd41-dbf0d24350ab (service), filesystem_pool: Some(ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External } } } }, OmicronZoneConfig { id: c56712c8-6e8b-4e60-ac6b-cf372bcb6045 (service), filesystem_pool: Some(ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External } } } }, OmicronZoneConfig { id: b3dd7edf-4655-4991-a90e-af4ba34be25e (service), filesystem_pool: Some(ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External } } } }, OmicronZoneConfig { id: e6a1d17d-f2c9-4849-a9f0-0a022ec58410 (service), filesystem_pool: Some(ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External } } } }, OmicronZoneConfig { id: eb831c09-91e7-4f2b-9d75-70d39fa02cc6 (service), filesystem_pool: Some(ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External } } } }, OmicronZoneConfig { id: e8755fe5-b179-43a0-83f0-79d8946f073e (service), filesystem_pool: Some(ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11802024-11-19T01:31:49.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48128
11812024-11-19T01:31:49.519ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11822024-11-19T01:31:49.519ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efd7fee1-3fb4-451f-a329-22d734d942b3, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11832024-11-19T01:31:49.717ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11842024-11-19T01:31:49.717ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e98d393-d940-4def-ba7c-d8c67ea23aa1, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11852024-11-19T01:31:49.786ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11862024-11-19T01:31:49.786ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11872024-11-19T01:31:49.862ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7fe7da70-47c6-458a-9e5c-e16bfba721cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11882024-11-19T01:31:49.862ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7fe7da70-47c6-458a-9e5c-e16bfba721cf, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11892024-11-19T01:31:49.918ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 365c6d6d-7b90-4b73-92e9-59978ac6067a, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11902024-11-19T01:31:49.919ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 365c6d6d-7b90-4b73-92e9-59978ac6067a, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11912024-11-19T01:31:49.962ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c2716362-63ff-42d5-b9df-4e59111bff45, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11922024-11-19T01:31:49.962ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c2716362-63ff-42d5-b9df-4e59111bff45, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11932024-11-19T01:31:50.013ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c687cb16-184e-49d7-8fd9-f59b7f20cccd, dataset_name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11942024-11-19T01:31:50.013ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c687cb16-184e-49d7-8fd9-f59b7f20cccd, dataset_name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Cockroach }, responder: ... }
11952024-11-19T01:31:50.071ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5, dataset_name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11962024-11-19T01:31:50.071ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d5a6d7e4-a1b5-43d8-8d5f-6613d62e8bb5, dataset_name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11972024-11-19T01:31:50.139ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11982024-11-19T01:31:50.140ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11992024-11-19T01:31:50.206ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 52e4d19a-b928-4138-8817-4fd8deeaf29e, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12002024-11-19T01:31:50.206ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 52e4d19a-b928-4138-8817-4fd8deeaf29e, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12012024-11-19T01:31:50.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b8761b34-4aa2-43dc-b5b9-6f0770d0c38b, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12022024-11-19T01:31:50.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b8761b34-4aa2-43dc-b5b9-6f0770d0c38b, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12032024-11-19T01:31:50.336ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fa497751-8795-42d9-9b44-989076dbbfa5, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12042024-11-19T01:31:50.336ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fa497751-8795-42d9-9b44-989076dbbfa5, dataset_name: DatasetName { pool_name: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, kind: Crucible }, responder: ... }
12052024-11-19T01:31:50.425ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f8d33665-e1ef-4076-8304-eb4279a4f099, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12062024-11-19T01:31:50.425ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f8d33665-e1ef-4076-8304-eb4279a4f099, dataset_name: DatasetName { pool_name: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, kind: Crucible }, responder: ... }
12072024-11-19T01:31:50.499ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12082024-11-19T01:31:50.499ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, kind: Crucible }, responder: ... }
12092024-11-19T01:31:50.559ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 981954b7-d527-4910-bd41-dbf0d24350ab, dataset_name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12102024-11-19T01:31:50.559ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 981954b7-d527-4910-bd41-dbf0d24350ab, dataset_name: DatasetName { pool_name: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, kind: Crucible }, responder: ... }
12112024-11-19T01:31:50.622ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c56712c8-6e8b-4e60-ac6b-cf372bcb6045, dataset_name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12122024-11-19T01:31:50.622ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c56712c8-6e8b-4e60-ac6b-cf372bcb6045, dataset_name: DatasetName { pool_name: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, kind: Crucible }, responder: ... }
12132024-11-19T01:31:50.680ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3dd7edf-4655-4991-a90e-af4ba34be25e, dataset_name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12142024-11-19T01:31:50.680ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b3dd7edf-4655-4991-a90e-af4ba34be25e, dataset_name: DatasetName { pool_name: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, kind: Crucible }, responder: ... }
12152024-11-19T01:31:50.758ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e6a1d17d-f2c9-4849-a9f0-0a022ec58410, dataset_name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12162024-11-19T01:31:50.758ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e6a1d17d-f2c9-4849-a9f0-0a022ec58410, dataset_name: DatasetName { pool_name: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, kind: Crucible }, responder: ... }
12172024-11-19T01:31:50.839ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eb831c09-91e7-4f2b-9d75-70d39fa02cc6, dataset_name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12182024-11-19T01:31:50.839ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: eb831c09-91e7-4f2b-9d75-70d39fa02cc6, dataset_name: DatasetName { pool_name: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, kind: Crucible }, responder: ... }
12192024-11-19T01:31:50.925ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e8755fe5-b179-43a0-83f0-79d8946f073e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12202024-11-19T01:31:50.925ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e8755fe5-b179-43a0-83f0-79d8946f073e, dataset_name: DatasetName { pool_name: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, kind: Crucible }, responder: ... }
12212024-11-19T01:31:51.010ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12222024-11-19T01:31:51.010ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
12232024-11-19T01:31:51.011ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
12242024-11-19T01:31:51.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12252024-11-19T01:31:51.153ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12262024-11-19T01:31:51.153ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12272024-11-19T01:31:51.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12282024-11-19T01:31:51.204ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12292024-11-19T01:31:51.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12302024-11-19T01:31:51.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12312024-11-19T01:31:51.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12322024-11-19T01:31:51.205ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12332024-11-19T01:31:51.228ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12342024-11-19T01:31:51.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12352024-11-19T01:31:51.230ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12362024-11-19T01:31:51.413ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12372024-11-19T01:31:51.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12382024-11-19T01:31:51.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12392024-11-19T01:31:51.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12402024-11-19T01:31:51.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-11-19T01:31:51.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12422024-11-19T01:31:51.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12432024-11-19T01:31:51.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12442024-11-19T01:31:51.437ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6 file = illumos-utils/src/zone.rs:325
12452024-11-19T01:31:51.443ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3 file = illumos-utils/src/zone.rs:325
12462024-11-19T01:31:51.448ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b file = illumos-utils/src/zone.rs:325
12472024-11-19T01:31:51.453ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda file = illumos-utils/src/zone.rs:325
12482024-11-19T01:31:51.458ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5 file = illumos-utils/src/zone.rs:325
12492024-11-19T01:31:51.463ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b file = illumos-utils/src/zone.rs:325
12502024-11-19T01:31:51.469ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e file = illumos-utils/src/zone.rs:325
12512024-11-19T01:31:51.615ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6 file = illumos-utils/src/zone.rs:363
12522024-11-19T01:31:51.620ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3 file = illumos-utils/src/zone.rs:363
12532024-11-19T01:31:51.626ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b file = illumos-utils/src/zone.rs:363
12542024-11-19T01:31:51.631ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda file = illumos-utils/src/zone.rs:363
12552024-11-19T01:31:51.636ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5 file = illumos-utils/src/zone.rs:363
12562024-11-19T01:31:51.641ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b file = illumos-utils/src/zone.rs:363
12572024-11-19T01:31:51.646ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e file = illumos-utils/src/zone.rs:363
12582024-11-19T01:31:51.651ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d file = illumos-utils/src/zone.rs:325
12592024-11-19T01:31:51.657ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab file = illumos-utils/src/zone.rs:325
12602024-11-19T01:31:51.662ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099 file = illumos-utils/src/zone.rs:325
12612024-11-19T01:31:51.668ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7 file = illumos-utils/src/zone.rs:325
12622024-11-19T01:31:51.674ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410 file = illumos-utils/src/zone.rs:325
12632024-11-19T01:31:51.680ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045 file = illumos-utils/src/zone.rs:325
12642024-11-19T01:31:51.686ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e file = illumos-utils/src/zone.rs:325
12652024-11-19T01:31:51.744ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12662024-11-19T01:31:51.745ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d file = illumos-utils/src/zone.rs:363
12672024-11-19T01:31:51.756ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab file = illumos-utils/src/zone.rs:363
12682024-11-19T01:31:51.768ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099 file = illumos-utils/src/zone.rs:363
12692024-11-19T01:31:51.776ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7 file = illumos-utils/src/zone.rs:363
12702024-11-19T01:31:51.785ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410 file = illumos-utils/src/zone.rs:363
12712024-11-19T01:31:51.793ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045 file = illumos-utils/src/zone.rs:363
12722024-11-19T01:31:51.801ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e file = illumos-utils/src/zone.rs:363
12732024-11-19T01:31:51.872ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12742024-11-19T01:31:51.929ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12752024-11-19T01:31:51.992ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12762024-11-19T01:31:51.996ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12772024-11-19T01:31:51.996ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12782024-11-19T01:31:52.057ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 183, 90]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12792024-11-19T01:31:52.057ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12802024-11-19T01:31:52.114ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12812024-11-19T01:31:52.116ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12822024-11-19T01:31:52.116ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12832024-11-19T01:31:52.226ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 232, 238]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12842024-11-19T01:31:52.226ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12852024-11-19T01:31:52.229ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12862024-11-19T01:31:52.229ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12872024-11-19T01:31:52.340ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 152, 223]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12882024-11-19T01:31:52.340ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12892024-11-19T01:31:52.341ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12902024-11-19T01:31:52.341ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12912024-11-19T01:31:52.395ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 221, 211]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12922024-11-19T01:31:52.395ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12932024-11-19T01:31:52.396ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12942024-11-19T01:31:52.396ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12952024-11-19T01:31:52.398ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12962024-11-19T01:31:52.398ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12972024-11-19T01:31:52.454ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 169, 41]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12982024-11-19T01:31:52.454ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12992024-11-19T01:31:52.454ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13002024-11-19T01:31:52.456ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13012024-11-19T01:31:52.456ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13022024-11-19T01:31:52.456ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13032024-11-19T01:31:52.456ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13042024-11-19T01:31:52.456ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13052024-11-19T01:31:52.521ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13062024-11-19T01:31:52.526ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13072024-11-19T01:31:52.526ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13082024-11-19T01:31:52.526ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13092024-11-19T01:31:52.526ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13102024-11-19T01:31:52.529ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13112024-11-19T01:31:52.529ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13122024-11-19T01:31:52.529ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13132024-11-19T01:31:52.580ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13142024-11-19T01:31:52.669ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13152024-11-19T01:31:52.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13162024-11-19T01:31:52.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13172024-11-19T01:31:52.675ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73 file = illumos-utils/src/zone.rs:325
13182024-11-19T01:31:52.686ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e file = illumos-utils/src/zone.rs:325
13192024-11-19T01:31:52.737ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b file = illumos-utils/src/zone.rs:325
13202024-11-19T01:31:52.813ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73 file = illumos-utils/src/zone.rs:363
13212024-11-19T01:31:52.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e file = illumos-utils/src/zone.rs:363
13222024-11-19T01:31:52.834ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 file = illumos-utils/src/zone.rs:325
13232024-11-19T01:31:52.875ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b file = illumos-utils/src/zone.rs:363
13242024-11-19T01:31:52.889ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e file = illumos-utils/src/zone.rs:325
13252024-11-19T01:31:52.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 file = illumos-utils/src/zone.rs:363
13262024-11-19T01:31:52.922ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e file = illumos-utils/src/zone.rs:363
13272024-11-19T01:31:53.518ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e2481975-3977-496e-a270-5d45680952af/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6eaa2e8c-ec59-4907-ae08-2c4f8b083b61'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13282024-11-19T01:31:53.532ZINFOSledAgent (ServiceManager): Booting oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13292024-11-19T01:31:53.633ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='68362824-3aec-4a26-8d8e-6aeaf2367744'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13302024-11-19T01:31:53.633ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13312024-11-19T01:31:53.662ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='12b53500-545b-4c49-b78a-73d75a27fac6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-11-19T01:31:53.662ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13332024-11-19T01:31:53.706ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13342024-11-19T01:31:53.707ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13352024-11-19T01:31:53.889ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_76d71a82-bade-4cd6-841f-df791cc1a175/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b3a07aa8-1030-4ea9-bb57-52f2a4da499a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362024-11-19T01:31:53.889ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
13372024-11-19T01:31:53.913ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4db3afbb-2372-4910-937c-04a030c788e8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='32ec8059-40b8-4cfa-b847-10ffbc451ac4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382024-11-19T01:31:53.913ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
13392024-11-19T01:31:53.923ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fcf832e2-5c1d-42ac-8a75-5eb33770b119'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-11-19T01:31:53.923ZINFOSledAgent (ServiceManager): Booting oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13412024-11-19T01:31:53.982ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e8c43fda-8fc9-4ee3-8d53-065ce4a6a85f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422024-11-19T01:31:53.983ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13432024-11-19T01:31:54.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 73.772209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
13442024-11-19T01:31:54.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 47.214759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13452024-11-19T01:31:54.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 53.749222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13462024-11-19T01:31:54.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 59.78646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13472024-11-19T01:31:54.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 25.939267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13482024-11-19T01:31:54.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 71.118516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
13492024-11-19T01:31:54.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 59.376881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13502024-11-19T01:31:54.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 123.985594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13512024-11-19T01:31:54.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 137.33086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13522024-11-19T01:31:54.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 129.086457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13532024-11-19T01:31:54.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 76.627378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
13542024-11-19T01:31:54.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 123.30032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13552024-11-19T01:31:54.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 149.595201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13562024-11-19T01:31:54.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 71.91167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
13572024-11-19T01:31:54.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 250.196926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13582024-11-19T01:31:54.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 248.232135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13592024-11-19T01:31:54.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 224.765778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13602024-11-19T01:31:54.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 206.454891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
13612024-11-19T01:31:54.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 243.36771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13622024-11-19T01:31:54.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 278.067516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
13632024-11-19T01:31:54.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 262.366463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13642024-11-19T01:31:54.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 313.930769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13652024-11-19T01:31:54.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 420.290805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13662024-11-19T01:31:54.939ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13672024-11-19T01:31:54.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 542.538562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13682024-11-19T01:31:54.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 220.679908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13692024-11-19T01:31:54.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 262.985908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13702024-11-19T01:31:55.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 525.539925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
13712024-11-19T01:31:55.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 347.168529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
13722024-11-19T01:31:55.127ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13732024-11-19T01:31:55.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 937.880641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13742024-11-19T01:31:55.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 53.014056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13752024-11-19T01:31:55.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 406.037505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13762024-11-19T01:31:55.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.095302682s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13772024-11-19T01:31:55.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 136.175344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13782024-11-19T01:31:55.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.157199067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13792024-11-19T01:31:55.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 44.644446ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13802024-11-19T01:31:55.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 160.548078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13812024-11-19T01:31:55.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 72.903359ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13822024-11-19T01:31:55.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.147506435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
13832024-11-19T01:31:55.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 683.094623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13842024-11-19T01:31:55.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 170.623991ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13852024-11-19T01:31:55.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.101441793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
13862024-11-19T01:31:55.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 255.319614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13872024-11-19T01:31:55.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 950.345622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
13882024-11-19T01:31:55.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 581.110298ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13892024-11-19T01:31:55.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 551.197063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13902024-11-19T01:31:56.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 777.699613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
13912024-11-19T01:31:56.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.444662701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
13922024-11-19T01:31:56.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 630.645454ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13932024-11-19T01:31:56.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 617.043273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
13942024-11-19T01:31:56.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.074820678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13952024-11-19T01:32:00.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.147747002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
13962024-11-19T01:32:00.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.149699524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
13972024-11-19T01:32:00.322ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_516208ff-c30f-4aff-8e5a-1912725b8a19/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4817551d-4acd-47d0-9b95-22dd39eb7d11'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13982024-11-19T01:32:00.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.154809828s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
13992024-11-19T01:32:00.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.071668134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
14002024-11-19T01:32:01.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 543.91292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
14012024-11-19T01:32:01.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 1.32115368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
14022024-11-19T01:32:01.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 598.184262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14032024-11-19T01:32:01.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 524.469517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
14042024-11-19T01:32:01.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.42385385s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
14052024-11-19T01:32:01.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.424226533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
14062024-11-19T01:32:01.408ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14072024-11-19T01:32:01.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 765.323789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
14082024-11-19T01:32:01.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.368969948s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
14092024-11-19T01:32:01.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 955.805876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
14102024-11-19T01:32:01.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.150142522s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
14112024-11-19T01:32:01.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 693.847253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14122024-11-19T01:32:01.970ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14132024-11-19T01:32:01.971ZINFOSledAgent (ServiceManager): Booting oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14142024-11-19T01:32:02.003ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14152024-11-19T01:32:02.003ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14162024-11-19T01:32:02.017ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14172024-11-19T01:32:02.020ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14182024-11-19T01:32:02.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.316362623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
14192024-11-19T01:32:02.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 39.605895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14202024-11-19T01:32:02.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 110.21836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14212024-11-19T01:32:02.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 38.07254ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14222024-11-19T01:32:02.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 55.311229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14232024-11-19T01:32:02.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 29.053486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14242024-11-19T01:32:02.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 106.166219ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14252024-11-19T01:32:02.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 148.169657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14262024-11-19T01:32:02.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 52.084585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14272024-11-19T01:32:02.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 168.465944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14282024-11-19T01:32:02.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 236.650878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14292024-11-19T01:32:02.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 160.253085ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14302024-11-19T01:32:02.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 179.615638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14312024-11-19T01:32:02.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.275175617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
14322024-11-19T01:32:02.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 440.129507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14332024-11-19T01:32:02.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 221.867114ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14342024-11-19T01:32:02.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 626.035413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
14352024-11-19T01:32:02.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 560.862632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14362024-11-19T01:32:02.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.058968089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14372024-11-19T01:32:02.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 505.179381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14382024-11-19T01:32:02.720ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ab199b91-015a-4655-9e04-9df66d150eb1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='65fad411-fad1-49e4-b806-3db997e281fe'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14392024-11-19T01:32:02.721ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14402024-11-19T01:32:02.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 520.490746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
14412024-11-19T01:32:02.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.343604799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
14422024-11-19T01:32:02.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.039376183s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14432024-11-19T01:32:02.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.364319022s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
14442024-11-19T01:32:02.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 55.8342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14452024-11-19T01:32:03.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 705.897162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14462024-11-19T01:32:03.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 148.117849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14472024-11-19T01:32:03.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 618.585881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
14482024-11-19T01:32:03.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.490485552s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
14492024-11-19T01:32:03.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 546.993709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14502024-11-19T01:32:03.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 805.268726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14512024-11-19T01:32:03.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 865.046474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
14522024-11-19T01:32:03.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 874.300005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
14532024-11-19T01:32:03.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 170.486007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14542024-11-19T01:32:03.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 729.070091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
14552024-11-19T01:32:03.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 549.579029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14562024-11-19T01:32:03.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 537.878418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14572024-11-19T01:32:03.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 556.531993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14582024-11-19T01:32:03.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.22788415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
14592024-11-19T01:32:03.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 532.434743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
14602024-11-19T01:32:03.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 575.74954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14612024-11-19T01:32:03.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.215151799s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14622024-11-19T01:32:04.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.293965323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14632024-11-19T01:32:04.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.290509996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
14642024-11-19T01:32:04.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 970.204956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
14652024-11-19T01:32:04.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 1.003275234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
14662024-11-19T01:32:04.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 701.103678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14672024-11-19T01:32:04.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 822.819526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14682024-11-19T01:32:04.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.028715619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
14692024-11-19T01:32:04.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.291100917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
14702024-11-19T01:32:04.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.000427261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14712024-11-19T01:32:04.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.154560288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
14722024-11-19T01:32:04.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 725.620387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14732024-11-19T01:32:04.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.232731111s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
14742024-11-19T01:32:05.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 520.692983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14752024-11-19T01:32:05.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.461167223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
14762024-11-19T01:32:05.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 992.011726ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14772024-11-19T01:32:05.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 523.426394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14782024-11-19T01:32:05.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.342968451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
14792024-11-19T01:32:05.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 958.483287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
14802024-11-19T01:32:05.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 770.774647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
14812024-11-19T01:32:05.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 927.251465ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
14822024-11-19T01:32:05.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 613.879424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14832024-11-19T01:32:05.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 722.850452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14842024-11-19T01:32:05.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.086755194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
14852024-11-19T01:32:05.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 985.959248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
14862024-11-19T01:32:05.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.333630554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
14872024-11-19T01:32:05.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 574.073978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
14882024-11-19T01:32:05.665ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='b8403c47-1584-4cc7-8521-f7e7869f6be7'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14892024-11-19T01:32:05.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 866.150158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
14902024-11-19T01:32:05.679ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
14912024-11-19T01:32:05.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.112506094s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
14922024-11-19T01:32:05.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 42.199944ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
14932024-11-19T01:32:06.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.0725959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
14942024-11-19T01:32:06.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 88.002298ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
14952024-11-19T01:32:06.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 1.342640258s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
14962024-11-19T01:32:06.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 823.594681ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
14972024-11-19T01:32:06.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 119.519282ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
14982024-11-19T01:32:06.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 684.140356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
14992024-11-19T01:32:06.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 550.798338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
15002024-11-19T01:32:06.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.161802429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
15012024-11-19T01:32:06.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 313.3606ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
15022024-11-19T01:32:06.268ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15032024-11-19T01:32:06.268ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15042024-11-19T01:32:06.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 963.295533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
15052024-11-19T01:32:06.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.131489853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
15062024-11-19T01:32:06.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 527.769888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
15072024-11-19T01:32:06.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 622.419721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
15082024-11-19T01:32:06.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.236132916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
15092024-11-19T01:32:06.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.159563196s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
15102024-11-19T01:32:06.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 35.422315ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15112024-11-19T01:32:06.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 990.312286ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
15122024-11-19T01:32:06.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 142.55393ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15132024-11-19T01:32:06.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.40732668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
15142024-11-19T01:32:06.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 106.303747ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15152024-11-19T01:32:07.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 782.48489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
15162024-11-19T01:32:07.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.378767417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
15172024-11-19T01:32:07.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.028678524s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
15182024-11-19T01:32:07.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 669.338318ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
15192024-11-19T01:32:07.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.097113937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
15202024-11-19T01:32:07.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.01349686s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
15212024-11-19T01:32:07.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 330.899003ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15222024-11-19T01:32:07.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.192850889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
15232024-11-19T01:32:07.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.189509027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
15242024-11-19T01:32:07.290ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15252024-11-19T01:32:07.291ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15262024-11-19T01:32:07.323ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15272024-11-19T01:32:07.323ZINFOSledAgent (ServiceManager): Booting oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15282024-11-19T01:32:07.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 637.347216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
15292024-11-19T01:32:07.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 783.310712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
15302024-11-19T01:32:07.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 605.317684ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15312024-11-19T01:32:07.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 59.255109ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15322024-11-19T01:32:07.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 60.137657ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15332024-11-19T01:32:07.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 125.525405ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15342024-11-19T01:32:07.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 112.099633ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15352024-11-19T01:32:07.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.280834641s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
15362024-11-19T01:32:07.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 914.682756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
15372024-11-19T01:32:07.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 239.144983ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15382024-11-19T01:32:07.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 175.217732ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15392024-11-19T01:32:07.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.157230782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
15402024-11-19T01:32:07.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.386694401s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
15412024-11-19T01:32:07.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.165507006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
15422024-11-19T01:32:07.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 976.999761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
15432024-11-19T01:32:07.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 368.949593ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15442024-11-19T01:32:07.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 475.414275ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15452024-11-19T01:32:08.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.244229178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
15462024-11-19T01:32:08.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 812.618147ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15472024-11-19T01:32:08.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 605.366884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
15482024-11-19T01:32:08.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.129972918s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
15492024-11-19T01:32:08.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.160730598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
15502024-11-19T01:32:08.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 942.700891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
15512024-11-19T01:32:08.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 853.630869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
15522024-11-19T01:32:08.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 481.357747ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15532024-11-19T01:32:08.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.425412423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
15542024-11-19T01:32:08.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 617.703094ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15552024-11-19T01:32:08.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 712.098696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
15562024-11-19T01:32:08.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.128679384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
15572024-11-19T01:32:08.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.034454624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
15582024-11-19T01:32:08.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.164076115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
15592024-11-19T01:32:08.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.141392519s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15602024-11-19T01:32:08.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.416743129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
15612024-11-19T01:32:08.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 902.965095ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
15622024-11-19T01:32:08.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 913.545032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
15632024-11-19T01:32:08.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 876.033938ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15642024-11-19T01:32:09.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 940.695131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
15652024-11-19T01:32:09.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 916.963714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15662024-11-19T01:32:09.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 916.895053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
15672024-11-19T01:32:09.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 1.251819879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
15682024-11-19T01:32:09.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 995.310763ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
15692024-11-19T01:32:09.209ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15702024-11-19T01:32:09.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.224253736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
15712024-11-19T01:32:09.221ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
15722024-11-19T01:32:09.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.221799058s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
15732024-11-19T01:32:09.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.305670955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
15742024-11-19T01:32:09.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 662.366428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
15752024-11-19T01:32:09.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 57.157988ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
15762024-11-19T01:32:09.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 59.936705ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
15772024-11-19T01:32:09.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 112.637782ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
15782024-11-19T01:32:09.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 915.932447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
15792024-11-19T01:32:09.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.436267398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
15802024-11-19T01:32:09.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 549.036649ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
15812024-11-19T01:32:09.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 872.792052ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
15822024-11-19T01:32:09.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 611.581529ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15832024-11-19T01:32:09.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.249865313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
15842024-11-19T01:32:09.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.034208172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
15852024-11-19T01:32:09.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.016159684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
15862024-11-19T01:32:09.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.019062171s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
15872024-11-19T01:32:09.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.119081041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
15882024-11-19T01:32:10.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 602.493472ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
15892024-11-19T01:32:10.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 841.514193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
15902024-11-19T01:32:10.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.201641202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
15912024-11-19T01:32:10.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 976.460051ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
15922024-11-19T01:32:10.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.301746083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
15932024-11-19T01:32:10.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.020749893s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
15942024-11-19T01:32:10.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.01510832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
15952024-11-19T01:32:10.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.213355094s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
15962024-11-19T01:32:10.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 1.354521848s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
15972024-11-19T01:32:10.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.413920937s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
15982024-11-19T01:32:10.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 728.618538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
15992024-11-19T01:32:10.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 742.386833ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16002024-11-19T01:32:10.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 837.895668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
16012024-11-19T01:32:10.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 984.652773ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
16022024-11-19T01:32:10.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.026360471s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
16032024-11-19T01:32:10.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 629.554258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
16042024-11-19T01:32:10.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 597.144156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
16052024-11-19T01:32:10.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 543.280795ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
16062024-11-19T01:32:11.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.311249599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
16072024-11-19T01:32:11.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.131959166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
16082024-11-19T01:32:11.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 823.274627ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
16092024-11-19T01:32:11.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.471166891s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
16102024-11-19T01:32:11.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.435055095s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
16112024-11-19T01:32:11.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 771.231189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
16122024-11-19T01:32:11.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.153269704s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
16132024-11-19T01:32:11.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 557.276275ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16142024-11-19T01:32:11.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 528.142018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
16152024-11-19T01:32:11.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 820.367548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
16162024-11-19T01:32:11.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.251863608s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
16172024-11-19T01:32:11.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 981.033837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
16182024-11-19T01:32:11.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 722.684364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
16192024-11-19T01:32:11.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.187213606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
16202024-11-19T01:32:11.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.191622162s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
16212024-11-19T01:32:11.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.058230066s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
16222024-11-19T01:32:11.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 599.313163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
16232024-11-19T01:32:11.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 580.073255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
16242024-11-19T01:32:11.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.2879423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
16252024-11-19T01:32:11.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 562.710685ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16262024-11-19T01:32:11.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 690.596565ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
16272024-11-19T01:32:12.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 968.846699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
16282024-11-19T01:32:12.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.069429794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
16292024-11-19T01:32:12.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.131469749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
16302024-11-19T01:32:12.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 508.664528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
16312024-11-19T01:32:12.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 821.388774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
16322024-11-19T01:32:12.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 832.097037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
16332024-11-19T01:32:12.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 716.766694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
16342024-11-19T01:32:12.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 916.044349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
16352024-11-19T01:32:12.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.038445868s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
16362024-11-19T01:32:12.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 923.87545ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16372024-11-19T01:32:12.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.405360489s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
16382024-11-19T01:32:12.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 972.291987ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
16392024-11-19T01:32:12.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.401196518s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
16402024-11-19T01:32:12.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 978.502565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
16412024-11-19T01:32:12.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.131763254s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
16422024-11-19T01:32:12.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.304151118s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
16432024-11-19T01:32:12.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.348120147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
16442024-11-19T01:32:12.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.35775643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
16452024-11-19T01:32:12.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 588.424672ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
16462024-11-19T01:32:12.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 535.584347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
16472024-11-19T01:32:13.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 779.754641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
16482024-11-19T01:32:13.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 781.031618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
16492024-11-19T01:32:13.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 972.682382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
16502024-11-19T01:32:13.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 680.127535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
16512024-11-19T01:32:13.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.0262872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
16522024-11-19T01:32:13.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 677.513903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
16532024-11-19T01:32:13.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.350309299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
16542024-11-19T01:32:13.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.205641453s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16552024-11-19T01:32:13.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.273159226s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
16562024-11-19T01:32:13.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.324720606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
16572024-11-19T01:32:13.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 701.478993ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
16582024-11-19T01:32:13.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.395068141s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
16592024-11-19T01:32:13.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 545.486671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
16602024-11-19T01:32:13.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.249013526s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
16612024-11-19T01:32:13.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.356790336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
16622024-11-19T01:32:13.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 986.123273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
16632024-11-19T01:32:13.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.170828497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
16642024-11-19T01:32:13.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 686.423823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
16652024-11-19T01:32:14.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.217008389s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
16662024-11-19T01:32:14.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 942.503995ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
16672024-11-19T01:32:14.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.375895282s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
16682024-11-19T01:32:14.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 938.675225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
16692024-11-19T01:32:14.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.05861346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
16702024-11-19T01:32:14.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 755.194824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
16712024-11-19T01:32:14.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.131563191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
16722024-11-19T01:32:14.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 678.486637ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
16732024-11-19T01:32:14.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 766.310567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
16742024-11-19T01:32:14.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.109608979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
16752024-11-19T01:32:14.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 698.988174ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16762024-11-19T01:32:14.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 760.504629ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
16772024-11-19T01:32:14.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 501.737588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
16782024-11-19T01:32:14.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 765.384724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
16792024-11-19T01:32:14.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 894.62239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
16802024-11-19T01:32:14.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.050715152s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
16812024-11-19T01:32:14.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.186955948s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
16822024-11-19T01:32:15.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 687.020708ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
16832024-11-19T01:32:15.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 868.327544ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
16842024-11-19T01:32:15.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 998.522347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
16852024-11-19T01:32:15.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 515.356454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
16862024-11-19T01:32:15.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 649.945591ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
16872024-11-19T01:32:15.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.059664105s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
16882024-11-19T01:32:15.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 974.908885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
16892024-11-19T01:32:15.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 857.079548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
16902024-11-19T01:32:15.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 1.204819388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
16912024-11-19T01:32:15.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.42434858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
16922024-11-19T01:32:15.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 724.54279ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
16932024-11-19T01:32:15.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.217779794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
16942024-11-19T01:32:15.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 882.28134ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
16952024-11-19T01:32:15.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.154341846s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
16962024-11-19T01:32:15.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 534.316971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
16972024-11-19T01:32:15.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.094306059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
16982024-11-19T01:32:15.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.498595949s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
16992024-11-19T01:32:15.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 661.147235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
17002024-11-19T01:32:15.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 661.072174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
17012024-11-19T01:32:15.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 694.110581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
17022024-11-19T01:32:15.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e") failed: Property not found. retry in 1.491895621s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
17032024-11-19T01:32:16.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 552.532032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17042024-11-19T01:32:16.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.23570889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17052024-11-19T01:32:16.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.226925911s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17062024-11-19T01:32:16.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.450911484s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17072024-11-19T01:32:16.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099") failed: Property not found. retry in 1.409695237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
17082024-11-19T01:32:16.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 824.603885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
17092024-11-19T01:32:16.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 550.844334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17102024-11-19T01:32:16.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.345997607s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17112024-11-19T01:32:16.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.338621026s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
17122024-11-19T01:32:16.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 548.54703ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
17132024-11-19T01:32:16.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6") failed: Property not found. retry in 1.347938334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
17142024-11-19T01:32:16.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 502.244321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
17152024-11-19T01:32:16.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e") failed: Property not found. retry in 1.285609003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
17162024-11-19T01:32:16.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.340039513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17172024-11-19T01:32:16.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 765.673693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17182024-11-19T01:32:16.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 841.569433ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17192024-11-19T01:32:16.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d") failed: Property not found. retry in 1.193388514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
17202024-11-19T01:32:16.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045") failed: Property not found. retry in 1.45696395s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
17212024-11-19T01:32:16.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.031987067s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17222024-11-19T01:32:16.847ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 54.082374116s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
17232024-11-19T01:32:17.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab") failed: Property not found. retry in 1.456841287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
17242024-11-19T01:32:17.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda") failed: Property not found. retry in 1.132772036s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
17252024-11-19T01:32:17.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e") failed: Property not found. retry in 554.09446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
17262024-11-19T01:32:17.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 1.179655946s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
17272024-11-19T01:32:17.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 613.339498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17282024-11-19T01:32:17.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 632.059181ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17292024-11-19T01:32:17.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.14562448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17302024-11-19T01:32:17.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 728.379626ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17312024-11-19T01:32:17.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 949.655441ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17322024-11-19T01:32:17.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 684.891882ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17332024-11-19T01:32:17.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 818.503753ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
17342024-11-19T01:32:17.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 973.858403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17352024-11-19T01:32:17.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 1.223747695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17362024-11-19T01:32:17.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.02798809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17372024-11-19T01:32:17.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.385847004s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17382024-11-19T01:32:18.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.123080928s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17392024-11-19T01:32:18.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 820.907719ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17402024-11-19T01:32:18.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73") failed: Property not found. retry in 641.312843ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
17412024-11-19T01:32:18.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 817.111917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17422024-11-19T01:32:18.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.23234025s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17432024-11-19T01:32:18.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.405111668s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
17442024-11-19T01:32:18.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.317183171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17452024-11-19T01:32:18.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.299892375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17462024-11-19T01:32:19.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 643.615289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17472024-11-19T01:32:19.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 918.099713ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17482024-11-19T01:32:19.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.337815673s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17492024-11-19T01:32:19.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.108986783s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17502024-11-19T01:32:19.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 837.995054ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17512024-11-19T01:32:19.581ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43309
17522024-11-19T01:32:19.585ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1119 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43309 req_id = fbeea837-e713-4644-abf2-aa3752c16b21 response_code = 200 uri = /baseboard
17532024-11-19T01:32:19.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 681.514025ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17542024-11-19T01:32:19.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 525.148165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17552024-11-19T01:32:20.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.231763682s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
17562024-11-19T01:32:20.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.491333749s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17572024-11-19T01:32:20.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 1.000664477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17582024-11-19T01:32:20.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 900.8672ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17592024-11-19T01:32:20.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 817.108553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17602024-11-19T01:32:20.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 932.398427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17612024-11-19T01:32:20.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 980.542823ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17622024-11-19T01:32:20.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.09244262s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17632024-11-19T01:32:20.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.191423089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17642024-11-19T01:32:21.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.197649852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17652024-11-19T01:32:21.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 806.495247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17662024-11-19T01:32:21.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.076159089s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17672024-11-19T01:32:21.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.182734684s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
17682024-11-19T01:32:21.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 779.121182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17692024-11-19T01:32:21.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.344188106s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17702024-11-19T01:32:21.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.161983049s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17712024-11-19T01:32:21.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.272903167s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17722024-11-19T01:32:21.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5") failed: Property not found. retry in 1.258788834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17732024-11-19T01:32:21.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b") failed: Property not found. retry in 854.653022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17742024-11-19T01:32:22.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3") failed: Property not found. retry in 576.074618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17752024-11-19T01:32:22.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.077342839s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17762024-11-19T01:32:22.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 981.596152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17772024-11-19T01:32:22.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e") failed: Property not found. retry in 1.229058565s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
17782024-11-19T01:32:22.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b") failed: Property not found. retry in 1.26001605s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17792024-11-19T01:32:22.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7") failed: Property not found. retry in 1.132706252s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17802024-11-19T01:32:22.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b") failed: Property not found. retry in 1.411524633s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17812024-11-19T01:32:23.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410") failed: Property not found. retry in 1.224556847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17822024-11-19T01:32:23.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91") failed: Property not found. retry in 1.040359926s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17832024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_eb831c09-91e7-4f2b-9d75-70d39fa02cc6
17842024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_12a58e93-842e-43c6-9a83-fe5da94cf6a3
17852024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_13c22fb6-5873-4940-9848-cc9130b7aa73
17862024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_f21cee7f-868d-4f90-82e5-780381d1769b
17872024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e8cfc52b-d770-4bc6-af3c-d4bb1b31eeda
17882024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fa497751-8795-42d9-9b44-989076dbbfa5
17892024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_b8761b34-4aa2-43dc-b5b9-6f0770d0c38b
17902024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_52e4d19a-b928-4138-8817-4fd8deeaf29e
17912024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e8755fe5-b179-43a0-83f0-79d8946f073e
17922024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_a97a9e1e-ade8-4d48-bc64-1b5a63e68b91
17932024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17942024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_6642f456-b34f-481a-b944-a6103a98ff7d
17952024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_981954b7-d527-4910-bd41-dbf0d24350ab
17962024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f8d33665-e1ef-4076-8304-eb4279a4f099
17972024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_b8403c47-1584-4cc7-8521-f7e7869f6be7
17982024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e6a1d17d-f2c9-4849-a9f0-0a022ec58410
17992024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_d9867752-e046-43b5-9e2e-9abcfe9a206e
18002024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c56712c8-6e8b-4e60-ac6b-cf372bcb6045
18012024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b3dd7edf-4655-4991-a90e-af4ba34be25e
18022024-11-19T01:32:24.594ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18032024-11-19T01:32:24.596ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18042024-11-19T01:32:24.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35086965 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48128 req_id = f7e460c5-81f5-42d8-9fee-7fc3a31e68c0 response_code = 204 uri = /omicron-zones
18052024-11-19T01:32:24.620ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
18062024-11-19T01:32:24.621ZINFOSledAgent (RSS): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18072024-11-19T01:32:24.621ZINFOSledAgent (RSS): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18082024-11-19T01:32:24.849ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
18092024-11-19T01:32:24.851ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
18102024-11-19T01:32:24.887ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
18112024-11-19T01:32:24.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18122024-11-19T01:32:25.032ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18132024-11-19T01:32:25.137ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18142024-11-19T01:32:25.348ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18152024-11-19T01:32:25.489ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18162024-11-19T01:32:25.783ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18172024-11-19T01:32:26.046ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18182024-11-19T01:32:26.327ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18192024-11-19T01:32:26.573ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/cbab7bfb-8e8e-44f1-a93b-b95de3b50f49/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
18202024-11-19T01:32:27.168ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/nexus.rs:527 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
18212024-11-19T01:32:27.168ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/302245ee-8785-4baf-86ed-0823410907ec) file = sled-agent/src/probe_manager.rs:231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
18222024-11-19T01:32:27.414ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "f589036c-f825-410f-8aa1-89be29a77c29", "content-length": "113", "date": "Tue, 19 Nov 2024 01:32:27 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "f589036c-f825-410f-8aa1-89be29a77c29" } file = sled-agent/src/rack_setup/service.rs:1075
18232024-11-19T01:32:29.159ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7ed5894e-67aa-4c27-82f3-ed8b2c29d2f7", "content-length": "173", "date": "Tue, 19 Nov 2024 01:32:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cbab7bfb-8e8e-44f1-a93b-b95de3b50f49\"", request_id: "7ed5894e-67aa-4c27-82f3-ed8b2c29d2f7" } file = sled-agent/src/rack_setup/service.rs:1075
18242024-11-19T01:32:30.229ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cd66f511-9bb4-450e-899c-7abafb96b2ad", "content-length": "173", "date": "Tue, 19 Nov 2024 01:32:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cbab7bfb-8e8e-44f1-a93b-b95de3b50f49\"", request_id: "cd66f511-9bb4-450e-899c-7abafb96b2ad" } file = sled-agent/src/rack_setup/service.rs:1075
18252024-11-19T01:32:30.385ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
18262024-11-19T01:32:30.970ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9f4d60a8-efe2-45da-b9ff-83d0cc3ae37f", "content-length": "173", "date": "Tue, 19 Nov 2024 01:32:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cbab7bfb-8e8e-44f1-a93b-b95de3b50f49\"", request_id: "9f4d60a8-efe2-45da-b9ff-83d0cc3ae37f" } file = sled-agent/src/rack_setup/service.rs:1075
18272024-11-19T01:32:32.129ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fb6867eb-5316-4d52-89b1-46eb4881e346", "content-length": "173", "date": "Tue, 19 Nov 2024 01:32:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cbab7bfb-8e8e-44f1-a93b-b95de3b50f49\"", request_id: "fb6867eb-5316-4d52-89b1-46eb4881e346" } file = sled-agent/src/rack_setup/service.rs:1075
18282024-11-19T01:32:33.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38345
18292024-11-19T01:32:33.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38345 req_id = d8b37717-9c1b-42d3-9fb8-d4888717d2ef response_code = 200 uri = /vpc-routes
18302024-11-19T01:32:33.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64671
18312024-11-19T01:32:33.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64671 req_id = c4a0a076-1e14-4a4e-825d-9cc6b8e8f645 response_code = 200 uri = /vpc-routes
18322024-11-19T01:32:34.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55730
18332024-11-19T01:32:34.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18342024-11-19T01:32:34.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18352024-11-19T01:32:34.003ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
18362024-11-19T01:32:34.004ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
18372024-11-19T01:32:34.021ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18382024-11-19T01:32:34.021ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
18392024-11-19T01:32:34.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33203
18402024-11-19T01:32:34.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18412024-11-19T01:32:34.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18422024-11-19T01:32:34.045ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
18432024-11-19T01:32:34.046ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
18442024-11-19T01:32:34.052ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18452024-11-19T01:32:34.052ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
18462024-11-19T01:32:34.068ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18472024-11-19T01:32:34.068ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
18482024-11-19T01:32:34.087ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18492024-11-19T01:32:34.087ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
18502024-11-19T01:32:34.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
18512024-11-19T01:32:34.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64671 req_id = 9e0bbe67-343e-48e6-a2aa-b300e61d5176 response_code = 204 uri = /eip-gateways
18522024-11-19T01:32:34.103ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18532024-11-19T01:32:34.103ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
18542024-11-19T01:32:34.135ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18552024-11-19T01:32:34.135ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
18562024-11-19T01:32:34.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
18572024-11-19T01:32:34.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38345 req_id = 3aca21c8-c9da-4858-b44b-18cc79d8f789 response_code = 204 uri = /eip-gateways
18582024-11-19T01:32:34.149ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18592024-11-19T01:32:34.149ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
18602024-11-19T01:32:34.167ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18612024-11-19T01:32:34.167ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
18622024-11-19T01:32:34.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64041
18632024-11-19T01:32:34.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1098 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64041 req_id = b545a94f-a911-4e38-acce-6d6c7afd4e50 response_code = 200 uri = /v2p
18642024-11-19T01:32:34.183ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18652024-11-19T01:32:34.183ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
18662024-11-19T01:32:34.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18672024-11-19T01:32:34.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
18682024-11-19T01:32:34.224ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18692024-11-19T01:32:34.224ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
18702024-11-19T01:32:34.245ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18712024-11-19T01:32:34.245ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
18722024-11-19T01:32:34.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64671 req_id = 208bdee9-d54b-4e52-85c1-6d0c14152afb response_code = 204 uri = /vpc-routes
18732024-11-19T01:32:34.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58582
18742024-11-19T01:32:34.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58582 req_id = 38cb7a1d-0b75-40ee-bc63-13f2eb7027ae response_code = 200 uri = /v2p
18752024-11-19T01:32:34.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18762024-11-19T01:32:34.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
18772024-11-19T01:32:34.301ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-11-19T01:32:34.301ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
18792024-11-19T01:32:34.322ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18802024-11-19T01:32:34.322ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
18812024-11-19T01:32:34.358ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18822024-11-19T01:32:34.358ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
18832024-11-19T01:32:34.377ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18842024-11-19T01:32:34.377ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
18852024-11-19T01:32:34.397ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18862024-11-19T01:32:34.397ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
18872024-11-19T01:32:34.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 400980 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55730 req_id = 01958bdf-fa7a-494d-b688-826054b23d07 response_code = 200 uri = /inventory
18882024-11-19T01:32:34.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369068 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33203 req_id = 9316cf40-4f83-4826-8470-d641417e4a14 response_code = 200 uri = /inventory
18892024-11-19T01:32:34.454ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18902024-11-19T01:32:34.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38345 req_id = cbb5a376-ed2c-457f-9cd0-bd0c16e1cefe response_code = 204 uri = /vpc-routes
18912024-11-19T01:32:34.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36988
18922024-11-19T01:32:34.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36988 req_id = 8a1f7a98-4161-4931-9390-8b1040e318b0 response_code = 200 uri = /vpc-routes
18932024-11-19T01:32:34.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52567
18942024-11-19T01:32:34.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18952024-11-19T01:32:34.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18962024-11-19T01:32:34.531ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
18972024-11-19T01:32:34.531ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
18982024-11-19T01:32:34.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18992024-11-19T01:32:34.545ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
19002024-11-19T01:32:34.571ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19012024-11-19T01:32:34.571ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
19022024-11-19T01:32:34.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19032024-11-19T01:32:34.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
19042024-11-19T01:32:34.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19052024-11-19T01:32:34.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
19062024-11-19T01:32:34.627ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
19072024-11-19T01:32:34.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36988 req_id = dd1f4b79-803d-4631-8c23-a4dfeb03f943 response_code = 204 uri = /eip-gateways
19082024-11-19T01:32:34.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1074 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36988 req_id = ae9912fa-0e50-4486-9ff9-d2b0ccfc75a3 response_code = 204 uri = /vpc-routes
19092024-11-19T01:32:34.648ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19102024-11-19T01:32:34.648ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
19112024-11-19T01:32:34.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53802
19122024-11-19T01:32:34.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53802 req_id = d78df5de-4bdb-41b6-9955-ce54d9aedf99 response_code = 200 uri = /v2p
19132024-11-19T01:32:34.672ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19142024-11-19T01:32:34.672ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
19152024-11-19T01:32:34.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19162024-11-19T01:32:34.697ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
19172024-11-19T01:32:34.723ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19182024-11-19T01:32:34.723ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
19192024-11-19T01:32:34.746ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19202024-11-19T01:32:34.746ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
19212024-11-19T01:32:34.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226571 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52567 req_id = c81a5747-e70a-4887-aefa-df621b00367a response_code = 200 uri = /inventory
19222024-11-19T01:32:36.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58660
19232024-11-19T01:32:36.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19242024-11-19T01:32:36.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19252024-11-19T01:32:36.245ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
19262024-11-19T01:32:36.246ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
19272024-11-19T01:32:36.257ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19282024-11-19T01:32:36.257ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
19292024-11-19T01:32:36.280ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19302024-11-19T01:32:36.280ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
19312024-11-19T01:32:36.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19322024-11-19T01:32:36.303ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
19332024-11-19T01:32:36.327ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19342024-11-19T01:32:36.327ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
19352024-11-19T01:32:36.349ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19362024-11-19T01:32:36.349ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
19372024-11-19T01:32:36.369ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19382024-11-19T01:32:36.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
19392024-11-19T01:32:36.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19402024-11-19T01:32:36.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
19412024-11-19T01:32:36.411ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19422024-11-19T01:32:36.411ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
19432024-11-19T01:32:36.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52340
19442024-11-19T01:32:36.432ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19452024-11-19T01:32:36.432ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
19462024-11-19T01:32:36.437ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19472024-11-19T01:32:36.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19482024-11-19T01:32:36.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19492024-11-19T01:32:36.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19502024-11-19T01:32:36.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19512024-11-19T01:32:36.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19522024-11-19T01:32:36.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19532024-11-19T01:32:36.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6849 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52340 req_id = 8fd1e783-50a3-43c9-9390-5459c2ed8010 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19542024-11-19T01:32:36.439ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
19552024-11-19T01:32:36.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201458 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58660 req_id = 2f7f8985-2ea7-4a64-a8e5-83333d89b0dc response_code = 200 uri = /inventory
19562024-11-19T01:32:37.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61037
19572024-11-19T01:32:37.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19582024-11-19T01:32:37.237ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19592024-11-19T01:32:37.237ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
19602024-11-19T01:32:37.237ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
19612024-11-19T01:32:37.247ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19622024-11-19T01:32:37.247ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
19632024-11-19T01:32:37.274ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19642024-11-19T01:32:37.274ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
19652024-11-19T01:32:37.298ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19662024-11-19T01:32:37.298ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
19672024-11-19T01:32:37.322ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19682024-11-19T01:32:37.322ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
19692024-11-19T01:32:37.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19702024-11-19T01:32:37.346ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
19712024-11-19T01:32:37.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19722024-11-19T01:32:37.367ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
19732024-11-19T01:32:37.389ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19742024-11-19T01:32:37.389ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
19752024-11-19T01:32:37.411ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19762024-11-19T01:32:37.411ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
19772024-11-19T01:32:37.431ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19782024-11-19T01:32:37.431ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
19792024-11-19T01:32:37.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206635 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61037 req_id = 49133bcd-8a9b-4c30-9235-0e35a46db557 response_code = 200 uri = /inventory
19802024-11-19T01:32:37.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55263
19812024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19822024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19832024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19842024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19852024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19862024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19872024-11-19T01:32:37.448ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19882024-11-19T01:32:37.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55263 req_id = e63478db-905f-422a-b30e-f760b042dc2c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19892024-11-19T01:32:37.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44664
19902024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19912024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
19922024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19932024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19942024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19952024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19962024-11-19T01:32:37.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19972024-11-19T01:32:37.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44664 req_id = 6ed775f8-8129-4298-9494-de587b5dac98 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19982024-11-19T01:32:38.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53419
19992024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20002024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20012024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20022024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20032024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20042024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20052024-11-19T01:32:38.282ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20062024-11-19T01:32:38.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53419 req_id = 13491486-b138-4eaa-bd2e-09ad5bccd328 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20072024-11-19T01:32:44.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40145
20082024-11-19T01:32:44.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40145 req_id = 952af2e3-d02a-48c6-9d91-e4fbcdb42116 response_code = 200 uri = /vpc-routes
20092024-11-19T01:32:44.262ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20102024-11-19T01:32:44.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40145 req_id = 6ef0c1b2-20d2-4f29-ab6f-a3aeb42751cd response_code = 204 uri = /eip-gateways
20112024-11-19T01:32:44.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40145 req_id = 1bf49c4b-5884-455e-bf30-1146ba429e10 response_code = 204 uri = /vpc-routes
20122024-11-19T01:32:49.621ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55610
20132024-11-19T01:32:49.621ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55610 req_id = a5739df0-bc18-40b9-a6f0-37a2919c0f0b response_code = 200 uri = /baseboard
20142024-11-19T01:33:03.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53081
20152024-11-19T01:33:03.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53081 req_id = b5d07b5c-315d-4eae-a2a7-7f7696d017f0 response_code = 200 uri = /vpc-routes
20162024-11-19T01:33:03.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20172024-11-19T01:33:03.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53081 req_id = e4aaff9d-7ab3-401a-9d26-7e59ee900e91 response_code = 204 uri = /eip-gateways
20182024-11-19T01:33:03.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52703
20192024-11-19T01:33:03.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52703 req_id = f93996a5-7052-4ee6-9c85-d7644e13d05c response_code = 200 uri = /vpc-routes
20202024-11-19T01:33:03.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20212024-11-19T01:33:03.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52703 req_id = c68a11a0-53d4-440e-b473-0087dc660c6f response_code = 204 uri = /eip-gateways
20222024-11-19T01:33:03.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52703 req_id = 2af0c60e-0297-4557-bfad-cd6339fde03f response_code = 204 uri = /vpc-routes
20232024-11-19T01:33:03.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45939
20242024-11-19T01:33:03.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45939 req_id = 5f1b6d6c-e5c9-43bf-9841-fb1b4e3d54e8 response_code = 200 uri = /v2p
20252024-11-19T01:33:03.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60538
20262024-11-19T01:33:03.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60538 req_id = ca3f055b-9c93-450a-80de-c9a0d3b3b4cf response_code = 200 uri = /v2p
20272024-11-19T01:33:03.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53081 req_id = 39755bc9-de7e-4b2c-b4b6-9dafb4f53cd3 response_code = 204 uri = /vpc-routes
20282024-11-19T01:33:03.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49912
20292024-11-19T01:33:03.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20302024-11-19T01:33:04.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20312024-11-19T01:33:04.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49912 req_id = 265f981c-ad03-4c7c-bcc7-f043371d6505 response_code = 204 uri = /switch-ports
20322024-11-19T01:33:04.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52752
20332024-11-19T01:33:04.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20342024-11-19T01:33:04.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49912 req_id = 4dfc99ab-c8c8-42ce-8802-1aaf2a8cce5a response_code = 200 uri = /network-bootstore-config
20352024-11-19T01:33:04.111ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20362024-11-19T01:33:04.116ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20372024-11-19T01:33:04.117ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20382024-11-19T01:33:04.118ZINFOSledAgent (bootstore): Writing ledger to /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20392024-11-19T01:33:04.119ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20402024-11-19T01:33:04.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7899 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49912 req_id = d2cfb934-d453-41e9-9238-120747969fb9 response_code = 204 uri = /network-bootstore-config
20412024-11-19T01:33:04.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52752 req_id = 01bc6c47-1605-4477-94d5-d8f83f7cb456 response_code = 204 uri = /switch-ports
20422024-11-19T01:33:04.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52752 req_id = 51fc3eab-d906-427f-93f1-ae53fe6d0d21 response_code = 200 uri = /network-bootstore-config
20432024-11-19T01:33:04.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63483
20442024-11-19T01:33:04.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63483 req_id = 44d37f83-d508-4881-b1cd-e73bd13bcce8 response_code = 200 uri = /vpc-routes
20452024-11-19T01:33:04.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56465
20462024-11-19T01:33:04.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56465 req_id = 4373fb83-5c82-4e48-8049-3b1b9e1187d2 response_code = 200 uri = /v2p
20472024-11-19T01:33:04.507ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20482024-11-19T01:33:04.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63483 req_id = ea61b78b-4344-494c-aa43-b4c19499cf27 response_code = 204 uri = /eip-gateways
20492024-11-19T01:33:04.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63483 req_id = c2694c20-1a94-4c97-b523-8d6e98edf81f response_code = 204 uri = /vpc-routes
20502024-11-19T01:33:04.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57650
20512024-11-19T01:33:04.604ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20522024-11-19T01:33:04.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20532024-11-19T01:33:04.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86454 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57650 req_id = 29def325-bc41-403e-8808-ebcb5f56f205 response_code = 204 uri = /switch-ports
20542024-11-19T01:33:04.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57650 req_id = 292288fd-6b5e-4b51-8491-af7d1f167554 response_code = 200 uri = /network-bootstore-config
20552024-11-19T01:33:16.829ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:49546 remote_addr = [fd00:1122:3344:101::d]:52174 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
20562024-11-19T01:33:16.851ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22192 local_addr = [fd00:1122:3344:101::1]:49546 method = GET remote_addr = [fd00:1122:3344:101::d]:52174 req_id = 67f38b6d-ff44-4ee4-94b1-0922209ec2ca response_code = 200 sled_id = 302245ee-8785-4baf-86ed-0823410907ec uri = /302245ee-8785-4baf-86ed-0823410907ec
20572024-11-19T01:33:19.656ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40782
20582024-11-19T01:33:19.656ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40782 req_id = 3fed43ff-88e4-4b4f-9ad1-3d235af09d14 response_code = 200 uri = /baseboard
20592024-11-19T01:33:33.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43823
20602024-11-19T01:33:33.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43823 req_id = f74b8b75-1eb7-4baf-a13a-182aaa6c59bb response_code = 200 uri = /vpc-routes
20612024-11-19T01:33:33.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20622024-11-19T01:33:33.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43823 req_id = 87ab3244-f007-41e1-95a5-6c3969c81065 response_code = 204 uri = /eip-gateways
20632024-11-19T01:33:33.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43823 req_id = 2456acdd-552a-4e5e-b453-3963ae8ebf96 response_code = 204 uri = /vpc-routes
20642024-11-19T01:33:33.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59289
20652024-11-19T01:33:33.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59289 req_id = 4b0c74d1-0a95-4225-879c-d41dbebf0792 response_code = 200 uri = /vpc-routes
20662024-11-19T01:33:33.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20672024-11-19T01:33:33.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59289 req_id = daa64a42-451c-4772-bc0f-b441100f98ff response_code = 204 uri = /eip-gateways
20682024-11-19T01:33:33.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59289 req_id = 6928541a-7ade-436f-ac7d-95b566510c09 response_code = 204 uri = /vpc-routes
20692024-11-19T01:33:33.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39985
20702024-11-19T01:33:33.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39985 req_id = 5a748d4a-4344-4f2c-98eb-b6a77eacde3d response_code = 200 uri = /v2p
20712024-11-19T01:33:33.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52072
20722024-11-19T01:33:33.928ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20732024-11-19T01:33:33.964ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20742024-11-19T01:33:34.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95035 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52072 req_id = b18f66e1-45cd-490f-b97d-4bcb62c12217 response_code = 204 uri = /switch-ports
20752024-11-19T01:33:34.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43953
20762024-11-19T01:33:34.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45793
20772024-11-19T01:33:34.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52072 req_id = ff851a81-9e53-48b9-9611-088a6aa8f92d response_code = 200 uri = /network-bootstore-config
20782024-11-19T01:33:34.023ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20792024-11-19T01:33:34.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43953 req_id = 0934fe7d-a59f-4380-9620-20162f930ab8 response_code = 200 uri = /v2p
20802024-11-19T01:33:34.059ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20812024-11-19T01:33:34.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87657 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45793 req_id = a615fb38-6b31-4667-b980-98f9c6c6cc75 response_code = 204 uri = /switch-ports
20822024-11-19T01:33:34.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45793 req_id = d200fb8f-a96a-474f-91ee-125fd565b26f response_code = 200 uri = /network-bootstore-config
20832024-11-19T01:33:34.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43043
20842024-11-19T01:33:34.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43043 req_id = ef4ac885-bd38-4e8d-84b6-ccd5e17fd531 response_code = 200 uri = /vpc-routes
20852024-11-19T01:33:34.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
20862024-11-19T01:33:34.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43043 req_id = 42b79978-c511-4bdb-b2cb-9f1618dfe27c response_code = 204 uri = /eip-gateways
20872024-11-19T01:33:34.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43043 req_id = d74f1b81-f2fb-4cc6-b42d-a4a0bc07e4ec response_code = 204 uri = /vpc-routes
20882024-11-19T01:33:34.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51889
20892024-11-19T01:33:34.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51889 req_id = 3bf1d8ba-11ae-4c01-8c60-38a8e6a939ea response_code = 200 uri = /v2p
20902024-11-19T01:33:34.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40262
20912024-11-19T01:33:34.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20922024-11-19T01:33:34.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20932024-11-19T01:33:34.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40262 req_id = 26b1e5ba-35c9-43fe-b580-f979546302ae response_code = 204 uri = /switch-ports
20942024-11-19T01:33:34.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40262 req_id = c8342930-bcc2-465d-84e2-8eb5f1af5328 response_code = 200 uri = /network-bootstore-config
20952024-11-19T01:33:35.012ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20962024-11-19T01:33:49.688ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44068
20972024-11-19T01:33:49.689ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44068 req_id = 505b2149-de43-4fcc-a0ff-2184e4fa3838 response_code = 200 uri = /baseboard
20982024-11-19T01:34:03.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49874
20992024-11-19T01:34:03.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49874 req_id = 3af33f4f-334e-47eb-b6c2-b4a489247e11 response_code = 200 uri = /vpc-routes
21002024-11-19T01:34:03.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21012024-11-19T01:34:03.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49874 req_id = c37135a2-787a-4788-8dae-547b98dde580 response_code = 204 uri = /eip-gateways
21022024-11-19T01:34:03.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49874 req_id = ca3fbc90-43f9-469a-82f1-a9f4b1bcb83c response_code = 204 uri = /vpc-routes
21032024-11-19T01:34:03.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64193
21042024-11-19T01:34:03.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21052024-11-19T01:34:03.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21062024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64193 req_id = 06693e84-7fe9-424b-b6ac-e87c22515b49 response_code = 204 uri = /switch-ports
21072024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38680
21082024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50214
21092024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51170
21102024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64193 req_id = 41c32fd8-e58a-4e3d-886c-2fd9a1fb5372 response_code = 200 uri = /network-bootstore-config
21112024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51170 req_id = d940dc92-10fc-4184-9254-15a941470577 response_code = 200 uri = /v2p
21122024-11-19T01:34:03.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38680 req_id = e3b3101f-1ec8-4697-96f9-2df6f294bc20 response_code = 200 uri = /vpc-routes
21132024-11-19T01:34:03.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50214 req_id = 7505bd29-3904-4d46-b916-96dcdd88a57c response_code = 200 uri = /v2p
21142024-11-19T01:34:03.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64986
21152024-11-19T01:34:03.844ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21162024-11-19T01:34:03.881ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21172024-11-19T01:34:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64986 req_id = dc4942e1-aa50-40bf-a0ee-a50ae56cdc78 response_code = 204 uri = /switch-ports
21182024-11-19T01:34:03.937ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21192024-11-19T01:34:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38680 req_id = d136ff61-71f2-422b-9ccc-00e9327d5583 response_code = 204 uri = /eip-gateways
21202024-11-19T01:34:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64986 req_id = 0146e81c-18bb-4a36-b477-4ae1d2c48531 response_code = 200 uri = /network-bootstore-config
21212024-11-19T01:34:03.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38680 req_id = 6c6c5b52-5fa4-4378-b804-516f0ea4d3a2 response_code = 204 uri = /vpc-routes
21222024-11-19T01:34:04.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58257
21232024-11-19T01:34:04.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58257 req_id = faa8a733-f666-4f6d-b0a3-875b9c9135d7 response_code = 200 uri = /vpc-routes
21242024-11-19T01:34:04.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21252024-11-19T01:34:04.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58257 req_id = dc2124e1-d0ee-4073-8ac8-4192f7af7b89 response_code = 204 uri = /eip-gateways
21262024-11-19T01:34:04.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58257 req_id = 3e995d03-7834-49f3-9766-5550a02b0ea0 response_code = 204 uri = /vpc-routes
21272024-11-19T01:34:04.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49587
21282024-11-19T01:34:04.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49587 req_id = 7c882e09-b450-4738-89a3-33bd9247efd6 response_code = 200 uri = /v2p
21292024-11-19T01:34:04.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51516
21302024-11-19T01:34:04.588ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21312024-11-19T01:34:04.625ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21322024-11-19T01:34:04.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51516 req_id = 5219afef-3298-4101-9220-12c99b400bc7 response_code = 204 uri = /switch-ports
21332024-11-19T01:34:04.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51516 req_id = 47e1ad11-1569-4af7-81bb-e8db8febd3f6 response_code = 200 uri = /network-bootstore-config
21342024-11-19T01:34:19.730ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33508
21352024-11-19T01:34:19.731ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33508 req_id = aebc2ffd-fa27-4e55-8c76-9c401f647f18 response_code = 200 uri = /baseboard
21362024-11-19T01:34:33.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55538
21372024-11-19T01:34:33.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55538 req_id = 0b479d1e-a036-4900-bdbb-921e9e6db646 response_code = 200 uri = /vpc-routes
21382024-11-19T01:34:33.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21392024-11-19T01:34:33.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55538 req_id = 42bb6bbd-6358-4520-a1f8-976a96fcc583 response_code = 204 uri = /eip-gateways
21402024-11-19T01:34:33.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55538 req_id = c5254eac-1951-41e3-a2c9-103a9ce4d786 response_code = 204 uri = /vpc-routes
21412024-11-19T01:34:33.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49501
21422024-11-19T01:34:33.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49501 req_id = feeaccef-dee7-4e0a-b54a-ff1c0f80575e response_code = 200 uri = /vpc-routes
21432024-11-19T01:34:33.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21442024-11-19T01:34:33.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49501 req_id = 26220cab-32a0-4412-b2f4-6f9ded99ebff response_code = 204 uri = /eip-gateways
21452024-11-19T01:34:33.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49501 req_id = 6894ed90-c80d-4997-9d3f-a2975950a625 response_code = 204 uri = /vpc-routes
21462024-11-19T01:34:33.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64384
21472024-11-19T01:34:33.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21482024-11-19T01:34:33.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21492024-11-19T01:34:34.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64384 req_id = dbc5cd47-af3c-4295-9571-54c3a9bc82db response_code = 204 uri = /switch-ports
21502024-11-19T01:34:34.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42618
21512024-11-19T01:34:34.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42618 req_id = 8695bedd-b09b-449a-ada9-6d2a90e9ea7b response_code = 200 uri = /v2p
21522024-11-19T01:34:34.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64384 req_id = 2af3912e-6f6e-4eff-afe3-f8c4c5f28759 response_code = 200 uri = /network-bootstore-config
21532024-11-19T01:34:34.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58007
21542024-11-19T01:34:34.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58007 req_id = b879bbce-1e72-4aed-a853-a9797780786d response_code = 200 uri = /v2p
21552024-11-19T01:34:34.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62097
21562024-11-19T01:34:34.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21572024-11-19T01:34:34.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21582024-11-19T01:34:34.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62097 req_id = 90dfa91b-0e50-4831-a434-1b1a809345b6 response_code = 204 uri = /switch-ports
21592024-11-19T01:34:34.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62097 req_id = eff8bc1a-64d8-4e75-9b55-97b72b27eede response_code = 200 uri = /network-bootstore-config
21602024-11-19T01:34:34.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64148
21612024-11-19T01:34:34.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64148 req_id = 4d2da7c6-eb4a-42a1-b1e4-043630066983 response_code = 200 uri = /vpc-routes
21622024-11-19T01:34:34.577ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21632024-11-19T01:34:34.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64148 req_id = 56da472a-675a-42ee-83c4-2094c67b70ec response_code = 204 uri = /eip-gateways
21642024-11-19T01:34:34.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49320
21652024-11-19T01:34:34.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49320 req_id = a7a65d81-5acd-4db0-a447-a4b8f362b119 response_code = 200 uri = /v2p
21662024-11-19T01:34:34.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64148 req_id = 2e8772a1-aaea-46b8-ad11-a0d0c91fbc16 response_code = 204 uri = /vpc-routes
21672024-11-19T01:34:34.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44553
21682024-11-19T01:34:34.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21692024-11-19T01:34:34.977ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21702024-11-19T01:34:35.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44553 req_id = 36856956-f978-4f8e-83a6-4830b1f82046 response_code = 204 uri = /switch-ports
21712024-11-19T01:34:35.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44553 req_id = 08ddb304-e056-4b80-bda7-9c44bac4b797 response_code = 200 uri = /network-bootstore-config
21722024-11-19T01:34:49.769ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58571
21732024-11-19T01:34:49.769ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58571 req_id = f579d36f-84d7-4e63-8db2-7c24385eee75 response_code = 200 uri = /baseboard
21742024-11-19T01:35:03.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40081
21752024-11-19T01:35:03.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40081 req_id = 8ddbe614-e768-4849-b3cd-520c6cfe4e42 response_code = 200 uri = /vpc-routes
21762024-11-19T01:35:03.690ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21772024-11-19T01:35:03.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40081 req_id = 344837df-dbba-4d48-8dd3-2d9cc3edec33 response_code = 204 uri = /eip-gateways
21782024-11-19T01:35:03.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40081 req_id = e490546d-d780-4c67-bfa6-79dfee65529b response_code = 204 uri = /vpc-routes
21792024-11-19T01:35:03.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43591
21802024-11-19T01:35:03.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43591 req_id = 62d04d5e-9a59-4699-917e-298ff3b8a408 response_code = 200 uri = /vpc-routes
21812024-11-19T01:35:03.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34013
21822024-11-19T01:35:03.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21832024-11-19T01:35:03.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21842024-11-19T01:35:03.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34013 req_id = f1383e4b-e5b4-4049-a9ab-3a56a5043872 response_code = 204 uri = /switch-ports
21852024-11-19T01:35:03.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34013 req_id = 98553834-54bb-4ecb-99b5-aab7f49121ef response_code = 200 uri = /network-bootstore-config
21862024-11-19T01:35:03.846ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
21872024-11-19T01:35:03.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43591 req_id = d034d5f1-e747-4ad7-82be-33a77b901e87 response_code = 204 uri = /eip-gateways
21882024-11-19T01:35:03.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49886
21892024-11-19T01:35:03.850ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21902024-11-19T01:35:03.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21912024-11-19T01:35:03.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49886 req_id = b34527d4-530d-40af-8fdf-65e4c0a6bb8a response_code = 204 uri = /switch-ports
21922024-11-19T01:35:03.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56850
21932024-11-19T01:35:03.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60375
21942024-11-19T01:35:03.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49886 req_id = 101c885c-3418-4f2a-ba98-7f09b3b2d882 response_code = 200 uri = /network-bootstore-config
21952024-11-19T01:35:03.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56850 req_id = 03bf8b6b-1944-4dbd-9ada-c8ad7e166f79 response_code = 200 uri = /v2p
21962024-11-19T01:35:03.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43591 req_id = f5017c97-23ed-45ff-93a5-645dd80ecfc5 response_code = 204 uri = /vpc-routes
21972024-11-19T01:35:03.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60375 req_id = f2106eb9-4c60-40d3-9bc0-b8528898a93b response_code = 200 uri = /v2p
21982024-11-19T01:35:04.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45487
21992024-11-19T01:35:04.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45487 req_id = f8077d91-8364-47bd-8f49-71fb130ea8d1 response_code = 200 uri = /vpc-routes
22002024-11-19T01:35:04.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22012024-11-19T01:35:04.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45487 req_id = 5860bb53-ea6d-4310-b899-dd5a82574b11 response_code = 204 uri = /eip-gateways
22022024-11-19T01:35:04.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45487 req_id = 66dba9b3-6438-4b49-befb-378759ee0131 response_code = 204 uri = /vpc-routes
22032024-11-19T01:35:04.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48325
22042024-11-19T01:35:04.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48325 req_id = 45de1031-b818-4557-aa93-93b795c5fdbc response_code = 200 uri = /v2p
22052024-11-19T01:35:04.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52481
22062024-11-19T01:35:04.669ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22072024-11-19T01:35:04.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22082024-11-19T01:35:04.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86400 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52481 req_id = 504dcf5a-af4c-4e03-ab52-1d6c542419a8 response_code = 204 uri = /switch-ports
22092024-11-19T01:35:04.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52481 req_id = f8588851-ac98-443a-8c5a-d6503564108d response_code = 200 uri = /network-bootstore-config
22102024-11-19T01:35:19.805ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53756
22112024-11-19T01:35:19.805ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53756 req_id = 0c917500-8b47-45ff-a928-bd76dd44e6d4 response_code = 200 uri = /baseboard
22122024-11-19T01:35:33.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49056
22132024-11-19T01:35:33.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49056 req_id = bbda044b-3c38-4156-ab21-42a67dce15e0 response_code = 200 uri = /vpc-routes
22142024-11-19T01:35:33.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22152024-11-19T01:35:33.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49056 req_id = 1dc6f635-4727-4eaa-b406-d60509c6232d response_code = 204 uri = /eip-gateways
22162024-11-19T01:35:33.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49056 req_id = b3edd7cb-c55e-4172-9f50-d25f995fd804 response_code = 204 uri = /vpc-routes
22172024-11-19T01:35:33.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35236
22182024-11-19T01:35:33.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35236 req_id = 2ea501a8-e65e-4ef2-8b31-932093c19ff6 response_code = 200 uri = /v2p
22192024-11-19T01:35:33.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34725
22202024-11-19T01:35:33.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22212024-11-19T01:35:33.941ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22222024-11-19T01:35:33.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34725 req_id = 8b80b643-822f-4b4c-9cd9-192ae4a259bd response_code = 204 uri = /switch-ports
22232024-11-19T01:35:33.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33667
22242024-11-19T01:35:33.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33667 req_id = 6236bf61-71ad-4857-838c-670c5305ec23 response_code = 200 uri = /vpc-routes
22252024-11-19T01:35:33.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34725 req_id = f3056d63-adda-4f8d-98ec-e1df0604ed8e response_code = 200 uri = /network-bootstore-config
22262024-11-19T01:35:34.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48222
22272024-11-19T01:35:34.007ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22282024-11-19T01:35:34.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22292024-11-19T01:35:34.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87969 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48222 req_id = 6ab2ea72-5931-4723-9b0e-58e5bd639837 response_code = 204 uri = /switch-ports
22302024-11-19T01:35:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53659
22312024-11-19T01:35:34.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22322024-11-19T01:35:34.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33667 req_id = af19e7d0-e473-4b4e-9064-4f591f9ee8bd response_code = 204 uri = /eip-gateways
22332024-11-19T01:35:34.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48222 req_id = d1a9c0b5-7751-4b4b-a8ae-a5bea01c7c06 response_code = 200 uri = /network-bootstore-config
22342024-11-19T01:35:34.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53659 req_id = c9dd8937-bb58-4c95-8566-881515e54d9b response_code = 200 uri = /v2p
22352024-11-19T01:35:34.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33667 req_id = 5bbe9b1a-3612-46e4-a6f5-bed9deab0efb response_code = 204 uri = /vpc-routes
22362024-11-19T01:35:34.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39299
22372024-11-19T01:35:34.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39299 req_id = f6576632-ccef-46fd-a589-2c584f5feb79 response_code = 200 uri = /vpc-routes
22382024-11-19T01:35:34.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22392024-11-19T01:35:34.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39299 req_id = 28ae17e5-4160-4c60-a148-7bbb311ffc12 response_code = 204 uri = /eip-gateways
22402024-11-19T01:35:34.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39299 req_id = 516623cf-95f1-453a-b8d1-492b2a86c860 response_code = 204 uri = /vpc-routes
22412024-11-19T01:35:34.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40876
22422024-11-19T01:35:34.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22432024-11-19T01:35:34.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22442024-11-19T01:35:34.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40876 req_id = 55972229-b827-4bc1-beea-7757118ffc2f response_code = 204 uri = /switch-ports
22452024-11-19T01:35:34.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49496
22462024-11-19T01:35:34.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40876 req_id = 4a629bed-eefe-4772-9c63-f8b44b59a0fc response_code = 200 uri = /network-bootstore-config
22472024-11-19T01:35:34.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49496 req_id = 9a895834-ad75-41ff-8046-5b38f15231e0 response_code = 200 uri = /v2p
22482024-11-19T01:35:49.844ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59763
22492024-11-19T01:35:49.844ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59763 req_id = 77c42a21-0e67-41b1-a9d3-30458bc68494 response_code = 200 uri = /baseboard
22502024-11-19T01:36:03.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64034
22512024-11-19T01:36:03.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64034 req_id = f48f685f-79d5-4fba-a8a7-33833915b682 response_code = 200 uri = /vpc-routes
22522024-11-19T01:36:03.694ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22532024-11-19T01:36:03.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64034 req_id = 8510fc22-6851-4861-ac53-9cca22788a89 response_code = 204 uri = /eip-gateways
22542024-11-19T01:36:03.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64034 req_id = 68993456-fdda-4b11-91c7-19e6a10e76a1 response_code = 204 uri = /vpc-routes
22552024-11-19T01:36:03.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50604
22562024-11-19T01:36:03.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50604 req_id = d1fa8c28-55dc-46dc-ba10-40ed023ea4dc response_code = 200 uri = /v2p
22572024-11-19T01:36:03.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40730
22582024-11-19T01:36:03.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22592024-11-19T01:36:03.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22602024-11-19T01:36:03.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40730 req_id = bda745f6-4361-40fc-938f-9821be71025d response_code = 204 uri = /switch-ports
22612024-11-19T01:36:03.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48495
22622024-11-19T01:36:03.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48495 req_id = 7c708fff-b05c-4eda-9479-96eb5c20fa7d response_code = 200 uri = /vpc-routes
22632024-11-19T01:36:03.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40730 req_id = 5069381d-fe51-4120-ab42-2a81a11d8105 response_code = 200 uri = /network-bootstore-config
22642024-11-19T01:36:03.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33211
22652024-11-19T01:36:03.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33211 req_id = 12d8aa8c-b68a-450c-aaa3-51f37ba92082 response_code = 200 uri = /v2p
22662024-11-19T01:36:03.868ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22672024-11-19T01:36:03.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48495 req_id = 8b55194b-7922-4a8d-ac30-f010caeaf90b response_code = 204 uri = /eip-gateways
22682024-11-19T01:36:03.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48495 req_id = 35707bed-7d67-49ce-aca4-ec8e93cc666b response_code = 204 uri = /vpc-routes
22692024-11-19T01:36:03.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48803
22702024-11-19T01:36:03.893ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22712024-11-19T01:36:03.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22722024-11-19T01:36:03.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48803 req_id = dc9b6b8f-b539-4dda-b936-37acb297f06e response_code = 204 uri = /switch-ports
22732024-11-19T01:36:03.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48803 req_id = 6bafa18c-75ef-4b49-8377-87c1430483cb response_code = 200 uri = /network-bootstore-config
22742024-11-19T01:36:04.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38651
22752024-11-19T01:36:04.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38651 req_id = cfc6db29-3c3f-4d03-8638-536ab4953727 response_code = 200 uri = /vpc-routes
22762024-11-19T01:36:04.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22772024-11-19T01:36:04.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38651 req_id = 78d05003-4825-489a-841f-be011f7f23e9 response_code = 204 uri = /eip-gateways
22782024-11-19T01:36:04.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38651 req_id = 8619e841-1904-45a5-90e3-ae6f97ebde07 response_code = 204 uri = /vpc-routes
22792024-11-19T01:36:04.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57693
22802024-11-19T01:36:04.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57693 req_id = 48253e0e-69f1-4b82-a0ef-fd2eb57ae674 response_code = 200 uri = /v2p
22812024-11-19T01:36:04.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64746
22822024-11-19T01:36:04.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22832024-11-19T01:36:04.580ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22842024-11-19T01:36:04.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64746 req_id = 886802b4-8001-495b-96de-6b3c4333b23c response_code = 204 uri = /switch-ports
22852024-11-19T01:36:04.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64746 req_id = 0df6ea70-b836-4d6b-a3c3-f85d98f58f3e response_code = 200 uri = /network-bootstore-config
22862024-11-19T01:36:19.876ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52540
22872024-11-19T01:36:19.877ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52540 req_id = 3b4ac743-2a26-412f-b041-a25e9e3cb8e2 response_code = 200 uri = /baseboard
22882024-11-19T01:36:33.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43854
22892024-11-19T01:36:33.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43854 req_id = e780705c-79ba-4a39-b728-85907fb38564 response_code = 200 uri = /vpc-routes
22902024-11-19T01:36:33.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22912024-11-19T01:36:33.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43854 req_id = 027b0980-c333-4c8d-afe1-344cd85bfa8f response_code = 204 uri = /eip-gateways
22922024-11-19T01:36:33.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43854 req_id = 041a5de4-0baf-463e-b07e-e4c05e57f4be response_code = 204 uri = /vpc-routes
22932024-11-19T01:36:33.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62113
22942024-11-19T01:36:33.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62113 req_id = 613baea3-3b72-45e9-8fef-d5483bd3cacc response_code = 200 uri = /vpc-routes
22952024-11-19T01:36:33.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
22962024-11-19T01:36:33.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62113 req_id = a8f1d03e-c22f-45ea-a682-5dc9549b146e response_code = 204 uri = /eip-gateways
22972024-11-19T01:36:33.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41233
22982024-11-19T01:36:33.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41233 req_id = 9f34296e-35aa-497c-b8a8-2b5be68264b9 response_code = 200 uri = /v2p
22992024-11-19T01:36:33.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57538
23002024-11-19T01:36:33.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23012024-11-19T01:36:33.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23022024-11-19T01:36:34.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95612 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57538 req_id = f2d79b7e-3c43-44fa-b813-f6b59bfa6ddb response_code = 204 uri = /switch-ports
23032024-11-19T01:36:34.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54416
23042024-11-19T01:36:34.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57538 req_id = 5084519a-94fd-4e6e-8a74-6120d5f9c244 response_code = 200 uri = /network-bootstore-config
23052024-11-19T01:36:34.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54416 req_id = cb5d3832-59be-4fb5-9a1f-81e3a4f0e004 response_code = 200 uri = /v2p
23062024-11-19T01:36:34.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62113 req_id = aac45ea8-c25b-498d-894e-c89d156b4704 response_code = 204 uri = /vpc-routes
23072024-11-19T01:36:34.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35972
23082024-11-19T01:36:34.101ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23092024-11-19T01:36:34.138ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23102024-11-19T01:36:34.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91008 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35972 req_id = 0af7163b-058b-4bb6-8010-4dc834bbf60a response_code = 204 uri = /switch-ports
23112024-11-19T01:36:34.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35972 req_id = 0ef10cea-9c14-4721-944d-10edab37423b response_code = 200 uri = /network-bootstore-config
23122024-11-19T01:36:34.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61628
23132024-11-19T01:36:34.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61628 req_id = 6fe9ff57-e180-4d38-9e35-21e3f05b3039 response_code = 200 uri = /vpc-routes
23142024-11-19T01:36:34.445ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
23152024-11-19T01:36:34.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61628 req_id = be6f2f44-a6aa-4a71-94ff-e7581b70fc02 response_code = 204 uri = /eip-gateways
23162024-11-19T01:36:34.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61628 req_id = 878b3f47-6dac-44a1-94a9-fe370ede536f response_code = 204 uri = /vpc-routes
23172024-11-19T01:36:34.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36127
23182024-11-19T01:36:34.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36127 req_id = 11651264-280c-445a-a00c-7002b5b7d28f response_code = 200 uri = /v2p
23192024-11-19T01:36:34.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60922
23202024-11-19T01:36:34.713ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23212024-11-19T01:36:34.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23222024-11-19T01:36:34.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60922 req_id = b3b13d33-932a-48e6-863c-a76fd4b1af93 response_code = 204 uri = /switch-ports
23232024-11-19T01:36:34.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60922 req_id = 066d68b7-26e4-4661-ab7a-e7896b762a6a response_code = 200 uri = /network-bootstore-config
23242024-11-19T01:36:49.910ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48140
23252024-11-19T01:36:49.910ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48140 req_id = 69dfabf2-eb93-46b9-b438-76e8f7a369a2 response_code = 200 uri = /baseboard
23262024-11-19T01:37:03.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51521
23272024-11-19T01:37:03.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51521 req_id = 660e588c-e602-41c3-9568-23fd0d0214d4 response_code = 200 uri = /vpc-routes
23282024-11-19T01:37:03.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
23292024-11-19T01:37:03.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51521 req_id = 54d8411f-9bea-4b81-9b47-65ddace97f67 response_code = 204 uri = /eip-gateways
23302024-11-19T01:37:03.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51521 req_id = 54821762-4d21-4c13-95a9-d650d51b1c93 response_code = 204 uri = /vpc-routes
23312024-11-19T01:37:03.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50518
23322024-11-19T01:37:03.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60129
23332024-11-19T01:37:03.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60129 req_id = 93adc4e7-bc3f-4aee-a645-038e03b77766 response_code = 200 uri = /v2p
23342024-11-19T01:37:03.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50518 req_id = c79c81b6-25f9-4925-9b18-68bb79c46fdc response_code = 200 uri = /vpc-routes
23352024-11-19T01:37:03.860ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
23362024-11-19T01:37:03.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50518 req_id = 984079c4-372a-4912-be45-ffc9813ba647 response_code = 204 uri = /eip-gateways
23372024-11-19T01:37:03.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50518 req_id = f777870e-e483-4fc3-8fd7-2b22da2eaed5 response_code = 204 uri = /vpc-routes
23382024-11-19T01:37:03.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35711
23392024-11-19T01:37:03.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23402024-11-19T01:37:03.922ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23412024-11-19T01:37:03.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97886 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35711 req_id = a16e80b4-9b9e-46b5-a9c7-2b8ed6fd27bb response_code = 204 uri = /switch-ports
23422024-11-19T01:37:03.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60540
23432024-11-19T01:37:03.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63525
23442024-11-19T01:37:03.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35711 req_id = d5c89d08-3445-468f-a4b3-134476f3e3cf response_code = 200 uri = /network-bootstore-config
23452024-11-19T01:37:03.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60540 req_id = 33dfe07b-0d75-4463-b4c8-882884935813 response_code = 200 uri = /v2p
23462024-11-19T01:37:03.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23472024-11-19T01:37:04.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23482024-11-19T01:37:04.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89560 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63525 req_id = b163705f-2144-4403-be92-d39d4fd8fcc5 response_code = 204 uri = /switch-ports
23492024-11-19T01:37:04.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63525 req_id = d39b8706-a8db-4817-9998-52be4aa8d2f0 response_code = 200 uri = /network-bootstore-config
23502024-11-19T01:37:04.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41996
23512024-11-19T01:37:04.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41996 req_id = 6920927c-8e1d-42b3-975a-888c478ae387 response_code = 200 uri = /vpc-routes
23522024-11-19T01:37:04.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
23532024-11-19T01:37:04.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41996 req_id = 9a99eac4-16b1-4864-bc2b-1cb7735b8c69 response_code = 204 uri = /eip-gateways
23542024-11-19T01:37:04.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41996 req_id = 68e4ac1d-4837-48e5-9b12-3881c42fc9c7 response_code = 204 uri = /vpc-routes
23552024-11-19T01:37:04.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48079
23562024-11-19T01:37:04.524ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23572024-11-19T01:37:04.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23582024-11-19T01:37:04.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48079 req_id = dbfbf025-2b18-47b7-a71a-25e04bc6d4ce response_code = 204 uri = /switch-ports
23592024-11-19T01:37:04.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55732
23602024-11-19T01:37:04.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55732 req_id = 805e1712-cef9-43d0-afee-7b42b1d4b151 response_code = 200 uri = /v2p
23612024-11-19T01:37:04.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48079 req_id = 921e264e-bf71-451d-86c5-241e2f84615f response_code = 200 uri = /network-bootstore-config
23622024-11-19T01:37:19.943ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42277
23632024-11-19T01:37:19.943ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42277 req_id = 87054c07-2044-4a9e-aae5-ce6b305817e6 response_code = 200 uri = /baseboard
23642024-11-19T01:37:33.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56054
23652024-11-19T01:37:33.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56054 req_id = 484af65e-5480-4459-9ee9-d84de503fdc2 response_code = 200 uri = /vpc-routes
23662024-11-19T01:37:33.848ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
23672024-11-19T01:37:33.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56054 req_id = 350271f3-8cd4-4af7-9f9d-244c15cd15dc response_code = 204 uri = /eip-gateways
23682024-11-19T01:37:33.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56054 req_id = 5772ad0e-9be7-48a6-aa9b-841bb73b770c response_code = 204 uri = /vpc-routes
23692024-11-19T01:37:33.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39765
23702024-11-19T01:37:33.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39765 req_id = eac5d6ee-f0c0-41d0-9eb1-c38fc9412de2 response_code = 200 uri = /vpc-routes
23712024-11-19T01:37:33.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34017
23722024-11-19T01:37:33.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34017 req_id = 26271aee-a4f1-4ada-9364-46e2337610e4 response_code = 200 uri = /v2p
23732024-11-19T01:37:33.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43161
23742024-11-19T01:37:33.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43161 req_id = f0ae45a5-7f09-4865-8d82-5575a4cdaee7 response_code = 200 uri = /v2p
23752024-11-19T01:37:33.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
23762024-11-19T01:37:33.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39765 req_id = c1114ae5-4081-41e7-929d-b5b3e2f1a0d2 response_code = 204 uri = /eip-gateways
23772024-11-19T01:37:33.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39765 req_id = d1177b6f-1154-4b19-b4de-7163cce32e50 response_code = 204 uri = /vpc-routes
23782024-11-19T01:37:34.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45685
23792024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23802024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23812024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23822024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23832024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23842024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23852024-11-19T01:37:34.025ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23862024-11-19T01:37:34.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45685 req_id = b01d2d97-5210-4afe-98e9-b0955facdb44 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23872024-11-19T01:37:34.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54903
23882024-11-19T01:37:34.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23892024-11-19T01:37:34.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23902024-11-19T01:37:34.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97412 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54903 req_id = cab51d06-d80d-495f-8d85-68599d5e33e1 response_code = 204 uri = /switch-ports
23912024-11-19T01:37:34.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58164
23922024-11-19T01:37:34.139ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23932024-11-19T01:37:34.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54903 req_id = c6d261e5-9cab-4ebd-ac0e-01b946acc86b response_code = 200 uri = /network-bootstore-config
23942024-11-19T01:37:34.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23952024-11-19T01:37:34.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41762
23962024-11-19T01:37:34.179ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23972024-11-19T01:37:34.180ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23982024-11-19T01:37:34.180ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23992024-11-19T01:37:34.180ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24002024-11-19T01:37:34.180ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24012024-11-19T01:37:34.180ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24022024-11-19T01:37:34.180ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24032024-11-19T01:37:34.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41762 req_id = 38a6c052-7ebc-4354-ab01-8c3acfb42712 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24042024-11-19T01:37:34.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58164 req_id = a93eca30-c02b-4631-9ca0-2c12a0bf328b response_code = 204 uri = /switch-ports
24052024-11-19T01:37:34.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58164 req_id = 0230077e-98b2-47be-b5da-d7f71b42fa99 response_code = 200 uri = /network-bootstore-config
24062024-11-19T01:37:34.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64248
24072024-11-19T01:37:34.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64248 req_id = d704c91a-77bf-4cb5-b411-c850d8508734 response_code = 200 uri = /vpc-routes
24082024-11-19T01:37:34.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59900
24092024-11-19T01:37:34.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59900 req_id = fde7f430-39d8-4153-ad66-aa071dd77c35 response_code = 200 uri = /v2p
24102024-11-19T01:37:34.699ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24112024-11-19T01:37:34.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64248 req_id = d8c44aad-6476-49b7-ba91-636bab48117b response_code = 204 uri = /eip-gateways
24122024-11-19T01:37:34.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64248 req_id = 2daac568-950b-47c2-bb80-1ecac8c3f71a response_code = 204 uri = /vpc-routes
24132024-11-19T01:37:34.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44303
24142024-11-19T01:37:34.752ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24152024-11-19T01:37:34.786ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24162024-11-19T01:37:34.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44303 req_id = a48da1bb-d994-4bb7-a3ed-f364f32b334c response_code = 204 uri = /switch-ports
24172024-11-19T01:37:34.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44303 req_id = 35e86c09-4edb-47a5-8b12-17dcd63afe10 response_code = 200 uri = /network-bootstore-config
24182024-11-19T01:37:34.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54989
24192024-11-19T01:37:34.922ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24202024-11-19T01:37:34.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
24212024-11-19T01:37:34.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24222024-11-19T01:37:34.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24232024-11-19T01:37:34.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24242024-11-19T01:37:34.922ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24252024-11-19T01:37:34.923ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24262024-11-19T01:37:34.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54989 req_id = 352001b4-d10d-40a9-b8af-68141df511fd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24272024-11-19T01:37:49.975ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47126
24282024-11-19T01:37:49.975ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47126 req_id = 4b744aa1-134f-4c61-b5e0-9855736fd250 response_code = 200 uri = /baseboard
24292024-11-19T01:38:03.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52694
24302024-11-19T01:38:03.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52694 req_id = 8778f61e-3893-4700-9815-ac821a945134 response_code = 200 uri = /vpc-routes
24312024-11-19T01:38:03.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24322024-11-19T01:38:03.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52694 req_id = 80716488-7e39-4ce5-82c9-e78fe2d25065 response_code = 204 uri = /eip-gateways
24332024-11-19T01:38:03.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52694 req_id = 137f64a4-266c-41b0-932b-87d7b5420648 response_code = 204 uri = /vpc-routes
24342024-11-19T01:38:03.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63781
24352024-11-19T01:38:03.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63781 req_id = 3fca30bc-5ff1-4c20-af03-7a4a0c45b0bf response_code = 200 uri = /v2p
24362024-11-19T01:38:03.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60349
24372024-11-19T01:38:03.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24382024-11-19T01:38:03.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24392024-11-19T01:38:03.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91403 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60349 req_id = 7ff48e24-a283-48a0-9b73-26937b647009 response_code = 204 uri = /switch-ports
24402024-11-19T01:38:03.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58432
24412024-11-19T01:38:03.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58432 req_id = 8b489e36-e3df-4c71-8b3f-b70539a3c3ea response_code = 200 uri = /vpc-routes
24422024-11-19T01:38:03.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60349 req_id = 257aa387-d27e-4007-aaef-65689cf32c56 response_code = 200 uri = /network-bootstore-config
24432024-11-19T01:38:03.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63591
24442024-11-19T01:38:03.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63591 req_id = 0656dfaa-2de8-424d-a72c-6686b34c1f95 response_code = 200 uri = /v2p
24452024-11-19T01:38:03.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24462024-11-19T01:38:03.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58432 req_id = 3019201d-1c14-479a-8430-d8cfb93f31da response_code = 204 uri = /eip-gateways
24472024-11-19T01:38:03.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58432 req_id = 02180598-5521-41ab-abfb-7eb8cc3013c7 response_code = 204 uri = /vpc-routes
24482024-11-19T01:38:03.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48417
24492024-11-19T01:38:03.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24502024-11-19T01:38:03.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24512024-11-19T01:38:04.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48417 req_id = 5b75550f-87a3-4056-ae85-6be7a7a266c5 response_code = 204 uri = /switch-ports
24522024-11-19T01:38:04.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48417 req_id = fecfee3b-5070-4800-92d2-f01f38d7d917 response_code = 200 uri = /network-bootstore-config
24532024-11-19T01:38:04.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62736
24542024-11-19T01:38:04.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62736 req_id = 49270771-d513-430b-94d3-c6ea6fa26b1e response_code = 200 uri = /vpc-routes
24552024-11-19T01:38:04.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24562024-11-19T01:38:04.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62736 req_id = 1df35362-d031-45ec-8579-b0eccac92e86 response_code = 204 uri = /eip-gateways
24572024-11-19T01:38:04.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62334
24582024-11-19T01:38:04.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62334 req_id = d8ccd7ee-0543-4ee1-82e1-698542b02d3e response_code = 200 uri = /v2p
24592024-11-19T01:38:04.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62736 req_id = 15c87421-0c27-4f6a-a721-8dd54f528212 response_code = 204 uri = /vpc-routes
24602024-11-19T01:38:04.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51058
24612024-11-19T01:38:04.605ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24622024-11-19T01:38:04.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24632024-11-19T01:38:04.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89291 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51058 req_id = 5f39f0c4-5fda-43ce-b078-accb1044f178 response_code = 204 uri = /switch-ports
24642024-11-19T01:38:04.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51058 req_id = 84680d94-ba31-48a3-ab2b-2d76f8a5fb05 response_code = 200 uri = /network-bootstore-config
24652024-11-19T01:38:20.010ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42925
24662024-11-19T01:38:20.010ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42925 req_id = 91a400fe-b9d5-40d5-93d4-22d165b68e83 response_code = 200 uri = /baseboard
24672024-11-19T01:38:20.486ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24682024-11-19T01:38:20.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24692024-11-19T01:38:20.520ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1950, tv_nsec: 694451958 } time_to_next_cleanup = 599.99999592s
24702024-11-19T01:38:33.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38962
24712024-11-19T01:38:33.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38962 req_id = 463e3735-e910-4d4b-96d2-c64633c8013e response_code = 200 uri = /vpc-routes
24722024-11-19T01:38:33.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24732024-11-19T01:38:33.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38962 req_id = 292576dc-e85c-4974-975a-f5070a096b1a response_code = 204 uri = /eip-gateways
24742024-11-19T01:38:33.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38962 req_id = 3c761103-871c-423a-bf8d-657132c4dc2a response_code = 204 uri = /vpc-routes
24752024-11-19T01:38:33.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38160
24762024-11-19T01:38:33.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38160 req_id = 82d58042-152f-4091-a5b5-c4cebdacf22d response_code = 200 uri = /v2p
24772024-11-19T01:38:33.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35270
24782024-11-19T01:38:33.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35270 req_id = a56ed798-1ab8-41a2-8b25-abd85c9384d0 response_code = 200 uri = /vpc-routes
24792024-11-19T01:38:33.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24802024-11-19T01:38:33.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35270 req_id = e85332c2-7982-4859-8a6b-2e180c001921 response_code = 204 uri = /eip-gateways
24812024-11-19T01:38:33.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35270 req_id = ac5a0df2-c0a6-4392-87f8-94126ac2abe4 response_code = 204 uri = /vpc-routes
24822024-11-19T01:38:33.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62999
24832024-11-19T01:38:33.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62999 req_id = 35e57336-cb91-4289-94b9-71058d17ccfc response_code = 200 uri = /v2p
24842024-11-19T01:38:33.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62945
24852024-11-19T01:38:33.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24862024-11-19T01:38:34.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24872024-11-19T01:38:34.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62945 req_id = be09c822-2520-4d5b-bec0-4742cf6760d6 response_code = 204 uri = /switch-ports
24882024-11-19T01:38:34.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52087
24892024-11-19T01:38:34.089ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24902024-11-19T01:38:34.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3911 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62945 req_id = d879db72-9949-4c35-85dd-bfb625b02a4d response_code = 200 uri = /network-bootstore-config
24912024-11-19T01:38:34.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24922024-11-19T01:38:34.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52087 req_id = 4a7ffaa4-fc18-4ee2-8ac0-75dd422409a3 response_code = 204 uri = /switch-ports
24932024-11-19T01:38:34.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52087 req_id = 6b734e76-3edc-41b5-ac68-d52a59600b1d response_code = 200 uri = /network-bootstore-config
24942024-11-19T01:38:34.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39616
24952024-11-19T01:38:34.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39616 req_id = 91e07983-a887-428d-82de-259b660059e7 response_code = 200 uri = /vpc-routes
24962024-11-19T01:38:34.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
24972024-11-19T01:38:34.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39616 req_id = 1c7c3586-d7b2-4443-ad65-fdd059ed83dc response_code = 204 uri = /eip-gateways
24982024-11-19T01:38:34.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39616 req_id = d89c9148-4a40-4642-ae20-a8211c4c5439 response_code = 204 uri = /vpc-routes
24992024-11-19T01:38:34.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37057
25002024-11-19T01:38:34.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37057 req_id = a0669335-bf86-42db-b566-ad64a9ee295a response_code = 200 uri = /v2p
25012024-11-19T01:38:34.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46943
25022024-11-19T01:38:34.703ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25032024-11-19T01:38:34.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25042024-11-19T01:38:34.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46943 req_id = 720aec19-a1c9-43c5-a14a-6e77a7b4e38c response_code = 204 uri = /switch-ports
25052024-11-19T01:38:34.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46943 req_id = 17577700-ad9b-4302-b6e7-cd50d44b226f response_code = 200 uri = /network-bootstore-config
25062024-11-19T01:38:35.017ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25072024-11-19T01:38:50.043ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53503
25082024-11-19T01:38:50.043ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53503 req_id = a913726d-7669-4694-9fc8-3b8e10d1c197 response_code = 200 uri = /baseboard
25092024-11-19T01:39:03.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44313
25102024-11-19T01:39:03.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44313 req_id = 0c8cec25-cef4-4b53-87c3-8ea063645181 response_code = 200 uri = /vpc-routes
25112024-11-19T01:39:03.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25122024-11-19T01:39:03.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44313 req_id = 033c982c-39f6-4089-a242-292cb1d800f8 response_code = 204 uri = /eip-gateways
25132024-11-19T01:39:03.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44313 req_id = d2da35b6-bbdc-4639-8caa-7808d63f31d5 response_code = 204 uri = /vpc-routes
25142024-11-19T01:39:03.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43177
25152024-11-19T01:39:03.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25162024-11-19T01:39:03.749ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25172024-11-19T01:39:03.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92524 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43177 req_id = 4bf74417-7601-4440-9a9e-34d16b90fff8 response_code = 204 uri = /switch-ports
25182024-11-19T01:39:03.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36271
25192024-11-19T01:39:03.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61797
25202024-11-19T01:39:03.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61797 req_id = 2e5a7f40-201d-44b0-b5fd-465ade9d4508 response_code = 200 uri = /vpc-routes
25212024-11-19T01:39:03.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43177 req_id = f15d7d8b-d0db-4458-9607-4c67ca67814a response_code = 200 uri = /network-bootstore-config
25222024-11-19T01:39:03.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36271 req_id = c8568f6d-7dfd-4b83-8571-80fbd4838d31 response_code = 200 uri = /v2p
25232024-11-19T01:39:03.818ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25242024-11-19T01:39:03.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61797 req_id = cb4028a3-922d-407b-a3a0-9a7f92111a0b response_code = 204 uri = /eip-gateways
25252024-11-19T01:39:03.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61797 req_id = 230e14e8-47eb-471f-9f4c-274039a13340 response_code = 204 uri = /vpc-routes
25262024-11-19T01:39:03.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61429
25272024-11-19T01:39:03.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61429 req_id = c4e2a703-c717-4a8c-9237-fc91b3402211 response_code = 200 uri = /v2p
25282024-11-19T01:39:03.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48254
25292024-11-19T01:39:03.891ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25302024-11-19T01:39:03.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25312024-11-19T01:39:03.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48254 req_id = 6d49a9a6-8d9a-4be3-9cb4-a1dd6ed70fc0 response_code = 204 uri = /switch-ports
25322024-11-19T01:39:03.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48254 req_id = 0341b3c1-190d-4777-a0c8-7579165aafe9 response_code = 200 uri = /network-bootstore-config
25332024-11-19T01:39:04.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61126
25342024-11-19T01:39:04.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61126 req_id = d9e6bffc-6909-42b6-aba5-c3fcbd40ef23 response_code = 200 uri = /vpc-routes
25352024-11-19T01:39:04.426ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25362024-11-19T01:39:04.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61126 req_id = 438aada1-4ee8-4246-a03b-d3d1df3d9cc3 response_code = 204 uri = /eip-gateways
25372024-11-19T01:39:04.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61126 req_id = 8bcaea46-e330-4e48-a327-27812553737f response_code = 204 uri = /vpc-routes
25382024-11-19T01:39:04.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58205
25392024-11-19T01:39:04.506ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25402024-11-19T01:39:04.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25412024-11-19T01:39:04.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58205 req_id = 2c96f1e2-cfc8-4ea3-ad0a-d4b3cb66b40f response_code = 204 uri = /switch-ports
25422024-11-19T01:39:04.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52384
25432024-11-19T01:39:04.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58205 req_id = 37a3c4cb-769d-41bf-a33b-028038a2b3c2 response_code = 200 uri = /network-bootstore-config
25442024-11-19T01:39:04.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52384 req_id = 497e1885-dc62-410d-ae22-e32fedac0f97 response_code = 200 uri = /v2p
25452024-11-19T01:39:20.079ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58500
25462024-11-19T01:39:20.079ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58500 req_id = 440ce97b-0326-466c-a702-f0004b30892e response_code = 200 uri = /baseboard
25472024-11-19T01:39:33.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53032
25482024-11-19T01:39:33.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53032 req_id = 0cab27a1-9be8-42c4-89f3-8014746bb3a9 response_code = 200 uri = /vpc-routes
25492024-11-19T01:39:33.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52373
25502024-11-19T01:39:33.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52373 req_id = 45f8e2f0-34c4-4d06-94e8-5d219d0bd384 response_code = 200 uri = /vpc-routes
25512024-11-19T01:39:33.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25522024-11-19T01:39:33.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52373 req_id = cdad5257-f9d4-409d-ba7e-9ef347c27763 response_code = 204 uri = /eip-gateways
25532024-11-19T01:39:33.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25542024-11-19T01:39:33.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53032 req_id = 9341e75e-9825-4138-822c-40dddffecf06 response_code = 204 uri = /eip-gateways
25552024-11-19T01:39:33.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52373 req_id = 16752a3b-d739-4ab3-8c0b-a5cffa0d305a response_code = 204 uri = /vpc-routes
25562024-11-19T01:39:33.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53032 req_id = 35e1c297-6ead-4c36-83db-f88ec36576d0 response_code = 204 uri = /vpc-routes
25572024-11-19T01:39:33.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59011
25582024-11-19T01:39:33.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25592024-11-19T01:39:34.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25602024-11-19T01:39:34.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99202 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59011 req_id = 2bc815b6-33c4-4a77-9608-543d458a52f7 response_code = 204 uri = /switch-ports
25612024-11-19T01:39:34.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65258
25622024-11-19T01:39:34.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54835
25632024-11-19T01:39:34.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52047
25642024-11-19T01:39:34.066ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25652024-11-19T01:39:34.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3929 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59011 req_id = 9ffe58e7-58b8-485e-8fb9-99a67d31152c response_code = 200 uri = /network-bootstore-config
25662024-11-19T01:39:34.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3861 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65258 req_id = 3895a75e-8a0b-4199-9e12-e477c62fe6b1 response_code = 200 uri = /v2p
25672024-11-19T01:39:34.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54835 req_id = f80be7dd-2ae4-497e-a4d7-6aaa5d79070c response_code = 200 uri = /v2p
25682024-11-19T01:39:34.100ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25692024-11-19T01:39:34.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52047 req_id = 3772fe91-c24c-4087-96b7-6192474c4a88 response_code = 204 uri = /switch-ports
25702024-11-19T01:39:34.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52047 req_id = 502506f7-f31e-497b-95df-60e34d7891fc response_code = 200 uri = /network-bootstore-config
25712024-11-19T01:39:34.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47053
25722024-11-19T01:39:34.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47053 req_id = f6c7cac9-745f-401e-ae23-831c7ed6e22b response_code = 200 uri = /vpc-routes
25732024-11-19T01:39:34.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46652
25742024-11-19T01:39:34.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46652 req_id = 77b4817e-b529-4c27-989d-1219d9d934e9 response_code = 200 uri = /v2p
25752024-11-19T01:39:34.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25762024-11-19T01:39:34.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47053 req_id = c3b11154-fc37-4f7b-8403-d8e16ed9ea22 response_code = 204 uri = /eip-gateways
25772024-11-19T01:39:34.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47053 req_id = bd908135-aabf-4939-9768-fd63375d0453 response_code = 204 uri = /vpc-routes
25782024-11-19T01:39:34.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49784
25792024-11-19T01:39:34.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25802024-11-19T01:39:35.036ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25812024-11-19T01:39:35.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49784 req_id = 96976323-8b2c-491c-bb8d-14bc26f9b864 response_code = 204 uri = /switch-ports
25822024-11-19T01:39:35.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49784 req_id = 02d07cfb-bddb-4f34-8baf-15dc609dbee2 response_code = 200 uri = /network-bootstore-config
25832024-11-19T01:39:50.110ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34900
25842024-11-19T01:39:50.110ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34900 req_id = 8e18128e-4701-4d1d-a267-9effbc67fe28 response_code = 200 uri = /baseboard
25852024-11-19T01:40:03.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63376
25862024-11-19T01:40:03.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63376 req_id = 5a330ace-0c6a-4aaf-9aa3-ce7ef4197809 response_code = 200 uri = /vpc-routes
25872024-11-19T01:40:03.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
25882024-11-19T01:40:03.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63376 req_id = 9a0faaae-d55b-4557-bc2a-ce46a831f106 response_code = 204 uri = /eip-gateways
25892024-11-19T01:40:03.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56158
25902024-11-19T01:40:03.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25912024-11-19T01:40:03.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25922024-11-19T01:40:03.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98702 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56158 req_id = f101aaf7-fe98-4dd4-b762-5f40270aa93c response_code = 204 uri = /switch-ports
25932024-11-19T01:40:03.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51358
25942024-11-19T01:40:03.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55795
25952024-11-19T01:40:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56158 req_id = 16b0eb6f-42c7-42bb-9591-abeb77fa51b0 response_code = 200 uri = /network-bootstore-config
25962024-11-19T01:40:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51358 req_id = 9707187c-6bc7-4994-8503-1190b493f94d response_code = 200 uri = /v2p
25972024-11-19T01:40:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63376 req_id = fdbe329a-2cdf-416e-a813-d2610236548e response_code = 204 uri = /vpc-routes
25982024-11-19T01:40:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55795 req_id = eb8ab3ad-7976-4e41-b9f7-b21984fa34b8 response_code = 200 uri = /vpc-routes
25992024-11-19T01:40:03.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34574
26002024-11-19T01:40:03.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34574 req_id = 19dc7d33-c96d-4f08-ac60-f639e34ef476 response_code = 200 uri = /v2p
26012024-11-19T01:40:03.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47700
26022024-11-19T01:40:03.816ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26032024-11-19T01:40:03.855ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26042024-11-19T01:40:03.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96471 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47700 req_id = 63c7e150-cf44-4ca7-b648-06f4122ed206 response_code = 204 uri = /switch-ports
26052024-11-19T01:40:03.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47700 req_id = 3c2c6b8f-e592-4c2b-9fe2-85981879ba46 response_code = 200 uri = /network-bootstore-config
26062024-11-19T01:40:03.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26072024-11-19T01:40:03.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55795 req_id = c20d2f6d-0e36-4163-bf21-78978f81d2c4 response_code = 204 uri = /eip-gateways
26082024-11-19T01:40:03.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55795 req_id = 4369e43b-1182-4a2b-9508-30e2defff01a response_code = 204 uri = /vpc-routes
26092024-11-19T01:40:04.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37455
26102024-11-19T01:40:04.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37455 req_id = c792cff3-4ee4-413c-8ddf-280cafc83be9 response_code = 200 uri = /vpc-routes
26112024-11-19T01:40:04.455ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26122024-11-19T01:40:04.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37455 req_id = f5ba5ac9-8de6-4061-879e-211dde15b945 response_code = 204 uri = /eip-gateways
26132024-11-19T01:40:04.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37455 req_id = 915e22bd-710e-484b-90a8-b1ee5ac11b1a response_code = 204 uri = /vpc-routes
26142024-11-19T01:40:04.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57386
26152024-11-19T01:40:04.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57386 req_id = bc84339c-9684-4a8a-8091-d5b9ce01f99e response_code = 200 uri = /v2p
26162024-11-19T01:40:04.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42367
26172024-11-19T01:40:04.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26182024-11-19T01:40:04.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26192024-11-19T01:40:04.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42367 req_id = 4d87a039-b2bd-440c-8abd-2e763a6c7fba response_code = 204 uri = /switch-ports
26202024-11-19T01:40:04.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42367 req_id = 3cb78303-5b04-4ba8-8c76-40f135bc0773 response_code = 200 uri = /network-bootstore-config
26212024-11-19T01:40:10.421ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26222024-11-19T01:40:10.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26232024-11-19T01:40:20.144ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53990
26242024-11-19T01:40:20.145ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53990 req_id = d3deea89-f658-4b71-8306-249d12e8430a response_code = 200 uri = /baseboard
26252024-11-19T01:40:20.423ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26262024-11-19T01:40:20.424ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26272024-11-19T01:40:20.425ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26282024-11-19T01:40:20.426ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26292024-11-19T01:40:30.428ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26302024-11-19T01:40:30.429ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26312024-11-19T01:40:30.430ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26322024-11-19T01:40:30.431ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26332024-11-19T01:40:33.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64358
26342024-11-19T01:40:33.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64358 req_id = 73f559a7-aa0a-4ded-97ab-75f7d65c2878 response_code = 200 uri = /vpc-routes
26352024-11-19T01:40:33.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37102
26362024-11-19T01:40:33.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37102 req_id = 5fd9a975-2078-40b0-bffa-c30e2d08b99e response_code = 200 uri = /vpc-routes
26372024-11-19T01:40:33.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35694
26382024-11-19T01:40:33.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35694 req_id = f9f2af59-cf00-4f3f-896f-def231f58782 response_code = 200 uri = /v2p
26392024-11-19T01:40:33.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26402024-11-19T01:40:33.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37102 req_id = 18e12deb-64f6-45eb-8034-7baf6f3cc0d6 response_code = 204 uri = /eip-gateways
26412024-11-19T01:40:33.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37102 req_id = 2c33107f-513d-439c-a7c5-0821b411a5b7 response_code = 204 uri = /vpc-routes
26422024-11-19T01:40:33.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26432024-11-19T01:40:33.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64358 req_id = d0064a6b-179c-40bc-b726-39cad6fbc7e3 response_code = 204 uri = /eip-gateways
26442024-11-19T01:40:33.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64358 req_id = fe230e92-d91e-4ce4-afa3-6ba324ff3a9d response_code = 204 uri = /vpc-routes
26452024-11-19T01:40:33.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55336
26462024-11-19T01:40:33.944ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26472024-11-19T01:40:33.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26482024-11-19T01:40:34.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103983 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55336 req_id = 9d2b5754-237e-47c4-8c7a-d283f366fc9e response_code = 204 uri = /switch-ports
26492024-11-19T01:40:34.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38764
26502024-11-19T01:40:34.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34325
26512024-11-19T01:40:34.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26522024-11-19T01:40:34.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55336 req_id = eea476b3-1338-4625-86d5-3610756c2c84 response_code = 200 uri = /network-bootstore-config
26532024-11-19T01:40:34.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4551 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38764 req_id = 9a0bba18-5dfd-49cf-bda7-2eda4a90bad0 response_code = 200 uri = /v2p
26542024-11-19T01:40:34.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26552024-11-19T01:40:34.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34325 req_id = ee453628-68a9-42da-82cd-4afc95b2602a response_code = 204 uri = /switch-ports
26562024-11-19T01:40:34.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34325 req_id = 560fa688-212e-4b3a-bb06-d852919bfb0d response_code = 200 uri = /network-bootstore-config
26572024-11-19T01:40:34.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63865
26582024-11-19T01:40:34.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63865 req_id = 1feeddbb-90dd-48dc-b505-8fd43ec4a319 response_code = 200 uri = /vpc-routes
26592024-11-19T01:40:34.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37068
26602024-11-19T01:40:34.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37068 req_id = b619446c-36dd-42c7-a95a-5dfec689cca8 response_code = 200 uri = /v2p
26612024-11-19T01:40:34.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26622024-11-19T01:40:34.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63865 req_id = 052ba430-435e-4425-9c67-d765fa7b3f27 response_code = 204 uri = /eip-gateways
26632024-11-19T01:40:34.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63865 req_id = eb747e78-76eb-47de-9a27-f4079a790fe1 response_code = 204 uri = /vpc-routes
26642024-11-19T01:40:34.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35503
26652024-11-19T01:40:34.809ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26662024-11-19T01:40:34.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26672024-11-19T01:40:34.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95698 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35503 req_id = bb28f550-406a-4c97-a023-9d940e994cc0 response_code = 204 uri = /switch-ports
26682024-11-19T01:40:34.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35503 req_id = 994f1c51-a9b0-4d36-8e99-4c8dadf9fc71 response_code = 200 uri = /network-bootstore-config
26692024-11-19T01:40:40.432ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26702024-11-19T01:40:40.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26712024-11-19T01:40:40.433ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26722024-11-19T01:40:40.435ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26732024-11-19T01:40:50.180ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60692
26742024-11-19T01:40:50.180ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60692 req_id = 108c7202-aff7-4060-ac35-f72db63e76b3 response_code = 200 uri = /baseboard
26752024-11-19T01:40:50.436ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26762024-11-19T01:40:50.437ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26772024-11-19T01:40:50.438ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26782024-11-19T01:40:50.439ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26792024-11-19T01:41:00.440ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26802024-11-19T01:41:00.441ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26812024-11-19T01:41:00.442ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26822024-11-19T01:41:00.443ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
26832024-11-19T01:41:03.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59193
26842024-11-19T01:41:03.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59193 req_id = 6f967067-ade2-45e0-8651-b9b16d36cf35 response_code = 200 uri = /vpc-routes
26852024-11-19T01:41:03.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45886
26862024-11-19T01:41:03.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45886 req_id = b790b43c-4726-4f86-9442-3892e124511b response_code = 200 uri = /v2p
26872024-11-19T01:41:03.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55970
26882024-11-19T01:41:03.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55970 req_id = aa0f1bee-9bc9-4f1e-83f7-8fcb824984ba response_code = 200 uri = /vpc-routes
26892024-11-19T01:41:03.730ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26902024-11-19T01:41:03.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59193 req_id = 093f8574-39d2-4880-bcc2-b6d7c4ae8aa3 response_code = 204 uri = /eip-gateways
26912024-11-19T01:41:03.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59193 req_id = 04a1b354-f4bf-4199-901f-85d2dfb9fd46 response_code = 204 uri = /vpc-routes
26922024-11-19T01:41:03.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
26932024-11-19T01:41:03.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55970 req_id = c5e688d0-872e-4fcf-aa2c-30185c2f09fd response_code = 204 uri = /eip-gateways
26942024-11-19T01:41:03.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43122
26952024-11-19T01:41:03.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26962024-11-19T01:41:03.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26972024-11-19T01:41:03.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106944 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43122 req_id = b21a085d-9f7a-4a1b-ad75-8c55f7bd701f response_code = 204 uri = /switch-ports
26982024-11-19T01:41:03.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46424
26992024-11-19T01:41:03.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55970 req_id = b5d3dc2c-3677-4f51-98fc-e3abfb0b5a65 response_code = 204 uri = /vpc-routes
27002024-11-19T01:41:03.868ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27012024-11-19T01:41:03.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43122 req_id = 7443e95c-f013-49f8-8906-283fc7f56a81 response_code = 200 uri = /network-bootstore-config
27022024-11-19T01:41:03.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59324
27032024-11-19T01:41:03.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59324 req_id = edcb5ed3-c415-4a7d-944a-d1adb7aceb6e response_code = 200 uri = /v2p
27042024-11-19T01:41:03.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27052024-11-19T01:41:03.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102129 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46424 req_id = c74be4a6-53d4-49a1-a6a8-b22509f5ba1e response_code = 204 uri = /switch-ports
27062024-11-19T01:41:03.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46424 req_id = 0638eae3-dd7a-440c-9f26-d6080715beaa response_code = 200 uri = /network-bootstore-config
27072024-11-19T01:41:04.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35447
27082024-11-19T01:41:04.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35447 req_id = e2340b5d-a404-4eba-b79c-0f44ccb27019 response_code = 200 uri = /vpc-routes
27092024-11-19T01:41:04.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
27102024-11-19T01:41:04.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35447 req_id = c8e3f5bd-6efd-40bc-a82a-81834be5dbf3 response_code = 204 uri = /eip-gateways
27112024-11-19T01:41:04.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38996
27122024-11-19T01:41:04.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38996 req_id = e0897782-35de-4ac4-954a-94294c733d89 response_code = 200 uri = /v2p
27132024-11-19T01:41:04.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35447 req_id = 3103686d-39c9-4ced-9e5c-c6075e76397f response_code = 204 uri = /vpc-routes
27142024-11-19T01:41:04.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46604
27152024-11-19T01:41:04.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27162024-11-19T01:41:04.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27172024-11-19T01:41:04.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90285 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46604 req_id = 925e3257-9ac4-4541-ba4b-75bbdc9433f5 response_code = 204 uri = /switch-ports
27182024-11-19T01:41:04.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46604 req_id = f2d933c7-7e62-4964-b1e0-8aff949fd178 response_code = 200 uri = /network-bootstore-config
27192024-11-19T01:41:10.444ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27202024-11-19T01:41:10.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27212024-11-19T01:41:10.445ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27222024-11-19T01:41:10.447ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27232024-11-19T01:41:20.216ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60349
27242024-11-19T01:41:20.216ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60349 req_id = dd1e619f-d9f8-480f-8f0b-6c1a15aedab0 response_code = 200 uri = /baseboard
27252024-11-19T01:41:20.448ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27262024-11-19T01:41:20.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27272024-11-19T01:41:20.449ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27282024-11-19T01:41:20.451ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27292024-11-19T01:41:30.454ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27302024-11-19T01:41:30.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27312024-11-19T01:41:30.455ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27322024-11-19T01:41:30.457ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27332024-11-19T01:41:33.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61218
27342024-11-19T01:41:33.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61218 req_id = 845b42e5-d184-4075-a68f-7d95a3aff84d response_code = 200 uri = /vpc-routes
27352024-11-19T01:41:33.853ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
27362024-11-19T01:41:33.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61218 req_id = 5417e2b1-b13b-4839-8f8b-70a0e428671c response_code = 204 uri = /eip-gateways
27372024-11-19T01:41:33.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61218 req_id = 1b38b0a7-2aea-44e4-a1df-f8a35560abed response_code = 204 uri = /vpc-routes
27382024-11-19T01:41:33.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55971
27392024-11-19T01:41:33.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55971 req_id = 30ee7582-f5f4-4510-9908-a96e7df522c9 response_code = 200 uri = /vpc-routes
27402024-11-19T01:41:33.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
27412024-11-19T01:41:33.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55971 req_id = 265847f3-db72-45b1-82d2-282bcb1f2e68 response_code = 204 uri = /eip-gateways
27422024-11-19T01:41:33.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40744
27432024-11-19T01:41:33.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40744 req_id = 3eb2fddf-b855-48ed-80f7-178710f67a0b response_code = 200 uri = /v2p
27442024-11-19T01:41:33.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55971 req_id = a13f188a-7c67-4f1e-95b4-e0ab3feeb589 response_code = 204 uri = /vpc-routes
27452024-11-19T01:41:34.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46670
27462024-11-19T01:41:34.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27472024-11-19T01:41:34.052ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27482024-11-19T01:41:34.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46670 req_id = d6164a21-773d-4992-ab44-654cfbcd3561 response_code = 204 uri = /switch-ports
27492024-11-19T01:41:34.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46670 req_id = ebae8b12-9276-4994-a618-f22cb315f293 response_code = 200 uri = /network-bootstore-config
27502024-11-19T01:41:34.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58570
27512024-11-19T01:41:34.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58570 req_id = b7f8e44a-9e69-47b3-8c59-f13ff220845d response_code = 200 uri = /v2p
27522024-11-19T01:41:34.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46418
27532024-11-19T01:41:34.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27542024-11-19T01:41:34.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27552024-11-19T01:41:34.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129107 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46418 req_id = 5ccc37ee-8a1f-47c4-a3f7-ed685972daff response_code = 204 uri = /switch-ports
27562024-11-19T01:41:34.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46418 req_id = 28b87df6-a384-4b26-b43f-ab620be01b6e response_code = 200 uri = /network-bootstore-config
27572024-11-19T01:41:34.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37734
27582024-11-19T01:41:34.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37734 req_id = 89f8263e-9a78-4e75-9f4b-6c8a1cb26728 response_code = 200 uri = /vpc-routes
27592024-11-19T01:41:34.658ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
27602024-11-19T01:41:34.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37734 req_id = 18da8837-9453-4ecd-993e-87da51c2f7b9 response_code = 204 uri = /eip-gateways
27612024-11-19T01:41:34.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37734 req_id = 77bd504c-3103-4157-9767-3d33b6adbfab response_code = 204 uri = /vpc-routes
27622024-11-19T01:41:34.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57062
27632024-11-19T01:41:34.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57062 req_id = e79a4800-c78e-41f1-930e-2afaddd5e65f response_code = 200 uri = /v2p
27642024-11-19T01:41:34.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61892
27652024-11-19T01:41:34.743ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27662024-11-19T01:41:34.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27672024-11-19T01:41:34.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107517 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61892 req_id = 57dda34e-a0dd-4898-8624-c4a729e3375e response_code = 204 uri = /switch-ports
27682024-11-19T01:41:34.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61892 req_id = c61610b5-5556-4017-b9d7-aa7fdb550f9b response_code = 200 uri = /network-bootstore-config
27692024-11-19T01:41:40.458ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27702024-11-19T01:41:40.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27712024-11-19T01:41:40.459ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27722024-11-19T01:41:40.461ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27732024-11-19T01:41:50.257ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42429
27742024-11-19T01:41:50.257ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42429 req_id = 060f5ba2-aa55-4113-a153-d374ff58db95 response_code = 200 uri = /baseboard
27752024-11-19T01:41:50.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27762024-11-19T01:41:50.462ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27772024-11-19T01:41:50.463ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27782024-11-19T01:41:50.464ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27792024-11-19T01:42:00.465ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27802024-11-19T01:42:00.466ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27812024-11-19T01:42:00.467ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27822024-11-19T01:42:00.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
27832024-11-19T01:42:03.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42743
27842024-11-19T01:42:03.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42743 req_id = 0ef197b7-8fe1-4ca5-9edf-b7e52f34c8b4 response_code = 200 uri = /vpc-routes
27852024-11-19T01:42:03.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33776
27862024-11-19T01:42:03.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33776 req_id = 35b99d4d-cbf2-4d20-b1ce-7053e0bd35cf response_code = 200 uri = /vpc-routes
27872024-11-19T01:42:03.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
27882024-11-19T01:42:03.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42743 req_id = c4be3312-585e-4372-bf60-9d2f0ba00971 response_code = 204 uri = /eip-gateways
27892024-11-19T01:42:03.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42743 req_id = 0cd4b7da-9702-4017-9c6d-3e46a584074a response_code = 204 uri = /vpc-routes
27902024-11-19T01:42:03.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44467
27912024-11-19T01:42:03.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44467 req_id = de53fb82-9b76-4d22-adf6-4cafcb1b6053 response_code = 200 uri = /v2p
27922024-11-19T01:42:03.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
27932024-11-19T01:42:03.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33776 req_id = 75469a29-4e99-4c54-856d-1caae9f888e9 response_code = 204 uri = /eip-gateways
27942024-11-19T01:42:03.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33776 req_id = b28da4c2-1c4b-4858-acec-0bcf4dcb10f7 response_code = 204 uri = /vpc-routes
27952024-11-19T01:42:03.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60427
27962024-11-19T01:42:03.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60427 req_id = 93033b91-93c9-4fc3-bf34-ba7f46eff68e response_code = 200 uri = /v2p
27972024-11-19T01:42:03.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44337
27982024-11-19T01:42:03.796ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27992024-11-19T01:42:03.837ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28002024-11-19T01:42:03.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44337 req_id = a0f510c8-67a2-4a74-a52c-17092cf36e76 response_code = 204 uri = /switch-ports
28012024-11-19T01:42:03.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33175
28022024-11-19T01:42:03.899ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28032024-11-19T01:42:03.934ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28042024-11-19T01:42:03.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89469 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33175 req_id = 962fc61d-c76e-4500-9987-bcbdc37aa06f response_code = 204 uri = /switch-ports
28052024-11-19T01:42:03.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44337 req_id = cb910f08-39ac-4ee6-9f4b-0cce41a5da76 response_code = 200 uri = /network-bootstore-config
28062024-11-19T01:42:03.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33175 req_id = d47df49a-e8ab-484c-9642-b19cfd6483a0 response_code = 200 uri = /network-bootstore-config
28072024-11-19T01:42:04.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39420
28082024-11-19T01:42:04.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39420 req_id = 10187aad-d859-4352-98f9-6902ae8e976c response_code = 200 uri = /vpc-routes
28092024-11-19T01:42:04.506ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
28102024-11-19T01:42:04.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39420 req_id = 25327cde-9b60-4b29-a916-58f248c30311 response_code = 204 uri = /eip-gateways
28112024-11-19T01:42:04.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39420 req_id = 1bbdb0c3-08f0-486a-a1ec-8945ab0e50e7 response_code = 204 uri = /vpc-routes
28122024-11-19T01:42:04.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51365
28132024-11-19T01:42:04.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28142024-11-19T01:42:04.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28152024-11-19T01:42:04.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98303 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51365 req_id = 80bc4e35-354a-4aac-86c4-a23737cbbfd8 response_code = 204 uri = /switch-ports
28162024-11-19T01:42:04.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44516
28172024-11-19T01:42:04.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51365 req_id = b63b170d-0867-40e0-8d29-6c48190cc60f response_code = 200 uri = /network-bootstore-config
28182024-11-19T01:42:04.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44516 req_id = a873ad51-c9e2-4873-a4e2-f829e16f0baf response_code = 200 uri = /v2p
28192024-11-19T01:42:10.468ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28202024-11-19T01:42:10.469ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28212024-11-19T01:42:10.470ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28222024-11-19T01:42:10.471ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28232024-11-19T01:42:20.294ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52422
28242024-11-19T01:42:20.294ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52422 req_id = 033c5723-6fb8-4df2-a431-3327a67a73d3 response_code = 200 uri = /baseboard
28252024-11-19T01:42:20.472ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28262024-11-19T01:42:20.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28272024-11-19T01:42:20.473ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28282024-11-19T01:42:20.475ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28292024-11-19T01:42:30.476ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28302024-11-19T01:42:30.477ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28312024-11-19T01:42:30.478ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28322024-11-19T01:42:30.479ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
28332024-11-19T01:42:33.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65109
28342024-11-19T01:42:33.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65109 req_id = 82842072-d625-45cb-a20a-edda85d5ea84 response_code = 200 uri = /vpc-routes
28352024-11-19T01:42:33.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
28362024-11-19T01:42:33.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65109 req_id = 8ebae207-45d2-4637-afd5-36d62d35af0b response_code = 204 uri = /eip-gateways
28372024-11-19T01:42:33.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65109 req_id = 4171d7ce-087f-4b10-b66c-876a4a12ef16 response_code = 204 uri = /vpc-routes
28382024-11-19T01:42:33.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55301
28392024-11-19T01:42:33.944ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28402024-11-19T01:42:33.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28412024-11-19T01:42:34.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111248 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55301 req_id = 3534a254-6d08-46ee-b530-eb11e114ce1c response_code = 204 uri = /switch-ports
28422024-11-19T01:42:34.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42037
28432024-11-19T01:42:34.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55845
28442024-11-19T01:42:34.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58695
28452024-11-19T01:42:34.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46379
28462024-11-19T01:42:34.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55301 req_id = 97691640-9f0d-4274-a84f-c8000a452df7 response_code = 200 uri = /network-bootstore-config
28472024-11-19T01:42:34.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28482024-11-19T01:42:34.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42037 req_id = c50426e1-d32f-42cb-aaf3-049b9b0d2e4c response_code = 200 uri = /vpc-routes
28492024-11-19T01:42:34.062ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28502024-11-19T01:42:34.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5999 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55845 req_id = 44407fca-08a0-49bc-8213-ba7abb839ba4 response_code = 200 uri = /v2p
28512024-11-19T01:42:34.062ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28522024-11-19T01:42:34.062ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
28532024-11-19T01:42:34.064ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
28542024-11-19T01:42:34.082ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28552024-11-19T01:42:34.082ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
28562024-11-19T01:42:34.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28572024-11-19T01:42:34.115ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28582024-11-19T01:42:34.115ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
28592024-11-19T01:42:34.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
28602024-11-19T01:42:34.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 614 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42037 req_id = 9a689b52-ff9f-4812-9004-7f601efc1de9 response_code = 204 uri = /eip-gateways
28612024-11-19T01:42:34.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 927 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42037 req_id = 22b4246a-aee9-4805-bbbd-588737c239d3 response_code = 204 uri = /vpc-routes
28622024-11-19T01:42:34.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632024-11-19T01:42:34.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
28642024-11-19T01:42:34.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-19T01:42:34.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
28662024-11-19T01:42:34.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 174beaa1-2d74-484f-b205-3fb5cd08e36f response_code = 204 uri = /switch-ports
28672024-11-19T01:42:34.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 2cd83408-9c46-4d34-9d34-6e1f144792f9 response_code = 200 uri = /network-bootstore-config
28682024-11-19T01:42:34.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51957
28692024-11-19T01:42:34.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51957 req_id = 269d127a-ddcc-47d3-8b33-41e8d707cb77 response_code = 200 uri = /v2p
28702024-11-19T01:42:34.201ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28712024-11-19T01:42:34.201ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
28722024-11-19T01:42:34.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49735
28732024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28742024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28752024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28762024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28772024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28782024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28792024-11-19T01:42:34.213ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28802024-11-19T01:42:34.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49735 req_id = 9ccefe08-a930-4686-b458-a068a6166b64 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28812024-11-19T01:42:34.228ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28822024-11-19T01:42:34.228ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
28832024-11-19T01:42:34.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28842024-11-19T01:42:34.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
28852024-11-19T01:42:34.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28862024-11-19T01:42:34.312ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
28872024-11-19T01:42:34.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52373
28882024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28892024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28902024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28912024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28922024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28932024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28942024-11-19T01:42:34.340ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28952024-11-19T01:42:34.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1003 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52373 req_id = 46fbde14-3a63-4fa5-9355-5ff3bf59b1b2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28962024-11-19T01:42:34.352ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28972024-11-19T01:42:34.352ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
28982024-11-19T01:42:34.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58695 req_id = 96f273ae-033c-404e-8baf-888e8b5431f8 response_code = 200 uri = /inventory
28992024-11-19T01:42:34.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59609
29002024-11-19T01:42:34.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59609 req_id = 98aa8ea5-30d8-417c-8b61-f7af808950c4 response_code = 200 uri = /vpc-routes
29012024-11-19T01:42:34.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
29022024-11-19T01:42:34.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59609 req_id = ee319095-f913-4746-bf84-97771da2d87a response_code = 204 uri = /eip-gateways
29032024-11-19T01:42:34.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59609 req_id = e25f0917-d711-4454-9b9b-9c64beaed446 response_code = 204 uri = /vpc-routes
29042024-11-19T01:42:34.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44268
29052024-11-19T01:42:34.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29062024-11-19T01:42:34.809ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29072024-11-19T01:42:34.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44268 req_id = 08550a8d-9b19-45f7-8794-eb0ca8ec08b7 response_code = 204 uri = /switch-ports
29082024-11-19T01:42:34.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34708
29092024-11-19T01:42:34.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64609
29102024-11-19T01:42:34.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44268 req_id = ddeec5f9-4046-4b79-9a37-a2359524f87f response_code = 200 uri = /network-bootstore-config
29112024-11-19T01:42:34.869ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29122024-11-19T01:42:34.869ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29132024-11-19T01:42:34.869ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
29142024-11-19T01:42:34.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34708 req_id = b53f1385-b79f-422c-9026-9389622c2dfd response_code = 200 uri = /v2p
29152024-11-19T01:42:34.869ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
29162024-11-19T01:42:34.883ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29172024-11-19T01:42:34.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
29182024-11-19T01:42:34.911ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29192024-11-19T01:42:34.911ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
29202024-11-19T01:42:34.937ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29212024-11-19T01:42:34.937ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
29222024-11-19T01:42:34.962ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29232024-11-19T01:42:34.962ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
29242024-11-19T01:42:34.984ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29252024-11-19T01:42:34.984ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
29262024-11-19T01:42:35.005ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29272024-11-19T01:42:35.005ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
29282024-11-19T01:42:35.034ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29292024-11-19T01:42:35.034ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
29302024-11-19T01:42:35.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56254
29312024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3ac0dcee-f159-48e6-bdef-a603be0719fd, kind: Service { id: a97a9e1e-ade8-4d48-bc64-1b5a63e68b91 }, name: Name("external-dns-a97a9e1e-ade8-4d48-bc64-1b5a63e68b91"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 152, 223])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 830fafc3-9abd-43ea-95d4-d8bc4033ddcc, kind: Service { id: 52e4d19a-b928-4138-8817-4fd8deeaf29e }, name: Name("external-dns-52e4d19a-b928-4138-8817-4fd8deeaf29e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 238])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6a0f8dba-9921-47cc-b46d-9464f538b1b5, kind: Service { id: 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b }, name: Name("nexus-7dcf0d8a-40d8-45f8-a6f1-d545f08c056b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 211])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9357d91c-cd60-4b75-8301-39bad393d1d3, kind: Service { id: 13c22fb6-5873-4940-9848-cc9130b7aa73 }, name: Name("nexus-13c22fb6-5873-4940-9848-cc9130b7aa73"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 183, 90])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b12f392c-1b48-41cc-89b1-c909b6177044, kind: Service { id: d9867752-e046-43b5-9e2e-9abcfe9a206e }, name: Name("nexus-d9867752-e046-43b5-9e2e-9abcfe9a206e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29322024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
29332024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29342024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29352024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29362024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29372024-11-19T01:42:35.040ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29382024-11-19T01:42:35.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56254 req_id = ed0a816d-5767-4f26-8bc6-0b6107cff908 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29392024-11-19T01:42:35.061ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29402024-11-19T01:42:35.061ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
29412024-11-19T01:42:35.086ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29422024-11-19T01:42:35.086ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
29432024-11-19T01:42:35.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64609 req_id = 3f127021-385d-41ad-8989-3274d448d687 response_code = 200 uri = /inventory
29442024-11-19T01:42:35.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63273
29452024-11-19T01:42:35.904ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29462024-11-19T01:42:35.904ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29472024-11-19T01:42:35.905ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/config/omicron-zones.json file = common/src/ledger.rs:177
29482024-11-19T01:42:35.905ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/config/omicron-zones.json file = common/src/ledger.rs:177
29492024-11-19T01:42:35.919ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 516208ff-c30f-4aff-8e5a-1912725b8a19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29502024-11-19T01:42:35.919ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_516208ff-c30f-4aff-8e5a-1912725b8a19
29512024-11-19T01:42:35.945ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2e39c5a-b408-452c-b8ff-191a8b0dc4f1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29522024-11-19T01:42:35.945ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2e39c5a-b408-452c-b8ff-191a8b0dc4f1
29532024-11-19T01:42:35.969ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fa04c6c-d192-4c25-b90b-3fb4b3280fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29542024-11-19T01:42:35.969ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fa04c6c-d192-4c25-b90b-3fb4b3280fe8
29552024-11-19T01:42:35.992ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29562024-11-19T01:42:35.993ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c
29572024-11-19T01:42:36.015ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4db3afbb-2372-4910-937c-04a030c788e8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29582024-11-19T01:42:36.015ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4db3afbb-2372-4910-937c-04a030c788e8
29592024-11-19T01:42:36.036ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 76d71a82-bade-4cd6-841f-df791cc1a175 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29602024-11-19T01:42:36.036ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_76d71a82-bade-4cd6-841f-df791cc1a175
29612024-11-19T01:42:36.058ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ab199b91-015a-4655-9e04-9df66d150eb1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29622024-11-19T01:42:36.058ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ab199b91-015a-4655-9e04-9df66d150eb1
29632024-11-19T01:42:36.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e2481975-3977-496e-a270-5d45680952af (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29642024-11-19T01:42:36.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e2481975-3977-496e-a270-5d45680952af
29652024-11-19T01:42:36.105ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2452b1fe-5c19-4c98-b1e3-6366a190c63e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29662024-11-19T01:42:36.105ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_2452b1fe-5c19-4c98-b1e3-6366a190c63e
29672024-11-19T01:42:36.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213828 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63273 req_id = 28eef99f-f5cb-4acb-b24a-dfa7d39b2952 response_code = 200 uri = /inventory
29682024-11-19T01:42:40.483ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29692024-11-19T01:42:40.484ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29702024-11-19T01:42:40.485ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29712024-11-19T01:42:40.486ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29722024-11-19T01:42:50.332ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64395
29732024-11-19T01:42:50.332ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64395 req_id = af520a43-302a-4abb-8151-bac01329e37f response_code = 200 uri = /baseboard
29742024-11-19T01:42:50.487ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29752024-11-19T01:42:50.488ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29762024-11-19T01:42:50.489ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29772024-11-19T01:42:50.490ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29782024-11-19T01:43:00.491ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29792024-11-19T01:43:00.492ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29802024-11-19T01:43:00.493ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29812024-11-19T01:43:00.494ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
29822024-11-19T01:43:03.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45990
29832024-11-19T01:43:03.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45990 req_id = 8b76f160-dd44-4fac-aa8f-51e0a8510798 response_code = 200 uri = /vpc-routes
29842024-11-19T01:43:03.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54464
29852024-11-19T01:43:03.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54464 req_id = 733d88b4-572f-4ca9-8d65-60dbeffdcc61 response_code = 200 uri = /vpc-routes
29862024-11-19T01:43:03.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
29872024-11-19T01:43:03.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45990 req_id = af8c1d0e-4d39-41e1-aa83-c61652032252 response_code = 204 uri = /eip-gateways
29882024-11-19T01:43:03.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45990 req_id = 2db5f064-2f64-422f-b089-e14183064dc0 response_code = 204 uri = /vpc-routes
29892024-11-19T01:43:03.767ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
29902024-11-19T01:43:03.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54464 req_id = 1a6ae606-b05e-4d3e-973e-14e32503b2fd response_code = 204 uri = /eip-gateways
29912024-11-19T01:43:03.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54464 req_id = 3f94107b-5ccb-410e-938d-627902d164f9 response_code = 204 uri = /vpc-routes
29922024-11-19T01:43:03.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39054
29932024-11-19T01:43:03.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29942024-11-19T01:43:03.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29952024-11-19T01:43:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39054 req_id = 0aac6fd3-9cc7-4dc8-8d88-c0c0bd18d578 response_code = 204 uri = /switch-ports
29962024-11-19T01:43:03.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48149
29972024-11-19T01:43:03.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42275
29982024-11-19T01:43:03.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59637
29992024-11-19T01:43:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39054 req_id = e1cc66bd-1e2f-4afa-8bb3-1e921fe27d1d response_code = 200 uri = /network-bootstore-config
30002024-11-19T01:43:03.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59637 req_id = 7f31657b-814d-4136-a132-d41052453541 response_code = 200 uri = /v2p
30012024-11-19T01:43:03.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30022024-11-19T01:43:03.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48149 req_id = fdc06208-38ed-44e2-8ddc-ab355c6c409c response_code = 200 uri = /v2p
30032024-11-19T01:43:03.976ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30042024-11-19T01:43:04.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95196 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42275 req_id = 107e2c41-6397-466d-accb-af55222db105 response_code = 204 uri = /switch-ports
30052024-11-19T01:43:04.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42275 req_id = dc3cd352-0973-4278-ad60-15476a8d45f4 response_code = 200 uri = /network-bootstore-config
30062024-11-19T01:43:04.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62479
30072024-11-19T01:43:04.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62479 req_id = ebb4f0ca-98e7-42b9-858d-f4803132456d response_code = 200 uri = /vpc-routes
30082024-11-19T01:43:04.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
30092024-11-19T01:43:04.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62479 req_id = 9ec56443-fc9c-42e0-b84e-47c0e8614709 response_code = 204 uri = /eip-gateways
30102024-11-19T01:43:04.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62479 req_id = cd6d1ae1-0d6c-48da-a1fe-e7ec6283fd9d response_code = 204 uri = /vpc-routes
30112024-11-19T01:43:04.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32928
30122024-11-19T01:43:04.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30132024-11-19T01:43:04.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30142024-11-19T01:43:04.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32928 req_id = 294524b8-29e0-4b61-a6df-8aef531a923a response_code = 204 uri = /switch-ports
30152024-11-19T01:43:04.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33385
30162024-11-19T01:43:04.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32928 req_id = 54eaa60b-879d-4813-8bcb-981ca63a2fe8 response_code = 200 uri = /network-bootstore-config
30172024-11-19T01:43:04.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33385 req_id = 6098e18d-c208-4141-9b51-f744daa34608 response_code = 200 uri = /v2p
30182024-11-19T01:43:10.495ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30192024-11-19T01:43:10.496ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30202024-11-19T01:43:10.497ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30212024-11-19T01:43:10.498ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30222024-11-19T01:43:20.367ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52313
30232024-11-19T01:43:20.367ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52313 req_id = d3dd4a58-e6c0-42ad-9a90-af1632122b97 response_code = 200 uri = /baseboard
30242024-11-19T01:43:20.499ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30252024-11-19T01:43:20.500ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30262024-11-19T01:43:20.501ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30272024-11-19T01:43:20.502ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30282024-11-19T01:43:30.503ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30292024-11-19T01:43:30.504ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30302024-11-19T01:43:30.505ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30312024-11-19T01:43:30.506ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30322024-11-19T01:43:33.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47356
30332024-11-19T01:43:33.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47356 req_id = 05a8839c-99b9-4505-af49-9fd18011fe25 response_code = 200 uri = /vpc-routes
30342024-11-19T01:43:33.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
30352024-11-19T01:43:33.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47356 req_id = 18607ef1-0f06-40cc-ae15-3f290fed302c response_code = 204 uri = /eip-gateways
30362024-11-19T01:43:33.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55534
30372024-11-19T01:43:33.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55534 req_id = 5d1569d1-a095-44fb-9bff-a8ee2edfc549 response_code = 200 uri = /vpc-routes
30382024-11-19T01:43:33.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51365
30392024-11-19T01:43:33.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51365 req_id = 87f3ecb1-6e5b-4534-9347-19435d2ed0ec response_code = 200 uri = /v2p
30402024-11-19T01:43:33.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47356 req_id = 9d4be8e7-b414-47d9-a30d-7f0678c895a7 response_code = 204 uri = /vpc-routes
30412024-11-19T01:43:33.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
30422024-11-19T01:43:33.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55534 req_id = 702435a5-0ac4-4d0a-99f0-19c5348c73e4 response_code = 204 uri = /eip-gateways
30432024-11-19T01:43:33.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55534 req_id = faf9df06-8455-4b37-8c64-9ba46125e283 response_code = 204 uri = /vpc-routes
30442024-11-19T01:43:34.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60637
30452024-11-19T01:43:34.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60637 req_id = 6cca954c-c737-4cf7-adc5-9efaf85cb3de response_code = 200 uri = /v2p
30462024-11-19T01:43:34.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59502
30472024-11-19T01:43:34.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30482024-11-19T01:43:34.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30492024-11-19T01:43:34.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59502 req_id = bc64f697-a3e4-41cf-a521-3c6864e9ac3f response_code = 204 uri = /switch-ports
30502024-11-19T01:43:34.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47245
30512024-11-19T01:43:34.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30522024-11-19T01:43:34.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59502 req_id = 7182b7e1-437d-49da-a962-a94c71c31a6a response_code = 200 uri = /network-bootstore-config
30532024-11-19T01:43:34.187ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30542024-11-19T01:43:34.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94961 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47245 req_id = 656c5b01-ea7d-4855-b746-5f3bde23780d response_code = 204 uri = /switch-ports
30552024-11-19T01:43:34.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47245 req_id = 7bf32c9e-fe7e-47d4-9727-e936d85ce473 response_code = 200 uri = /network-bootstore-config
30562024-11-19T01:43:34.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48578
30572024-11-19T01:43:34.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48578 req_id = cc87ef57-b541-423e-b823-2e7f2ca9edbe response_code = 200 uri = /vpc-routes
30582024-11-19T01:43:34.750ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
30592024-11-19T01:43:34.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48578 req_id = b3f5ed6d-6ec9-4011-9563-563f1ae8ef1c response_code = 204 uri = /eip-gateways
30602024-11-19T01:43:34.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50654
30612024-11-19T01:43:34.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50654 req_id = c0cfaaf4-efa0-4e50-a0d0-e67e2f0b40e9 response_code = 200 uri = /v2p
30622024-11-19T01:43:34.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48578 req_id = e13ebbd7-1420-488f-9db3-42883f20f2d5 response_code = 204 uri = /vpc-routes
30632024-11-19T01:43:35.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60914
30642024-11-19T01:43:35.014ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30652024-11-19T01:43:35.057ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30662024-11-19T01:43:35.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60914 req_id = d7856459-a269-4a2b-999c-fbbf6328dfec response_code = 204 uri = /switch-ports
30672024-11-19T01:43:35.117ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30682024-11-19T01:43:35.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60914 req_id = 92a0eff5-c0a6-4988-ae4b-deb6a3fa1d04 response_code = 200 uri = /network-bootstore-config
30692024-11-19T01:43:40.507ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30702024-11-19T01:43:40.508ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30712024-11-19T01:43:40.509ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30722024-11-19T01:43:40.510ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30732024-11-19T01:43:50.404ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53355
30742024-11-19T01:43:50.405ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53355 req_id = ea8f275e-5486-48bc-9978-115ff965fac0 response_code = 200 uri = /baseboard
30752024-11-19T01:43:50.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30762024-11-19T01:43:50.513ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30772024-11-19T01:43:50.514ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30782024-11-19T01:43:50.515ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30792024-11-19T01:44:00.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30802024-11-19T01:44:00.518ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30812024-11-19T01:44:00.519ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30822024-11-19T01:44:00.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
30832024-11-19T01:44:03.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58944
30842024-11-19T01:44:03.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58944 req_id = fc565f01-c39b-41d8-8576-c3ccce0da889 response_code = 200 uri = /vpc-routes
30852024-11-19T01:44:03.736ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
30862024-11-19T01:44:03.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58944 req_id = bb9910ae-3d07-46ba-a61b-3664a0631f54 response_code = 204 uri = /eip-gateways
30872024-11-19T01:44:03.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58944 req_id = aec49ac1-7e59-4b6a-8997-f479e1a070da response_code = 204 uri = /vpc-routes
30882024-11-19T01:44:03.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46001
30892024-11-19T01:44:03.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46001 req_id = 48f7ffc5-3777-4ae8-8f45-410dd2b3111a response_code = 200 uri = /vpc-routes
30902024-11-19T01:44:03.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
30912024-11-19T01:44:03.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46001 req_id = 68f54433-b52c-4518-b7f5-0fd78001ee4d response_code = 204 uri = /eip-gateways
30922024-11-19T01:44:03.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46001 req_id = 70463b80-17bb-4a26-af27-ffc25986f97e response_code = 204 uri = /vpc-routes
30932024-11-19T01:44:03.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58054
30942024-11-19T01:44:03.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30952024-11-19T01:44:03.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30962024-11-19T01:44:03.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105378 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58054 req_id = d548c5ec-0816-47e2-8a51-fefafefe5e1c response_code = 204 uri = /switch-ports
30972024-11-19T01:44:03.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55502
30982024-11-19T01:44:03.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54395
30992024-11-19T01:44:03.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42693
31002024-11-19T01:44:03.903ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31012024-11-19T01:44:03.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4768 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58054 req_id = 4ed7d09c-4363-4ebe-9873-9f06dd347fcb response_code = 200 uri = /network-bootstore-config
31022024-11-19T01:44:03.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5057 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55502 req_id = 629c2f26-20d4-465e-ae41-bdea19b2f2ea response_code = 200 uri = /v2p
31032024-11-19T01:44:03.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5029 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54395 req_id = bbfd7ead-7892-42b1-b574-f2849032ff44 response_code = 200 uri = /v2p
31042024-11-19T01:44:03.939ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31052024-11-19T01:44:03.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93945 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42693 req_id = 1bf91172-564b-4e45-98df-dc0eb703d8b4 response_code = 204 uri = /switch-ports
31062024-11-19T01:44:03.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42693 req_id = 6a062c66-bc38-4820-9576-b961ad04df8b response_code = 200 uri = /network-bootstore-config
31072024-11-19T01:44:04.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51523
31082024-11-19T01:44:04.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51523 req_id = 566908db-5ee6-4046-94c8-4f0438791c78 response_code = 200 uri = /vpc-routes
31092024-11-19T01:44:04.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
31102024-11-19T01:44:04.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51523 req_id = 8cd186cc-cb7d-4d6c-a526-7b4e1bb7adf0 response_code = 204 uri = /eip-gateways
31112024-11-19T01:44:04.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51523 req_id = 18dfde0e-a815-4103-b64c-3c07c42f2d58 response_code = 204 uri = /vpc-routes
31122024-11-19T01:44:04.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53134
31132024-11-19T01:44:04.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53134 req_id = b50fe212-8016-482f-b6af-f81bb5de45c1 response_code = 200 uri = /v2p
31142024-11-19T01:44:04.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45139
31152024-11-19T01:44:04.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31162024-11-19T01:44:04.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31172024-11-19T01:44:04.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45139 req_id = f30e4e6c-309e-4f34-95a6-c67cb2cf4927 response_code = 204 uri = /switch-ports
31182024-11-19T01:44:04.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45139 req_id = 0b3d6d72-2523-413a-a787-49c08f5bc395 response_code = 200 uri = /network-bootstore-config
31192024-11-19T01:44:10.520ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31202024-11-19T01:44:10.521ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31212024-11-19T01:44:10.522ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31222024-11-19T01:44:10.523ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31232024-11-19T01:44:20.441ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56582
31242024-11-19T01:44:20.441ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56582 req_id = d5f00b14-9980-4d55-aea6-ac861ac2ba23 response_code = 200 uri = /baseboard
31252024-11-19T01:44:20.524ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31262024-11-19T01:44:20.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31272024-11-19T01:44:20.525ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31282024-11-19T01:44:20.527ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31292024-11-19T01:44:30.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31302024-11-19T01:44:30.528ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31312024-11-19T01:44:30.529ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31322024-11-19T01:44:30.530ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31332024-11-19T01:44:33.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35776
31342024-11-19T01:44:33.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35776 req_id = cedf2284-d1e2-44a3-b255-5cfd75cb2760 response_code = 200 uri = /vpc-routes
31352024-11-19T01:44:33.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
31362024-11-19T01:44:33.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35776 req_id = e9a7bf80-87f2-42fe-9000-1fa713e876ff response_code = 204 uri = /eip-gateways
31372024-11-19T01:44:33.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35776 req_id = f40990b0-3f82-42ed-9b9c-2b1c23739661 response_code = 204 uri = /vpc-routes
31382024-11-19T01:44:33.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51124
31392024-11-19T01:44:33.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51124 req_id = afe5d014-f418-404c-a695-7e8cf5348d15 response_code = 200 uri = /vpc-routes
31402024-11-19T01:44:33.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
31412024-11-19T01:44:33.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51124 req_id = fca75f2f-900a-494c-ac61-ae38264a73ec response_code = 204 uri = /eip-gateways
31422024-11-19T01:44:33.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51124 req_id = 874dc5e3-6259-44b6-a8b3-e49211487103 response_code = 204 uri = /vpc-routes
31432024-11-19T01:44:33.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44308
31442024-11-19T01:44:33.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44308 req_id = 0c311387-873a-42b4-acd2-dd761b1749c3 response_code = 200 uri = /v2p
31452024-11-19T01:44:33.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33267
31462024-11-19T01:44:33.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31472024-11-19T01:44:34.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31482024-11-19T01:44:34.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33267 req_id = 2f705315-a618-4952-b31e-f4e9011d8bac response_code = 204 uri = /switch-ports
31492024-11-19T01:44:34.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63863
31502024-11-19T01:44:34.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33267 req_id = 2e2e05e0-29f0-44e9-91cf-33321dbde7c6 response_code = 200 uri = /network-bootstore-config
31512024-11-19T01:44:34.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63863 req_id = a433e405-27c7-41a0-9a66-b13aeece8c7c response_code = 200 uri = /v2p
31522024-11-19T01:44:34.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65338
31532024-11-19T01:44:34.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31542024-11-19T01:44:34.140ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31552024-11-19T01:44:34.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65338 req_id = 5511cd0d-6767-4598-ba48-a7622e909b3d response_code = 204 uri = /switch-ports
31562024-11-19T01:44:34.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65338 req_id = af4d6085-8f5b-479c-8475-8e2fdae19360 response_code = 200 uri = /network-bootstore-config
31572024-11-19T01:44:34.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46758
31582024-11-19T01:44:34.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46758 req_id = 5a1c3c60-2d6a-4363-a3fe-ec521a388826 response_code = 200 uri = /vpc-routes
31592024-11-19T01:44:34.541ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
31602024-11-19T01:44:34.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46758 req_id = 3b5d0f3a-a89a-498c-a356-4010717c7fd1 response_code = 204 uri = /eip-gateways
31612024-11-19T01:44:34.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46758 req_id = 91bbc133-9dcb-4af9-8f4e-9d8e0b595fda response_code = 204 uri = /vpc-routes
31622024-11-19T01:44:34.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54808
31632024-11-19T01:44:34.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54808 req_id = c4788821-4103-4d1e-a432-6c72714d2af5 response_code = 200 uri = /v2p
31642024-11-19T01:44:34.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37426
31652024-11-19T01:44:34.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31662024-11-19T01:44:34.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31672024-11-19T01:44:35.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37426 req_id = 82e3b189-fffa-4f9c-a35a-f9b25370c23b response_code = 204 uri = /switch-ports
31682024-11-19T01:44:35.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37426 req_id = b550b15e-7462-4678-926c-aab3c7afa2ff response_code = 200 uri = /network-bootstore-config
31692024-11-19T01:44:40.531ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31702024-11-19T01:44:40.532ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31712024-11-19T01:44:40.533ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31722024-11-19T01:44:40.534ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
31732024-11-19T01:44:45.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52001
31742024-11-19T01:44:45.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52001 req_id = c9d179ad-bd28-412c-b0b5-03102b3aacb1 response_code = 200 uri = /v2p
31752024-11-19T01:44:45.256ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10299830) }
31762024-11-19T01:44:45.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52001 req_id = e0ab479a-9d78-4a5a-814e-51ecc7430c8e response_code = 204 uri = /v2p
31772024-11-19T01:44:45.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37673
31782024-11-19T01:44:45.266ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10299830))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-9569d826487", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 86a86001-384a-4275-bd9e-a066e76750a7, read_only_parent: Some(Volume { block_size: 512, id: 09851437-1612-4ad3-908b-23d56f94c67e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e2caeb28-ff45-441e-9772-bb6050fb3fc6, key: Some("EbQzixNkVawf9MmZNqMHMo6QkxYkiZWJEBXga2pC5No="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::19]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 86a86001-384a-4275-bd9e-a066e76750a7, key: Some("HCmRHX/+XfSn97L3Z6pO6DORVQaUGu9xuOAwTsh/r6w="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::14]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-9569d826487" }] }), cloud_init_bytes: Some(..) } instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a metadata = InstanceMetadata { silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, project_id: 43ed357a-1904-4080-ab4e-07192398e688 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T01:44:45.262416732Z }
31792024-11-19T01:44:45.266ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a migration_id = None propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
31802024-11-19T01:44:45.266ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a migration_id = None propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10299830))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bf5f9af-1594-4e08-8b77-efe08afaca00, kind: Instance { id: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10299830), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-9569d826487", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 86a86001-384a-4275-bd9e-a066e76750a7, read_only_parent: Some(Volume { block_size: 512, id: 09851437-1612-4ad3-908b-23d56f94c67e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e2caeb28-ff45-441e-9772-bb6050fb3fc6, key: Some("EbQzixNkVawf9MmZNqMHMo6QkxYkiZWJEBXga2pC5No="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::19]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 86a86001-384a-4275-bd9e-a066e76750a7, key: Some("HCmRHX/+XfSn97L3Z6pO6DORVQaUGu9xuOAwTsh/r6w="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19003", "[fd00:1122:3344:101::14]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-9569d826487" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-19T01:44:45.262416732Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
31812024-11-19T01:44:45.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4074 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37673 req_id = 0eef9881-c9dd-4a47-bec8-2ddb56504d9a response_code = 200 uri = /vmms/f29067fd-e978-4a5d-8f3c-f6f062710092
31822024-11-19T01:44:45.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59484
31832024-11-19T01:44:45.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1700 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59484 req_id = 37f484b9-4018-4677-85c9-050fde0a4f04 response_code = 200 uri = /vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
31842024-11-19T01:44:45.352ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10299830 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
31852024-11-19T01:44:45.352ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
31862024-11-19T01:44:45.396ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092 file = illumos-utils/src/zone.rs:325 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
31872024-11-19T01:44:45.420ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092 file = illumos-utils/src/zone.rs:363 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
31882024-11-19T01:44:45.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47150
31892024-11-19T01:44:45.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47150 req_id = bc9f1e48-d0da-47a4-8544-53386d528662 response_code = 200 uri = /vpc-routes
31902024-11-19T01:44:45.451ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {1bf5f9af-1594-4e08-8b77-efe08afaca00: {10.151.1.176: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}, 10.151.1.175: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}}} }
31912024-11-19T01:44:46.660ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
31922024-11-19T01:44:46.660ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31932024-11-19T01:44:46.875ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 32.317447ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31942024-11-19T01:44:46.922ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 92.735642ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31952024-11-19T01:44:47.035ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 156.128174ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31962024-11-19T01:44:47.207ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 336.672968ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31972024-11-19T01:44:47.562ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 777.084674ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31982024-11-19T01:44:48.358ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 984.46453ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
31992024-11-19T01:44:49.355ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 1.445834386s file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
32002024-11-19T01:44:50.474ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62166
32012024-11-19T01:44:50.474ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62166 req_id = 96c6377e-cd1a-4c67-81c9-c7a9bd8d157a response_code = 200 uri = /baseboard
32022024-11-19T01:44:50.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32032024-11-19T01:44:50.535ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32042024-11-19T01:44:50.536ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32052024-11-19T01:44:50.537ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32062024-11-19T01:44:50.815ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 586.958013ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
32072024-11-19T01:44:51.416ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 671.268894ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 zone = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
32082024-11-19T01:44:52.124ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092 file = sled-agent/src/instance.rs:1787 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32092024-11-19T01:44:52.134ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 72.120081ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32102024-11-19T01:44:52.218ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092") failed: Property not found. retry in 122.939709ms file = illumos-utils/src/svc.rs:36 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32112024-11-19T01:44:52.354ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32122024-11-19T01:44:52.390ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32132024-11-19T01:44:52.528ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32142024-11-19T01:44:52.530ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32152024-11-19T01:44:52.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7078633 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47150 req_id = c287c99c-0380-4bef-8b9f-50d844b269e9 response_code = 204 uri = /eip-gateways
32162024-11-19T01:44:52.530ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-19T01:44:52.530158223Z } file = sled-agent/src/instance.rs:780 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32172024-11-19T01:44:52.530ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T01:44:52.530158223Z } propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32182024-11-19T01:44:52.531ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-19T01:44:52.530158223Z }, migration_in: None, migration_out: None }
32192024-11-19T01:44:52.578ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-19T01:44:52.578035299Z } file = sled-agent/src/instance.rs:780 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32202024-11-19T01:44:52.578ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T01:44:52.578035299Z } propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32212024-11-19T01:44:52.578ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-19T01:44:52.578035299Z }, migration_in: None, migration_out: None }
32222024-11-19T01:44:52.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47150 req_id = 1fc15fd1-92da-4863-b336-e3af97b03cb2 response_code = 204 uri = /vpc-routes
32232024-11-19T01:45:00.539ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32242024-11-19T01:45:00.540ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32252024-11-19T01:45:00.541ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32262024-11-19T01:45:00.543ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32272024-11-19T01:45:02.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53969
32282024-11-19T01:45:02.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53969 req_id = 1903123e-971e-43b7-abbb-65860501c6ed response_code = 200 uri = /vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
32292024-11-19T01:45:02.979ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-19T01:45:02.979423216Z } file = sled-agent/src/instance.rs:780 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32302024-11-19T01:45:02.979ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T01:45:02.979423216Z } propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32312024-11-19T01:45:02.979ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-19T01:45:02.979423216Z }, migration_in: None, migration_out: None }
32322024-11-19T01:45:02.994ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-19T01:45:02.994267862Z } file = sled-agent/src/instance.rs:780 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32332024-11-19T01:45:02.994ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-19T01:45:02.994267862Z } propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32342024-11-19T01:45:02.994ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32352024-11-19T01:45:02.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32362024-11-19T01:45:02.994ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 345979830078206649 n_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32372024-11-19T01:45:02.994ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10111901319115890161 n_samples = 6 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32382024-11-19T01:45:02.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
32392024-11-19T01:45:02.994ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/5c454e00-8a58-4633-b736-9493cda9d7a0/debug/bundle/zone", "/pool/int/d5fbaf8a-2201-4229-ba29-5652e47649ac/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/516208ff-c30f-4aff-8e5a-1912725b8a19/crypt/debug", "/pool/ext/b2e39c5a-b408-452c-b8ff-191a8b0dc4f1/crypt/debug", "/pool/ext/7fa04c6c-d192-4c25-b90b-3fb4b3280fe8/crypt/debug", "/pool/ext/b2a8f3fc-13e9-4ccd-afb7-34b48f0a3b1c/crypt/debug", "/pool/ext/4db3afbb-2372-4910-937c-04a030c788e8/crypt/debug", "/pool/ext/76d71a82-bade-4cd6-841f-df791cc1a175/crypt/debug", "/pool/ext/ab199b91-015a-4655-9e04-9df66d150eb1/crypt/debug", "/pool/ext/e2481975-3977-496e-a270-5d45680952af/crypt/debug", "/pool/ext/2452b1fe-5c19-4c98-b1e3-6366a190c63e/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092
32402024-11-19T01:45:03.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33083
32412024-11-19T01:45:03.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33083 req_id = 2d4d3246-b712-4966-9693-286b429b4b4a response_code = 200 uri = /vpc-routes
32422024-11-19T01:45:03.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52505
32432024-11-19T01:45:03.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36883
32442024-11-19T01:45:03.693ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092", bundle_id: a595b281-9af9-4be8-b7cd-6a3ff0496d54 }, time_created: 2024-11-19T01:45:02.995512574Z, version: 0, cause: TerminatedInstance }
32452024-11-19T01:45:03.693ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_f29067fd-e978-4a5d-8f3c-f6f062710092 file = sled-agent/src/instance.rs:1032 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32462024-11-19T01:45:03.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {1bf5f9af-1594-4e08-8b77-efe08afaca00: {10.151.1.176: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}, 10.151.1.175: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}}} }
32472024-11-19T01:45:03.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33083 req_id = 6632b3a0-9b28-4634-a7b9-2e0d9073604a response_code = 204 uri = /eip-gateways
32482024-11-19T01:45:03.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52318
32492024-11-19T01:45:03.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52318 req_id = a762af74-724b-44e7-adb0-97c3a2d12b3b response_code = 200 uri = /v2p
32502024-11-19T01:45:03.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33083 req_id = b2d0c0c6-0762-425b-bfd4-13627e201cc2 response_code = 204 uri = /vpc-routes
32512024-11-19T01:45:03.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45246
32522024-11-19T01:45:03.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45246 req_id = 6a7b790a-4cbf-4b16-8f7f-4c692b9fe2e2 response_code = 200 uri = /vpc-routes
32532024-11-19T01:45:03.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59009
32542024-11-19T01:45:03.807ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32552024-11-19T01:45:03.849ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32562024-11-19T01:45:03.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102845 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59009 req_id = 68baeba4-2810-4be6-9908-270cbfd218ff response_code = 204 uri = /switch-ports
32572024-11-19T01:45:03.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38166
32582024-11-19T01:45:03.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {1bf5f9af-1594-4e08-8b77-efe08afaca00: {10.151.1.175: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}, 10.151.1.176: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}}} }
32592024-11-19T01:45:03.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45246 req_id = 42f345b2-a330-48f0-97cf-7a070e425687 response_code = 204 uri = /eip-gateways
32602024-11-19T01:45:03.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59009 req_id = ca328a8f-6da1-4669-8fe9-d98cccbb52a6 response_code = 200 uri = /network-bootstore-config
32612024-11-19T01:45:03.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38166 req_id = 22d0eaad-c590-4b03-ac04-0bb98ad123a4 response_code = 200 uri = /v2p
32622024-11-19T01:45:03.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45246 req_id = 7e063a8c-e525-40e4-ac51-46ddd4e1da4c response_code = 204 uri = /vpc-routes
32632024-11-19T01:45:03.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57343
32642024-11-19T01:45:03.938ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32652024-11-19T01:45:03.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32662024-11-19T01:45:04.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57343 req_id = 97a6d227-9b99-4fb5-98c8-eec9fdbea042 response_code = 204 uri = /switch-ports
32672024-11-19T01:45:04.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57343 req_id = 91cca411-b661-4270-9379-43a19b35c0e5 response_code = 200 uri = /network-bootstore-config
32682024-11-19T01:45:04.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57706
32692024-11-19T01:45:04.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38787
32702024-11-19T01:45:04.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38787 req_id = b5e87b54-a119-48a2-8402-536c01ecaed4 response_code = 200 uri = /vpc-routes
32712024-11-19T01:45:04.525ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {1bf5f9af-1594-4e08-8b77-efe08afaca00: {10.151.1.176: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}, 10.151.1.175: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}}} }
32722024-11-19T01:45:04.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38787 req_id = b98c934a-2a6d-4702-b46e-898296cca111 response_code = 204 uri = /eip-gateways
32732024-11-19T01:45:04.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39680
32742024-11-19T01:45:04.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39680 req_id = f0d2b1f9-5930-499c-abf5-8409f78a175e response_code = 200 uri = /v2p
32752024-11-19T01:45:04.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38787 req_id = b3421071-d6dc-4f18-8408-3ae4fedcd897 response_code = 204 uri = /vpc-routes
32762024-11-19T01:45:04.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42401
32772024-11-19T01:45:04.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32782024-11-19T01:45:04.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32792024-11-19T01:45:04.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42401 req_id = 7bb4ad42-727c-4258-ad68-f2332caae3c5 response_code = 204 uri = /switch-ports
32802024-11-19T01:45:04.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42401 req_id = 1eed10b8-0f33-4941-a119-af8abe71055a response_code = 200 uri = /network-bootstore-config
32812024-11-19T01:45:05.469ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32822024-11-19T01:45:05.488ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(10299830), kind: System }
32832024-11-19T01:45:05.488ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(10299830), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
32842024-11-19T01:45:05.489ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T01:45:05.488982383Z }, migration_in: None, migration_out: None }
32852024-11-19T01:45:05.540ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T01:45:05.488982383Z }, migration_in: None, migration_out: None }
32862024-11-19T01:45:05.543ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092
32872024-11-19T01:45:05.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1076712 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57706 req_id = e4b1ad8e-ed63-423b-9f63-addf6ba0e2fb response_code = 200 uri = /vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
32882024-11-19T01:45:05.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895533 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52505 req_id = 8077c528-3b3d-40a9-8560-7e18a650fd0b response_code = 200 uri = /vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
32892024-11-19T01:45:05.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890026 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36883 req_id = 6539d526-6941-4151-8a8d-737ad84963c7 response_code = 200 uri = /vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
32902024-11-19T01:45:05.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48520
32912024-11-19T01:45:05.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48520 req_id = a02e9a1c-f238-413c-8c59-f2a3400d349b response_code = 200 uri = /vpc-routes
32922024-11-19T01:45:06.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
32932024-11-19T01:45:06.006ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1231 sled_id = 302245ee-8785-4baf-86ed-0823410907ec
32942024-11-19T01:45:06.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48520 req_id = 8331de0f-7217-4e2f-b2a2-b7d430146959 response_code = 204 uri = /eip-gateways
32952024-11-19T01:45:06.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48520 req_id = 2c42e300-0adc-4cfc-9357-f4aeefba8fd1 response_code = 204 uri = /vpc-routes
32962024-11-19T01:45:06.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34728
32972024-11-19T01:45:06.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34728 req_id = 1e4c567e-0f94-48ca-ab4c-4f99429a71e8 response_code = 200 uri = /v2p
32982024-11-19T01:45:06.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35840
32992024-11-19T01:45:06.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35840 req_id = 7513df78-9652-4211-b710-5c0ae575c858 response_code = 200 uri = /v2p
33002024-11-19T01:45:06.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60898
33012024-11-19T01:45:06.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60898 req_id = 602a7e28-4522-47d6-bc21-c2bb7ab0f668 response_code = 200 uri = /vpc-routes
33022024-11-19T01:45:06.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
33032024-11-19T01:45:06.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60898 req_id = 53323987-1712-4840-b14e-8643adaaff65 response_code = 204 uri = /eip-gateways
33042024-11-19T01:45:06.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60898 req_id = 46ccaf44-125a-4483-9736-50d95a942e1d response_code = 204 uri = /vpc-routes
33052024-11-19T01:45:07.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61495
33062024-11-19T01:45:07.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61495 req_id = 884b7424-94f8-4612-a32e-eb44c33c2603 response_code = 200 uri = /vpc-routes
33072024-11-19T01:45:07.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1205 sled_id = 302245ee-8785-4baf-86ed-0823410907ec values = ExternalIpGatewayMap { mappings: {} }
33082024-11-19T01:45:07.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61495 req_id = 76c04cc5-5a4e-4642-9611-8f3543d4a22a response_code = 204 uri = /eip-gateways
33092024-11-19T01:45:07.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61495 req_id = 843e8eee-0a6d-4145-add5-31cf35012952 response_code = 204 uri = /vpc-routes