Max level shown:
1 [ Dec 21 00:14:53 Enabled. ]
2 [ Dec 21 00:14:53 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 00:14:53 Method "start" exited with status 0. ]
4 [ Dec 21 00:14:53 Rereading configuration. ]
5 [ Dec 21 00:14:53 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T00:14:53.610ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T00:14:53.610ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T00:14:53.664ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T00:14:53.664ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T00:14:53.780ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T00:14:53.789ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T00:14:53.797ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T00:14:54.399ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-21T00:14:54.536ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T00:14:54.536ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T00:14:54.536ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T00:14:54.536ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T00:14:54.536ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-21T00:14:54.536ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-21T00:14:54.539ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T00:14:54.539ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T00:14:54.539ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T00:14:54.539ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T00:14:54.539ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T00:14:54.539ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T00:14:54.539ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T00:14:54.539ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T00:14:54.539ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T00:14:54.551ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T00:14:54.551ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = d42506e4-db68-4701-beb2-382ce82c1175 (zpool)
322024-12-21T00:14:54.650ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal }
332024-12-21T00:14:55.012ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T00:14:55.012ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T00:14:55.012ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T00:14:55.012ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T00:14:55.012ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T00:14:55.012ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T00:14:55.012ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T00:14:55.021ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T00:14:55.021ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool)
422024-12-21T00:14:55.110ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal }
432024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
512024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
712024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
722024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-21T00:14:55.474ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-21T00:14:55.474ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-21T00:14:55.474ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-21T00:14:55.474ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-21T00:14:55.474ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-21T00:14:55.474ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-21T00:14:55.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032024-12-21T00:14:55.474ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-21T00:14:55.474ZINFOSledAgent (bootstore): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-21T00:14:55.474ZINFOSledAgent (bootstore): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-21T00:14:55.474ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-21T00:14:55.474ZINFOSledAgent (bootstore): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-21T00:14:55.474ZINFOSledAgent (bootstore): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-21T00:14:55.474ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-21T00:14:55.474ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-21T00:14:55.474ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-21T00:14:55.485ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-21T00:14:55.485ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1378, tv_nsec: 653477431 } time_to_next_cleanup = 599.999937958s
1142024-12-21T00:14:55.485ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-21T00:14:55.485ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-21T00:14:55.485ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-21T00:14:55.488ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-21T00:14:55.489ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-21T00:14:55.490ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-21T00:14:55.491ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-21T00:14:55.491ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-21T00:14:55.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-21T00:14:55.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-21T00:14:55.491ZINFOSledAgent (RSS): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-21T00:14:55.491ZINFOSledAgent (RSS): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-21T00:14:55.491ZINFOSledAgent (RSS): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-21T00:14:55.491ZINFOSledAgent (RSS): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-21T00:14:55.491ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-21T00:14:55.491ZINFOSledAgent (RSS): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-21T00:14:55.491ZINFOSledAgent (RSS): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-21T00:14:55.491ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-21T00:14:55.491ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-21T00:14:55.491ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-21T00:14:55.491ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-21T00:14:55.492ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-21T00:14:55.492ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-21T00:14:55.492ZINFOSledAgent (bootstore): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-21T00:14:55.492ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-21T00:14:55.492ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 (sled), rack_id: a8c36764-00e1-4685-8f8d-23cc231b3f7b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-21T00:14:55.493ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-21T00:14:55.493ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-21T00:14:55.497ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-21T00:14:55.503ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-21T00:14:55.503ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-21T00:14:55.508ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-21T00:14:55.508ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-21T00:14:55.508ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43591
1482024-12-21T00:14:55.508ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 (sled), rack_id: a8c36764-00e1-4685-8f8d-23cc231b3f7b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-21T00:14:55.508ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-21T00:14:55.508ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1532024-12-21T00:14:55.508ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-21T00:14:55.508ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-21T00:14:55.508ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-21T00:14:55.508ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-21T00:14:55.526ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-21T00:14:55.547ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-21T00:14:55.564ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-21T00:14:55.582ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1662024-12-21T00:14:55.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-21T00:14:55.582ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1682024-12-21T00:14:55.582ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-21T00:14:55.585ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.501887ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cfacff5b-aece-4b51-aef9-5b8a48fb21df", "content-length": "124", "date": "Sat, 21 Dec 2024 00:14:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cfacff5b-aece-4b51-aef9-5b8a48fb21df" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-21T00:14:55.595ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_d42506e4-db68-4701-beb2-382ce82c1175/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-21T00:14:55.620ZINFOSledAgent: successfully created encrypted zvol: name="oxi_d42506e4-db68-4701-beb2-382ce82c1175/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-21T00:14:55.620ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_d42506e4-db68-4701-beb2-382ce82c1175/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-21T00:14:55.626ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1742024-12-21T00:14:55.626ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-21T00:14:55.626ZINFOSledAgent (BackingFs): Ensuring dataset oxi_d42506e4-db68-4701-beb2-382ce82c1175/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-21T00:14:55.694ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772024-12-21T00:14:55.736ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-21T00:14:55.736ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 159.335147ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "08e8b4e5-a981-4e7e-b747-f273cc876e07", "content-length": "124", "date": "Sat, 21 Dec 2024 00:14:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "08e8b4e5-a981-4e7e-b747-f273cc876e07" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-21T00:14:55.897ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-21T00:14:55.897ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 215.190572ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "be72d1e8-d3c3-4463-8f0c-c9974015c10c", "content-length": "124", "date": "Sat, 21 Dec 2024 00:14:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "be72d1e8-d3c3-4463-8f0c-c9974015c10c" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-21T00:14:55.913ZINFOSledAgent (BackingFs): Mounting oxi_d42506e4-db68-4701-beb2-382ce82c1175/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-21T00:14:55.927ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-21T00:14:55.927ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-21T00:14:55.927ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-21T00:14:55.927ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-21T00:14:56.114ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-21T00:14:56.115ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.055606ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7d0d814a-5abd-4a0e-8549-5c71393483f4", "content-length": "124", "date": "Sat, 21 Dec 2024 00:14:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7d0d814a-5abd-4a0e-8549-5c71393483f4" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-21T00:14:56.248ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-21T00:14:56.248ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 135.418403ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "288e55db-274f-447a-8c0c-2679f710737d", "content-length": "124", "date": "Sat, 21 Dec 2024 00:14:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "288e55db-274f-447a-8c0c-2679f710737d" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-21T00:14:56.385ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-21T00:14:56.386ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 275.573414ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "678ba4d2-1175-4cf8-af3f-5500d2aee3b8", "content-length": "124", "date": "Sat, 21 Dec 2024 00:14:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "678ba4d2-1175-4cf8-af3f-5500d2aee3b8" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-21T00:14:56.663ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-21T00:14:56.672ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1942024-12-21T00:14:56.677ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:36671 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1952024-12-21T00:14:56.677ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1962024-12-21T00:14:56.677ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:36671 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1972024-12-21T00:14:56.678ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 328.542685ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1982024-12-21T00:14:56.679ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
1992024-12-21T00:14:56.679ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2002024-12-21T00:14:56.679ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2012024-12-21T00:14:56.679ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022024-12-21T00:14:57.009ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 261.995079ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2032024-12-21T00:14:57.272ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.118879567s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2042024-12-21T00:14:58.393ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.305105912s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2052024-12-21T00:14:59.226ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2062024-12-21T00:14:59.226ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2072024-12-21T00:14:59.226ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2082024-12-21T00:14:59.226ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2092024-12-21T00:14:59.226ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2102024-12-21T00:14:59.226ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2112024-12-21T00:14:59.228ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2122024-12-21T00:14:59.230ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2132024-12-21T00:14:59.230ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='ded8351e-8bb9-4c84-b14e-87b35d32b4bb'/> <propval type="astring" name="rack_id" value='a8c36764-00e1-4685-8f8d-23cc231b3f7b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe75:8fec'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='a8c36764-00e1-4685-8f8d-23cc231b3f7b'/> <propval type="astring" name="sled_id" value='ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3'/> <propval type="astring" name="rack_uuid" value='a8c36764-00e1-4685-8f8d-23cc231b3f7b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3'/> <propval type="astring" name="rack_uuid" value='a8c36764-00e1-4685-8f8d-23cc231b3f7b'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-21T00:14:59.230ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-21T00:14:59.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 71.220937ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-21T00:14:59.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 130.279399ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-21T00:14:59.701ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.597799839s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2182024-12-21T00:14:59.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 114.549096ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-21T00:15:00.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 538.827068ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T00:15:00.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 574.517209ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T00:15:01.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 925.404624ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-21T00:15:02.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.350265467s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T00:15:03.301ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.794355607s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2242024-12-21T00:15:03.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 818.979917ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-21T00:15:05.234ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/nexus.rs:527 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2262024-12-21T00:15:05.264ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272024-12-21T00:15:05.265ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2282024-12-21T00:15:05.266ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2292024-12-21T00:15:05.266ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302024-12-21T00:15:05.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312024-12-21T00:15:05.266ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-21T00:15:05.266ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-21T00:15:05.267ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342024-12-21T00:15:05.267ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352024-12-21T00:15:05.267ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2362024-12-21T00:15:05.482ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43591
2372024-12-21T00:15:05.482ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-21T00:15:05.482ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-12-21T00:15:05.488ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402024-12-21T00:15:05.488ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2412024-12-21T00:15:05.488ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422024-12-21T00:15:05.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38475
2432024-12-21T00:15:05.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442024-12-21T00:15:05.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452024-12-21T00:15:05.795ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-21T00:15:05.795ZINFOSledAgent (ServiceManager): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-21T00:15:05.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38475 req_id = a9f1c235-22f5-4f4a-a5d2-98949121a984 response_code = 200 uri = /inventory
2482024-12-21T00:15:05.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46252
2492024-12-21T00:15:05.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46252 req_id = a2bd77c7-ee28-4ae9-9951-b2b5ef9f5fab response_code = 200 uri = /sled-role
2502024-12-21T00:15:05.858ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 061f88c6-a9df-4e94-875b-5ba2d5dcfeac (physical_disk), pool_id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: d3e839e8-fb56-4b7a-8a36-512b76b91f98 (physical_disk), pool_id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a67c9b83-1a79-402b-b948-550928d732b8 (physical_disk), pool_id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 7082ac2f-84fa-4c89-9989-2e4cf2bbfe07 (physical_disk), pool_id: db606984-291b-40d5-964e-14a228d68e45 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 3bd4601f-cda2-4906-ac5a-9f88a3e0373a (physical_disk), pool_id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 1d3a75a2-4f73-4269-ac23-271f35834649 (physical_disk), pool_id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e0b7c163-a4d7-4920-ba0f-77d6234c232e (physical_disk), pool_id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 474bb42a-55f8-4d3d-a8e7-21ad07eea9f6 (physical_disk), pool_id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dde143b8-bd36-4986-bba4-b3f0397b59e2 (physical_disk), pool_id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512024-12-21T00:15:05.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54543
2522024-12-21T00:15:05.858ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2532024-12-21T00:15:05.858ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 061f88c6-a9df-4e94-875b-5ba2d5dcfeac (physical_disk), pool_id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: d3e839e8-fb56-4b7a-8a36-512b76b91f98 (physical_disk), pool_id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a67c9b83-1a79-402b-b948-550928d732b8 (physical_disk), pool_id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 7082ac2f-84fa-4c89-9989-2e4cf2bbfe07 (physical_disk), pool_id: db606984-291b-40d5-964e-14a228d68e45 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 3bd4601f-cda2-4906-ac5a-9f88a3e0373a (physical_disk), pool_id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 1d3a75a2-4f73-4269-ac23-271f35834649 (physical_disk), pool_id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: e0b7c163-a4d7-4920-ba0f-77d6234c232e (physical_disk), pool_id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 474bb42a-55f8-4d3d-a8e7-21ad07eea9f6 (physical_disk), pool_id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: dde143b8-bd36-4986-bba4-b3f0397b59e2 (physical_disk), pool_id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2542024-12-21T00:15:05.858ZINFOSledAgent (StorageManager): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-21T00:15:05.858ZINFOSledAgent (StorageManager): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-21T00:15:05.858ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2572024-12-21T00:15:05.858ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582024-12-21T00:15:05.858ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592024-12-21T00:15:05.858ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602024-12-21T00:15:05.858ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612024-12-21T00:15:05.988ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2622024-12-21T00:15:05.988ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool)
2632024-12-21T00:15:06.441ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2642024-12-21T00:15:06.663ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2652024-12-21T00:15:06.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18404268949976698426 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2662024-12-21T00:15:06.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16983613855386893869 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
2672024-12-21T00:15:06.716ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }
2682024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-21T00:15:06.724ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752024-12-21T00:15:06.761ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762024-12-21T00:15:06.769ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone file = sled-storage/src/dataset.rs:302
2772024-12-21T00:15:06.909ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33 file = sled-storage/src/dataset.rs:388
2782024-12-21T00:15:06.917ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792024-12-21T00:15:06.917ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802024-12-21T00:15:06.917ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812024-12-21T00:15:06.917ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822024-12-21T00:15:06.917ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832024-12-21T00:15:06.927ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842024-12-21T00:15:06.928ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool)
2852024-12-21T00:15:07.025ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }
2862024-12-21T00:15:07.033ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872024-12-21T00:15:07.033ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882024-12-21T00:15:07.033ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892024-12-21T00:15:07.033ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902024-12-21T00:15:07.033ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-21T00:15:07.034ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-21T00:15:07.034ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932024-12-21T00:15:07.070ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-12-21T00:15:07.078ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone file = sled-storage/src/dataset.rs:302
2952024-12-21T00:15:07.221ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b file = sled-storage/src/dataset.rs:388
2962024-12-21T00:15:07.229ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-21T00:15:07.230ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-21T00:15:07.230ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-21T00:15:07.230ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-21T00:15:07.230ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-21T00:15:07.239ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-21T00:15:07.239ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool)
3032024-12-21T00:15:07.336ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }
3042024-12-21T00:15:07.343ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052024-12-21T00:15:07.343ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062024-12-21T00:15:07.343ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072024-12-21T00:15:07.343ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082024-12-21T00:15:07.343ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-21T00:15:07.344ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-21T00:15:07.344ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112024-12-21T00:15:07.381ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-21T00:15:07.389ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone file = sled-storage/src/dataset.rs:302
3132024-12-21T00:15:07.443ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
3142024-12-21T00:15:07.530ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19 file = sled-storage/src/dataset.rs:388
3152024-12-21T00:15:07.538ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-21T00:15:07.538ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-21T00:15:07.538ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-21T00:15:07.538ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-21T00:15:07.538ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-21T00:15:07.549ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-21T00:15:07.549ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = db606984-291b-40d5-964e-14a228d68e45 (zpool)
3222024-12-21T00:15:07.646ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }
3232024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-21T00:15:07.655ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302024-12-21T00:15:07.692ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-12-21T00:15:07.700ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/zone file = sled-storage/src/dataset.rs:302
3322024-12-21T00:15:07.835ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_db606984-291b-40d5-964e-14a228d68e45 file = sled-storage/src/dataset.rs:388
3332024-12-21T00:15:07.843ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342024-12-21T00:15:07.843ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352024-12-21T00:15:07.843ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362024-12-21T00:15:07.843ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372024-12-21T00:15:07.843ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382024-12-21T00:15:07.852ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392024-12-21T00:15:07.852ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool)
3402024-12-21T00:15:07.947ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }
3412024-12-21T00:15:07.955ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422024-12-21T00:15:07.955ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432024-12-21T00:15:07.955ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442024-12-21T00:15:07.955ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452024-12-21T00:15:07.955ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-21T00:15:07.956ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-21T00:15:07.956ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482024-12-21T00:15:07.991ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492024-12-21T00:15:07.999ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone file = sled-storage/src/dataset.rs:302
3502024-12-21T00:15:08.096ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 22.507185459s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
3512024-12-21T00:15:08.137ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 file = sled-storage/src/dataset.rs:388
3522024-12-21T00:15:08.145ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-21T00:15:08.145ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-21T00:15:08.145ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-21T00:15:08.145ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-21T00:15:08.145ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-21T00:15:08.155ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-21T00:15:08.155ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 96dd6601-21c1-4f69-a871-ce8980776531 (zpool)
3592024-12-21T00:15:08.251ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }
3602024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-21T00:15:08.259ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672024-12-21T00:15:08.295ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-21T00:15:08.303ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_96dd6601-21c1-4f69-a871-ce8980776531/crypt/zone file = sled-storage/src/dataset.rs:302
3692024-12-21T00:15:08.445ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
3702024-12-21T00:15:08.445ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_96dd6601-21c1-4f69-a871-ce8980776531 file = sled-storage/src/dataset.rs:388
3712024-12-21T00:15:08.453ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722024-12-21T00:15:08.453ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732024-12-21T00:15:08.453ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742024-12-21T00:15:08.453ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-12-21T00:15:08.453ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-12-21T00:15:08.464ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772024-12-21T00:15:08.464ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool)
3782024-12-21T00:15:08.560ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }
3792024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-21T00:15:08.568ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862024-12-21T00:15:08.604ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-12-21T00:15:08.613ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8504df1b-d5a7-40bd-ad45-c55449857140/crypt/zone file = sled-storage/src/dataset.rs:302
3882024-12-21T00:15:08.750ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8504df1b-d5a7-40bd-ad45-c55449857140 file = sled-storage/src/dataset.rs:388
3892024-12-21T00:15:08.757ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-21T00:15:08.758ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-21T00:15:08.758ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-21T00:15:08.758ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-21T00:15:08.758ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-21T00:15:08.766ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-21T00:15:08.766ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool)
3962024-12-21T00:15:08.862ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }
3972024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-21T00:15:08.870ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042024-12-21T00:15:08.905ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-21T00:15:08.912ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone file = sled-storage/src/dataset.rs:302
4062024-12-21T00:15:09.057ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b3c5770f-c2a5-4687-9844-df947021ecd9 file = sled-storage/src/dataset.rs:388
4072024-12-21T00:15:09.064ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-21T00:15:09.064ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-21T00:15:09.064ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-21T00:15:09.064ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-21T00:15:09.064ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-21T00:15:09.073ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-21T00:15:09.073ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool)
4142024-12-21T00:15:09.168ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }
4152024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-21T00:15:09.176ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222024-12-21T00:15:09.216ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-21T00:15:09.224ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/zone file = sled-storage/src/dataset.rs:302
4242024-12-21T00:15:09.357ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_30f2f8a7-d49b-4582-9153-44098dd8db06 file = sled-storage/src/dataset.rs:388
4252024-12-21T00:15:09.366ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-21T00:15:09.366ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-21T00:15:09.366ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-21T00:15:09.366ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d42506e4-db68-4701-beb2-382ce82c1175 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50e0102e-a0cf-4808-8b40-f7f22995d1e2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-21T00:15:09.366ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-21T00:15:09.366ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-21T00:15:09.366ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-21T00:15:09.366ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4332024-12-21T00:15:09.366ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342024-12-21T00:15:09.366ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4352024-12-21T00:15:09.366ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4362024-12-21T00:15:09.366ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4372024-12-21T00:15:09.366ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4382024-12-21T00:15:09.366ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4392024-12-21T00:15:09.366ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-21T00:15:09.366ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4412024-12-21T00:15:09.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3508486 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54543 req_id = b4f4be1f-f465-4bb0-b029-27183cdb9f3c response_code = 200 uri = /omicron-physical-disks
4422024-12-21T00:15:09.398ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03d6ef37-be6c-4e48-912e-60dc55d5af0f (dataset): DatasetConfig { id: 03d6ef37-be6c-4e48-912e-60dc55d5af0f (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 075cba5d-248b-4359-9897-a065ab41bcf2 (dataset): DatasetConfig { id: 075cba5d-248b-4359-9897-a065ab41bcf2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0add2492-7821-4c34-acb9-a5cbb489cf1b (dataset): DatasetConfig { id: 0add2492-7821-4c34-acb9-a5cbb489cf1b (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c7dce47-bb96-4956-a01d-735b1ba57d5f (dataset): DatasetConfig { id: 0c7dce47-bb96-4956-a01d-735b1ba57d5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d534828-2ced-4582-86d3-71fecb963982 (dataset): DatasetConfig { id: 0d534828-2ced-4582-86d3-71fecb963982 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dc98f38-fdf1-45e1-a871-377f9282f1e9 (dataset): DatasetConfig { id: 0dc98f38-fdf1-45e1-a871-377f9282f1e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11e22d14-0c11-48e4-ac1c-03b8affeb947 (dataset): DatasetConfig { id: 11e22d14-0c11-48e4-ac1c-03b8affeb947 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 147f67b7-1a64-4837-a172-f54a351ca455 (dataset): DatasetConfig { id: 147f67b7-1a64-4837-a172-f54a351ca455 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16ea3da5-9e2c-4a2b-ae01-b8fec43e3fab (dataset): DatasetConfig { id: 16ea3da5-9e2c-4a2b-ae01-b8fec43e3fab (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e24c9ac-73fd-4368-a0c1-cba11c45f1a1 (dataset): DatasetConfig { id: 1e24c9ac-73fd-4368-a0c1-cba11c45f1a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 238d19fe-faa3-4f09-8be3-824bdc4882b5 (dataset): DatasetConfig { id: 238d19fe-faa3-4f09-8be3-824bdc4882b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 266e345a-0f78-43e6-87c8-bee15ed447b9 (dataset): DatasetConfig { id: 266e345a-0f78-43e6-87c8-bee15ed447b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2f0dcccc-d6ea-4ab6-9cfc-f13f884941a1 (dataset): DatasetConfig { id: 2f0dcccc-d6ea-4ab6-9cfc-f13f884941a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 31fd50a4-b537-4301-ab94-dde72982fc61 (dataset): DatasetConfig { id: 31fd50a4-b537-4301-ab94-dde72982fc61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 324f8e9c-ec90-49a8-86cc-9e5c71f86d50 (dataset): DatasetConfig { id: 324f8e9c-ec90-49a8-86cc-9e5c71f86d50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32f1a38b-8cd0-4fe4-a549-d7b042246ab4 (dataset): DatasetConfig { id: 32f1a38b-8cd0-4fe4-a549-d7b042246ab4 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a86607a-8552-4f13-976e-5eea16a69bf7 (dataset): DatasetConfig { id: 3a86607a-8552-4f13-976e-5eea16a69bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b0e0bd2-1bbd-46a0-a1fe-3e7dddfcc5fc (dataset): DatasetConfig { id: 3b0e0bd2-1bbd-46a0-a1fe-3e7dddfcc5fc (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40125574-7e7f-48b5-9b59-4f6dfcb7db61 (dataset): DatasetConfig { id: 40125574-7e7f-48b5-9b59-4f6dfcb7db61 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 410e33df-a312-4fbf-9f1d-b6e926fae5db (dataset): DatasetConfig { id: 410e33df-a312-4fbf-9f1d-b6e926fae5db (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 467c58a2-54b3-49ef-bca0-8814ee90e22c (dataset): DatasetConfig { id: 467c58a2-54b3-49ef-bca0-8814ee90e22c (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49674c5c-06c9-4977-9fe9-134e284c8962 (dataset): DatasetConfig { id: 49674c5c-06c9-4977-9fe9-134e284c8962 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4afd12dc-8f2d-4b90-82f3-d8e48bc893d3 (dataset): DatasetConfig { id: 4afd12dc-8f2d-4b90-82f3-d8e48bc893d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4dc8867b-3112-4b97-ac06-eab278ed0191 (dataset): DatasetConfig { id: 4dc8867b-3112-4b97-ac06-eab278ed0191 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aae6da0-8d43-40d3-825b-628b4a83330d (dataset): DatasetConfig { id: 5aae6da0-8d43-40d3-825b-628b4a83330d (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 664716d9-bd97-4c7a-be47-460c9b10928f (dataset): DatasetConfig { id: 664716d9-bd97-4c7a-be47-460c9b10928f (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6d2e1f0a-8c40-4d2f-b89e-91a27cf689f3 (dataset): DatasetConfig { id: 6d2e1f0a-8c40-4d2f-b89e-91a27cf689f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 726ec9f7-fd98-423a-bae8-cbdfc341d66e (dataset): DatasetConfig { id: 726ec9f7-fd98-423a-bae8-cbdfc341d66e (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 77197f80-9e77-4dd9-b20d-01253368c07b (dataset): DatasetConfig { id: 77197f80-9e77-4dd9-b20d-01253368c07b (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a861e22-2286-4248-a405-34bcbd672de6 (dataset): DatasetConfig { id: 7a861e22-2286-4248-a405-34bcbd672de6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c3b9682-2650-4b7b-a57f-26815d42ee80 (dataset): DatasetConfig { id: 7c3b9682-2650-4b7b-a57f-26815d42ee80 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d362742-b5bf-4434-b927-d6743e885c2f (dataset): DatasetConfig { id: 7d362742-b5bf-4434-b927-d6743e885c2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ed8a8c2-e4ea-45ac-b712-e7a785be8ea7 (dataset): DatasetConfig { id: 7ed8a8c2-e4ea-45ac-b712-e7a785be8ea7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81ce77cd-583e-4ba9-8434-fb2e23269609 (dataset): DatasetConfig { id: 81ce77cd-583e-4ba9-8434-fb2e23269609 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83dee4c8-ecd4-44ac-bc17-0b278d1b190e (dataset): DatasetConfig { id: 83dee4c8-ecd4-44ac-bc17-0b278d1b190e (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8687ca82-5e19-4688-8f79-155f52ac874f (dataset): DatasetConfig { id: 8687ca82-5e19-4688-8f79-155f52ac874f (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88741f8d-c4d0-41f4-97bf-5f385f6297b8 (dataset): DatasetConfig { id: 88741f8d-c4d0-41f4-97bf-5f385f6297b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cbe636b-8129-40b1-83c2-003d1b650c39 (dataset): DatasetConfig { id: 8cbe636b-8129-40b1-83c2-003d1b650c39 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e06d177-5159-4001-b227-9e0e09307b4f (dataset): DatasetConfig { id: 8e06d177-5159-4001-b227-9e0e09307b4f (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e3b9a8f-cec4-408b-940d-73920387c041 (dataset): DatasetConfig { id: 8e3b9a8f-cec4-408b-940d-73920387c041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 921e68d5-a6bb-4359-b2cb-f0ebe807fbb1 (dataset): DatasetConfig { id: 921e68d5-a6bb-4359-b2cb-f0ebe807fbb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93a1d5ae-ce6f-4f12-85db-a5afad2753db (dataset): DatasetConfig { id: 93a1d5ae-ce6f-4f12-85db-a5afad2753db (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fb42e27-d59f-4893-8041-cc23a2c26afc (dataset): DatasetConfig { id: 9fb42e27-d59f-4893-8041-cc23a2c26afc (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae1d51bc-edf9-4a4a-813d-5abc8107e3a1 (dataset): DatasetConfig { id: ae1d51bc-edf9-4a4a-813d-5abc8107e3a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0668f28-c856-43f2-af77-7f9f3c13941c (dataset): DatasetConfig { id: b0668f28-c856-43f2-af77-7f9f3c13941c (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b1eaa661-3d73-42f8-83d9-8765b3452495 (dataset): DatasetConfig { id: b1eaa661-3d73-42f8-83d9-8765b3452495 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b49b9af3-41f7-47fc-be02-5301220ee1b7 (dataset): DatasetConfig { id: b49b9af3-41f7-47fc-be02-5301220ee1b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb20dd7e-4d41-4fc4-9252-03ba254373cb (dataset): DatasetConfig { id: bb20dd7e-4d41-4fc4-9252-03ba254373cb (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb878d85-bd09-4e0f-b496-592e2cac0c97 (dataset): DatasetConfig { id: bb878d85-bd09-4e0f-b496-592e2cac0c97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2b272f6-fd14-478f-9ed7-eb001b242307 (dataset): DatasetConfig { id: c2b272f6-fd14-478f-9ed7-eb001b242307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c303fd28-0def-432d-b5f0-c20ec0aab4a2 (dataset): DatasetConfig { id: c303fd28-0def-432d-b5f0-c20ec0aab4a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0b7856f-56d0-4c5b-9011-458e6ab97f09 (dataset): DatasetConfig { id: d0b7856f-56d0-4c5b-9011-458e6ab97f09 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d25f45ac-2071-4c24-a568-9d3099bec1ed (dataset): DatasetConfig { id: d25f45ac-2071-4c24-a568-9d3099bec1ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3f54298-b2bf-4b81-97c0-4bd156492f1f (dataset): DatasetConfig { id: d3f54298-b2bf-4b81-97c0-4bd156492f1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d63e5e7e-0131-4306-bc7a-463d7e9b110d (dataset): DatasetConfig { id: d63e5e7e-0131-4306-bc7a-463d7e9b110d (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7283801-16cf-4b6a-aadb-bf92bb1ce95a (dataset): DatasetConfig { id: d7283801-16cf-4b6a-aadb-bf92bb1ce95a (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d73b9e89-1723-4a17-83f8-8edb26266c60 (dataset): DatasetConfig { id: d73b9e89-1723-4a17-83f8-8edb26266c60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daabf456-a148-467f-862c-fb6da073c47b (dataset): DatasetConfig { id: daabf456-a148-467f-862c-fb6da073c47b (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df082a7c-fd83-4a5a-9880-342b8ddbd84c (dataset): DatasetConfig { id: df082a7c-fd83-4a5a-9880-342b8ddbd84c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7f55426-9c22-4f4b-bf7c-c1afb976ff0c (dataset): DatasetConfig { id: e7f55426-9c22-4f4b-bf7c-c1afb976ff0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, eb475757-17a8-404d-980b-3395f23cdeef (dataset): DatasetConfig { id: eb475757-17a8-404d-980b-3395f23cdeef (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebacb530-45fe-4192-a80b-d8478b0ac96a (dataset): DatasetConfig { id: ebacb530-45fe-4192-a80b-d8478b0ac96a (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4567513-008b-4b7f-9f83-c62b181e6338 (dataset): DatasetConfig { id: f4567513-008b-4b7f-9f83-c62b181e6338 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8f6a1d4-c5f3-48c7-9a9c-7b6013b0df04 (dataset): DatasetConfig { id: f8f6a1d4-c5f3-48c7-9a9c-7b6013b0df04 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faba7add-dc2d-4889-9b82-649aed51125c (dataset): DatasetConfig { id: faba7add-dc2d-4889-9b82-649aed51125c (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe5656f6-e312-4946-b4ef-02882c7aa8b2 (dataset): DatasetConfig { id: fe5656f6-e312-4946-b4ef-02882c7aa8b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-21T00:15:09.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36519
4442024-12-21T00:15:09.399ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4452024-12-21T00:15:09.399ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03d6ef37-be6c-4e48-912e-60dc55d5af0f (dataset): DatasetConfig { id: 03d6ef37-be6c-4e48-912e-60dc55d5af0f (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 075cba5d-248b-4359-9897-a065ab41bcf2 (dataset): DatasetConfig { id: 075cba5d-248b-4359-9897-a065ab41bcf2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0add2492-7821-4c34-acb9-a5cbb489cf1b (dataset): DatasetConfig { id: 0add2492-7821-4c34-acb9-a5cbb489cf1b (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c7dce47-bb96-4956-a01d-735b1ba57d5f (dataset): DatasetConfig { id: 0c7dce47-bb96-4956-a01d-735b1ba57d5f (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d534828-2ced-4582-86d3-71fecb963982 (dataset): DatasetConfig { id: 0d534828-2ced-4582-86d3-71fecb963982 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dc98f38-fdf1-45e1-a871-377f9282f1e9 (dataset): DatasetConfig { id: 0dc98f38-fdf1-45e1-a871-377f9282f1e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11e22d14-0c11-48e4-ac1c-03b8affeb947 (dataset): DatasetConfig { id: 11e22d14-0c11-48e4-ac1c-03b8affeb947 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 147f67b7-1a64-4837-a172-f54a351ca455 (dataset): DatasetConfig { id: 147f67b7-1a64-4837-a172-f54a351ca455 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16ea3da5-9e2c-4a2b-ae01-b8fec43e3fab (dataset): DatasetConfig { id: 16ea3da5-9e2c-4a2b-ae01-b8fec43e3fab (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e24c9ac-73fd-4368-a0c1-cba11c45f1a1 (dataset): DatasetConfig { id: 1e24c9ac-73fd-4368-a0c1-cba11c45f1a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 238d19fe-faa3-4f09-8be3-824bdc4882b5 (dataset): DatasetConfig { id: 238d19fe-faa3-4f09-8be3-824bdc4882b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 266e345a-0f78-43e6-87c8-bee15ed447b9 (dataset): DatasetConfig { id: 266e345a-0f78-43e6-87c8-bee15ed447b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2f0dcccc-d6ea-4ab6-9cfc-f13f884941a1 (dataset): DatasetConfig { id: 2f0dcccc-d6ea-4ab6-9cfc-f13f884941a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 31fd50a4-b537-4301-ab94-dde72982fc61 (dataset): DatasetConfig { id: 31fd50a4-b537-4301-ab94-dde72982fc61 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 324f8e9c-ec90-49a8-86cc-9e5c71f86d50 (dataset): DatasetConfig { id: 324f8e9c-ec90-49a8-86cc-9e5c71f86d50 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32f1a38b-8cd0-4fe4-a549-d7b042246ab4 (dataset): DatasetConfig { id: 32f1a38b-8cd0-4fe4-a549-d7b042246ab4 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a86607a-8552-4f13-976e-5eea16a69bf7 (dataset): DatasetConfig { id: 3a86607a-8552-4f13-976e-5eea16a69bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b0e0bd2-1bbd-46a0-a1fe-3e7dddfcc5fc (dataset): DatasetConfig { id: 3b0e0bd2-1bbd-46a0-a1fe-3e7dddfcc5fc (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40125574-7e7f-48b5-9b59-4f6dfcb7db61 (dataset): DatasetConfig { id: 40125574-7e7f-48b5-9b59-4f6dfcb7db61 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 410e33df-a312-4fbf-9f1d-b6e926fae5db (dataset): DatasetConfig { id: 410e33df-a312-4fbf-9f1d-b6e926fae5db (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 467c58a2-54b3-49ef-bca0-8814ee90e22c (dataset): DatasetConfig { id: 467c58a2-54b3-49ef-bca0-8814ee90e22c (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49674c5c-06c9-4977-9fe9-134e284c8962 (dataset): DatasetConfig { id: 49674c5c-06c9-4977-9fe9-134e284c8962 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4afd12dc-8f2d-4b90-82f3-d8e48bc893d3 (dataset): DatasetConfig { id: 4afd12dc-8f2d-4b90-82f3-d8e48bc893d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4dc8867b-3112-4b97-ac06-eab278ed0191 (dataset): DatasetConfig { id: 4dc8867b-3112-4b97-ac06-eab278ed0191 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aae6da0-8d43-40d3-825b-628b4a83330d (dataset): DatasetConfig { id: 5aae6da0-8d43-40d3-825b-628b4a83330d (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 664716d9-bd97-4c7a-be47-460c9b10928f (dataset): DatasetConfig { id: 664716d9-bd97-4c7a-be47-460c9b10928f (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6d2e1f0a-8c40-4d2f-b89e-91a27cf689f3 (dataset): DatasetConfig { id: 6d2e1f0a-8c40-4d2f-b89e-91a27cf689f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 726ec9f7-fd98-423a-bae8-cbdfc341d66e (dataset): DatasetConfig { id: 726ec9f7-fd98-423a-bae8-cbdfc341d66e (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 77197f80-9e77-4dd9-b20d-01253368c07b (dataset): DatasetConfig { id: 77197f80-9e77-4dd9-b20d-01253368c07b (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a861e22-2286-4248-a405-34bcbd672de6 (dataset): DatasetConfig { id: 7a861e22-2286-4248-a405-34bcbd672de6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c3b9682-2650-4b7b-a57f-26815d42ee80 (dataset): DatasetConfig { id: 7c3b9682-2650-4b7b-a57f-26815d42ee80 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d362742-b5bf-4434-b927-d6743e885c2f (dataset): DatasetConfig { id: 7d362742-b5bf-4434-b927-d6743e885c2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ed8a8c2-e4ea-45ac-b712-e7a785be8ea7 (dataset): DatasetConfig { id: 7ed8a8c2-e4ea-45ac-b712-e7a785be8ea7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 81ce77cd-583e-4ba9-8434-fb2e23269609 (dataset): DatasetConfig { id: 81ce77cd-583e-4ba9-8434-fb2e23269609 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83dee4c8-ecd4-44ac-bc17-0b278d1b190e (dataset): DatasetConfig { id: 83dee4c8-ecd4-44ac-bc17-0b278d1b190e (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8687ca82-5e19-4688-8f79-155f52ac874f (dataset): DatasetConfig { id: 8687ca82-5e19-4688-8f79-155f52ac874f (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 88741f8d-c4d0-41f4-97bf-5f385f6297b8 (dataset): DatasetConfig { id: 88741f8d-c4d0-41f4-97bf-5f385f6297b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cbe636b-8129-40b1-83c2-003d1b650c39 (dataset): DatasetConfig { id: 8cbe636b-8129-40b1-83c2-003d1b650c39 (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e06d177-5159-4001-b227-9e0e09307b4f (dataset): DatasetConfig { id: 8e06d177-5159-4001-b227-9e0e09307b4f (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e3b9a8f-cec4-408b-940d-73920387c041 (dataset): DatasetConfig { id: 8e3b9a8f-cec4-408b-940d-73920387c041 (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 921e68d5-a6bb-4359-b2cb-f0ebe807fbb1 (dataset): DatasetConfig { id: 921e68d5-a6bb-4359-b2cb-f0ebe807fbb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93a1d5ae-ce6f-4f12-85db-a5afad2753db (dataset): DatasetConfig { id: 93a1d5ae-ce6f-4f12-85db-a5afad2753db (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fb42e27-d59f-4893-8041-cc23a2c26afc (dataset): DatasetConfig { id: 9fb42e27-d59f-4893-8041-cc23a2c26afc (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae1d51bc-edf9-4a4a-813d-5abc8107e3a1 (dataset): DatasetConfig { id: ae1d51bc-edf9-4a4a-813d-5abc8107e3a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0668f28-c856-43f2-af77-7f9f3c13941c (dataset): DatasetConfig { id: b0668f28-c856-43f2-af77-7f9f3c13941c (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b1eaa661-3d73-42f8-83d9-8765b3452495 (dataset): DatasetConfig { id: b1eaa661-3d73-42f8-83d9-8765b3452495 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b49b9af3-41f7-47fc-be02-5301220ee1b7 (dataset): DatasetConfig { id: b49b9af3-41f7-47fc-be02-5301220ee1b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb20dd7e-4d41-4fc4-9252-03ba254373cb (dataset): DatasetConfig { id: bb20dd7e-4d41-4fc4-9252-03ba254373cb (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb878d85-bd09-4e0f-b496-592e2cac0c97 (dataset): DatasetConfig { id: bb878d85-bd09-4e0f-b496-592e2cac0c97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2b272f6-fd14-478f-9ed7-eb001b242307 (dataset): DatasetConfig { id: c2b272f6-fd14-478f-9ed7-eb001b242307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c303fd28-0def-432d-b5f0-c20ec0aab4a2 (dataset): DatasetConfig { id: c303fd28-0def-432d-b5f0-c20ec0aab4a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0b7856f-56d0-4c5b-9011-458e6ab97f09 (dataset): DatasetConfig { id: d0b7856f-56d0-4c5b-9011-458e6ab97f09 (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d25f45ac-2071-4c24-a568-9d3099bec1ed (dataset): DatasetConfig { id: d25f45ac-2071-4c24-a568-9d3099bec1ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d3f54298-b2bf-4b81-97c0-4bd156492f1f (dataset): DatasetConfig { id: d3f54298-b2bf-4b81-97c0-4bd156492f1f (dataset), name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d63e5e7e-0131-4306-bc7a-463d7e9b110d (dataset): DatasetConfig { id: d63e5e7e-0131-4306-bc7a-463d7e9b110d (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7283801-16cf-4b6a-aadb-bf92bb1ce95a (dataset): DatasetConfig { id: d7283801-16cf-4b6a-aadb-bf92bb1ce95a (dataset), name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d73b9e89-1723-4a17-83f8-8edb26266c60 (dataset): DatasetConfig { id: d73b9e89-1723-4a17-83f8-8edb26266c60 (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, daabf456-a148-467f-862c-fb6da073c47b (dataset): DatasetConfig { id: daabf456-a148-467f-862c-fb6da073c47b (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df082a7c-fd83-4a5a-9880-342b8ddbd84c (dataset): DatasetConfig { id: df082a7c-fd83-4a5a-9880-342b8ddbd84c (dataset), name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e7f55426-9c22-4f4b-bf7c-c1afb976ff0c (dataset): DatasetConfig { id: e7f55426-9c22-4f4b-bf7c-c1afb976ff0c (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, eb475757-17a8-404d-980b-3395f23cdeef (dataset): DatasetConfig { id: eb475757-17a8-404d-980b-3395f23cdeef (dataset), name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ebacb530-45fe-4192-a80b-d8478b0ac96a (dataset): DatasetConfig { id: ebacb530-45fe-4192-a80b-d8478b0ac96a (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4567513-008b-4b7f-9f83-c62b181e6338 (dataset): DatasetConfig { id: f4567513-008b-4b7f-9f83-c62b181e6338 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8f6a1d4-c5f3-48c7-9a9c-7b6013b0df04 (dataset): DatasetConfig { id: f8f6a1d4-c5f3-48c7-9a9c-7b6013b0df04 (dataset), name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, faba7add-dc2d-4889-9b82-649aed51125c (dataset): DatasetConfig { id: faba7add-dc2d-4889-9b82-649aed51125c (dataset), name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe5656f6-e312-4946-b4ef-02882c7aa8b2 (dataset): DatasetConfig { id: fe5656f6-e312-4946-b4ef-02882c7aa8b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462024-12-21T00:15:09.399ZINFOSledAgent (StorageManager): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-21T00:15:09.399ZINFOSledAgent (StorageManager): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-21T00:15:09.399ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492024-12-21T00:15:09.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502024-12-21T00:15:09.414ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512024-12-21T00:15:09.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone/oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), full_name: "oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone/oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5" } file = sled-storage/src/manager.rs:1431
4522024-12-21T00:15:09.450ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
4532024-12-21T00:15:09.470ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542024-12-21T00:15:09.470ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552024-12-21T00:15:09.470ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4562024-12-21T00:15:09.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572024-12-21T00:15:09.519ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582024-12-21T00:15:09.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4592024-12-21T00:15:09.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602024-12-21T00:15:09.571ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612024-12-21T00:15:09.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4622024-12-21T00:15:09.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632024-12-21T00:15:09.631ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4642024-12-21T00:15:09.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8504df1b-d5a7-40bd-ad45-c55449857140/crucible" } file = sled-storage/src/manager.rs:1431
4652024-12-21T00:15:09.683ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662024-12-21T00:15:09.683ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672024-12-21T00:15:09.683ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4" } file = sled-storage/src/manager.rs:1431
4682024-12-21T00:15:09.743ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692024-12-21T00:15:09.743ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702024-12-21T00:15:09.743ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed" } file = sled-storage/src/manager.rs:1431
4712024-12-21T00:15:09.805ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722024-12-21T00:15:09.805ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732024-12-21T00:15:09.805ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f" } file = sled-storage/src/manager.rs:1431
4742024-12-21T00:15:09.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752024-12-21T00:15:09.865ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762024-12-21T00:15:09.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8504df1b-d5a7-40bd-ad45-c55449857140/crypt/zone/oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a"), full_name: "oxp_8504df1b-d5a7-40bd-ad45-c55449857140/crypt/zone/oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a" } file = sled-storage/src/manager.rs:1431
4772024-12-21T00:15:09.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782024-12-21T00:15:09.924ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792024-12-21T00:15:09.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/debug"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/debug" } file = sled-storage/src/manager.rs:1431
4802024-12-21T00:15:09.953ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812024-12-21T00:15:09.953ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822024-12-21T00:15:09.953ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4832024-12-21T00:15:10.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842024-12-21T00:15:10.001ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4852024-12-21T00:15:10.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/debug"), full_name: "oxp_30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/debug" } file = sled-storage/src/manager.rs:1431
4862024-12-21T00:15:10.030ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872024-12-21T00:15:10.030ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882024-12-21T00:15:10.030ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db606984-291b-40d5-964e-14a228d68e45/crypt/debug"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/debug" } file = sled-storage/src/manager.rs:1431
4892024-12-21T00:15:10.059ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902024-12-21T00:15:10.059ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912024-12-21T00:15:10.059ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4922024-12-21T00:15:10.110ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932024-12-21T00:15:10.110ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942024-12-21T00:15:10.110ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crucible" } file = sled-storage/src/manager.rs:1431
4952024-12-21T00:15:10.157ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962024-12-21T00:15:10.157ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972024-12-21T00:15:10.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db606984-291b-40d5-964e-14a228d68e45/crypt/zone/oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/zone/oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e" } file = sled-storage/src/manager.rs:1431
4982024-12-21T00:15:10.216ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992024-12-21T00:15:10.216ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002024-12-21T00:15:10.216ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336" } file = sled-storage/src/manager.rs:1431
5012024-12-21T00:15:10.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022024-12-21T00:15:10.274ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032024-12-21T00:15:10.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crucible" } file = sled-storage/src/manager.rs:1431
5042024-12-21T00:15:10.322ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052024-12-21T00:15:10.322ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062024-12-21T00:15:10.322ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone/oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64"), full_name: "oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone/oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64" } file = sled-storage/src/manager.rs:1431
5072024-12-21T00:15:10.379ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082024-12-21T00:15:10.379ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092024-12-21T00:15:10.379ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081" } file = sled-storage/src/manager.rs:1431
5102024-12-21T00:15:10.437ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112024-12-21T00:15:10.437ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122024-12-21T00:15:10.437ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5132024-12-21T00:15:10.452ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
5142024-12-21T00:15:10.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152024-12-21T00:15:10.487ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162024-12-21T00:15:10.487ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72" } file = sled-storage/src/manager.rs:1431
5172024-12-21T00:15:10.545ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182024-12-21T00:15:10.545ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192024-12-21T00:15:10.545ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db606984-291b-40d5-964e-14a228d68e45/crypt/zone/oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/zone/oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef" } file = sled-storage/src/manager.rs:1431
5202024-12-21T00:15:10.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212024-12-21T00:15:10.603ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222024-12-21T00:15:10.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/zone/oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35"), full_name: "oxp_30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/zone/oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35" } file = sled-storage/src/manager.rs:1431
5232024-12-21T00:15:10.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242024-12-21T00:15:10.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252024-12-21T00:15:10.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9" } file = sled-storage/src/manager.rs:1431
5262024-12-21T00:15:10.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272024-12-21T00:15:10.722ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5282024-12-21T00:15:10.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/debug"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5292024-12-21T00:15:10.749ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302024-12-21T00:15:10.749ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312024-12-21T00:15:10.749ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1" } file = sled-storage/src/manager.rs:1431
5322024-12-21T00:15:10.809ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332024-12-21T00:15:10.809ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5342024-12-21T00:15:10.809ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/debug"), full_name: "oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/debug" } file = sled-storage/src/manager.rs:1431
5352024-12-21T00:15:10.839ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362024-12-21T00:15:10.840ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372024-12-21T00:15:10.840ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5382024-12-21T00:15:10.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392024-12-21T00:15:10.891ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402024-12-21T00:15:10.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461" } file = sled-storage/src/manager.rs:1431
5412024-12-21T00:15:10.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422024-12-21T00:15:10.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432024-12-21T00:15:10.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636" } file = sled-storage/src/manager.rs:1431
5442024-12-21T00:15:11.013ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452024-12-21T00:15:11.013ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462024-12-21T00:15:11.013ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da" } file = sled-storage/src/manager.rs:1431
5472024-12-21T00:15:11.073ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482024-12-21T00:15:11.073ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492024-12-21T00:15:11.073ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone" } file = sled-storage/src/manager.rs:1431
5502024-12-21T00:15:11.101ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512024-12-21T00:15:11.101ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5522024-12-21T00:15:11.101ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8504df1b-d5a7-40bd-ad45-c55449857140/crypt/zone"), full_name: "oxp_8504df1b-d5a7-40bd-ad45-c55449857140/crypt/zone" } file = sled-storage/src/manager.rs:1431
5532024-12-21T00:15:11.131ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542024-12-21T00:15:11.131ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552024-12-21T00:15:11.131ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5562024-12-21T00:15:11.181ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572024-12-21T00:15:11.181ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582024-12-21T00:15:11.181ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_96dd6601-21c1-4f69-a871-ce8980776531/crucible" } file = sled-storage/src/manager.rs:1431
5592024-12-21T00:15:11.229ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602024-12-21T00:15:11.230ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5612024-12-21T00:15:11.230ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db606984-291b-40d5-964e-14a228d68e45/crypt/zone"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/zone" } file = sled-storage/src/manager.rs:1431
5622024-12-21T00:15:11.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632024-12-21T00:15:11.258ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642024-12-21T00:15:11.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crucible" } file = sled-storage/src/manager.rs:1431
5652024-12-21T00:15:11.303ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662024-12-21T00:15:11.303ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672024-12-21T00:15:11.303ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone/oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293" } file = sled-storage/src/manager.rs:1431
5682024-12-21T00:15:11.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692024-12-21T00:15:11.361ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702024-12-21T00:15:11.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_30f2f8a7-d49b-4582-9153-44098dd8db06/crucible" } file = sled-storage/src/manager.rs:1431
5712024-12-21T00:15:11.408ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722024-12-21T00:15:11.408ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732024-12-21T00:15:11.408ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crucible" } file = sled-storage/src/manager.rs:1431
5742024-12-21T00:15:11.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5752024-12-21T00:15:11.454ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5762024-12-21T00:15:11.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone" } file = sled-storage/src/manager.rs:1431
5772024-12-21T00:15:11.457ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
5782024-12-21T00:15:11.483ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-21T00:15:11.483ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802024-12-21T00:15:11.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crucible" } file = sled-storage/src/manager.rs:1431
5812024-12-21T00:15:11.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822024-12-21T00:15:11.531ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832024-12-21T00:15:11.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a" } file = sled-storage/src/manager.rs:1431
5842024-12-21T00:15:11.590ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852024-12-21T00:15:11.590ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5862024-12-21T00:15:11.590ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/debug"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/debug" } file = sled-storage/src/manager.rs:1431
5872024-12-21T00:15:11.618ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882024-12-21T00:15:11.618ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892024-12-21T00:15:11.618ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce" } file = sled-storage/src/manager.rs:1431
5902024-12-21T00:15:11.678ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912024-12-21T00:15:11.678ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5922024-12-21T00:15:11.678ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone"), full_name: "oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/zone" } file = sled-storage/src/manager.rs:1431
5932024-12-21T00:15:11.706ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942024-12-21T00:15:11.706ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952024-12-21T00:15:11.706ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db606984-291b-40d5-964e-14a228d68e45/crypt/zone/oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/zone/oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d" } file = sled-storage/src/manager.rs:1431
5962024-12-21T00:15:11.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972024-12-21T00:15:11.764ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982024-12-21T00:15:11.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5992024-12-21T00:15:11.814ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002024-12-21T00:15:11.814ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6012024-12-21T00:15:11.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/debug"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/debug" } file = sled-storage/src/manager.rs:1431
6022024-12-21T00:15:11.842ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032024-12-21T00:15:11.842ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042024-12-21T00:15:11.842ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153" } file = sled-storage/src/manager.rs:1431
6052024-12-21T00:15:11.903ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062024-12-21T00:15:11.903ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072024-12-21T00:15:11.903ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56" } file = sled-storage/src/manager.rs:1431
6082024-12-21T00:15:11.961ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092024-12-21T00:15:11.961ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102024-12-21T00:15:11.961ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/zone/oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392" } file = sled-storage/src/manager.rs:1431
6112024-12-21T00:15:12.019ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122024-12-21T00:15:12.019ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6132024-12-21T00:15:12.019ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crucible" } file = sled-storage/src/manager.rs:1431
6142024-12-21T00:15:12.066ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152024-12-21T00:15:12.066ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6162024-12-21T00:15:12.066ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd" } file = sled-storage/src/manager.rs:1431
6172024-12-21T00:15:12.125ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182024-12-21T00:15:12.125ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6192024-12-21T00:15:12.125ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/zone"), full_name: "oxp_30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/zone" } file = sled-storage/src/manager.rs:1431
6202024-12-21T00:15:12.153ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212024-12-21T00:15:12.153ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222024-12-21T00:15:12.153ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/zone/oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b" } file = sled-storage/src/manager.rs:1431
6232024-12-21T00:15:12.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242024-12-21T00:15:12.214ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6252024-12-21T00:15:12.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96dd6601-21c1-4f69-a871-ce8980776531/crypt/zone"), full_name: "oxp_96dd6601-21c1-4f69-a871-ce8980776531/crypt/zone" } file = sled-storage/src/manager.rs:1431
6262024-12-21T00:15:12.242ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272024-12-21T00:15:12.242ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6282024-12-21T00:15:12.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8504df1b-d5a7-40bd-ad45-c55449857140/crypt/debug"), full_name: "oxp_8504df1b-d5a7-40bd-ad45-c55449857140/crypt/debug" } file = sled-storage/src/manager.rs:1431
6292024-12-21T00:15:12.270ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302024-12-21T00:15:12.270ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6312024-12-21T00:15:12.270ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96dd6601-21c1-4f69-a871-ce8980776531/crypt/debug"), full_name: "oxp_96dd6601-21c1-4f69-a871-ce8980776531/crypt/debug" } file = sled-storage/src/manager.rs:1431
6322024-12-21T00:15:12.298ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332024-12-21T00:15:12.298ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6342024-12-21T00:15:12.298ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone"), full_name: "oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/zone" } file = sled-storage/src/manager.rs:1431
6352024-12-21T00:15:12.327ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362024-12-21T00:15:12.327ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6372024-12-21T00:15:12.327ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone" } file = sled-storage/src/manager.rs:1431
6382024-12-21T00:15:12.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6392024-12-21T00:15:12.354ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6402024-12-21T00:15:12.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269"), full_name: "oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/zone/oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269" } file = sled-storage/src/manager.rs:1431
6412024-12-21T00:15:12.415ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6422024-12-21T00:15:12.415ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6432024-12-21T00:15:12.415ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_db606984-291b-40d5-964e-14a228d68e45/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6442024-12-21T00:15:12.459ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
6452024-12-21T00:15:12.464ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462024-12-21T00:15:12.464ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472024-12-21T00:15:12.464ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6482024-12-21T00:15:12.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492024-12-21T00:15:12.512ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502024-12-21T00:15:12.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96dd6601-21c1-4f69-a871-ce8980776531/crypt/zone/oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742"), full_name: "oxp_96dd6601-21c1-4f69-a871-ce8980776531/crypt/zone/oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742" } file = sled-storage/src/manager.rs:1431
6512024-12-21T00:15:12.571ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522024-12-21T00:15:12.572ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532024-12-21T00:15:12.572ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
6542024-12-21T00:15:12.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3173316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36519 req_id = 6b595c47-8856-4517-99d7-8f02d09849f9 response_code = 200 uri = /datasets
6552024-12-21T00:15:12.604ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: dc4ff2cf-ea9e-4712-9b04-a7dae9001392 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 55ab552b-1ee4-4e5b-9abb-60c1f61a0461 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b4abb0af-25f6-4c6c-815c-15cf2ec22293 (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6562024-12-21T00:15:12.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44251
6572024-12-21T00:15:12.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582024-12-21T00:15:12.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592024-12-21T00:15:12.614ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602024-12-21T00:15:12.614ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-12-21T00:15:12.622ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622024-12-21T00:15:12.622ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-12-21T00:15:12.631ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642024-12-21T00:15:12.631ZINFOSledAgent (ServiceManager): No ledger in /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-12-21T00:15:12.631ZINFOSledAgent (ServiceManager): No ledger in /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-12-21T00:15:12.631ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672024-12-21T00:15:12.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-21T00:15:12.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T00:15:12.674ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-21T00:15:12.726ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293 file = illumos-utils/src/zone.rs:325
6712024-12-21T00:15:12.730ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461 file = illumos-utils/src/zone.rs:325
6722024-12-21T00:15:12.734ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392 file = illumos-utils/src/zone.rs:325
6732024-12-21T00:15:12.747ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293 file = illumos-utils/src/zone.rs:363
6742024-12-21T00:15:12.751ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461 file = illumos-utils/src/zone.rs:363
6752024-12-21T00:15:12.755ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392 file = illumos-utils/src/zone.rs:363
6762024-12-21T00:15:13.461ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3) file = sled-agent/src/probe_manager.rs:231 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
6772024-12-21T00:15:14.313ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782024-12-21T00:15:14.313ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6792024-12-21T00:15:14.792ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802024-12-21T00:15:14.792ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
6812024-12-21T00:15:14.795ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822024-12-21T00:15:15.236ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6503977298491904856 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
6832024-12-21T00:15:15.237ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 928197658715517542 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
6842024-12-21T00:15:15.278ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-12-21T00:15:15.278ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
6862024-12-21T00:15:15.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 69.45671ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
6872024-12-21T00:15:15.294ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6882024-12-21T00:15:15.294ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
6892024-12-21T00:15:15.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 54.375934ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
6902024-12-21T00:15:15.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 47.633846ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
6912024-12-21T00:15:15.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 41.358993ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
6922024-12-21T00:15:15.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 151.116368ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
6932024-12-21T00:15:15.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 132.141335ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
6942024-12-21T00:15:15.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 114.516794ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
6952024-12-21T00:15:15.702ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6962024-12-21T00:15:15.709ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6972024-12-21T00:15:15.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 120.935849ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
6982024-12-21T00:15:15.740ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6992024-12-21T00:15:15.741ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
7002024-12-21T00:15:15.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 194.699157ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7012024-12-21T00:15:15.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 546.474908ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
7022024-12-21T00:15:15.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 429.338838ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
7032024-12-21T00:15:15.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 597.657009ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7042024-12-21T00:15:16.019ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
7052024-12-21T00:15:16.020ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
7062024-12-21T00:15:16.064ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
7072024-12-21T00:15:16.065ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
7082024-12-21T00:15:16.122ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7092024-12-21T00:15:16.122ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7102024-12-21T00:15:16.150ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7112024-12-21T00:15:16.150ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7122024-12-21T00:15:16.225ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7132024-12-21T00:15:16.225ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7142024-12-21T00:15:16.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 1.12925142s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
7152024-12-21T00:15:16.322ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7162024-12-21T00:15:16.322ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7172024-12-21T00:15:16.355ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7182024-12-21T00:15:16.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 1.035836786s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
7192024-12-21T00:15:16.392ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202024-12-21T00:15:16.392ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212024-12-21T00:15:16.392ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7222024-12-21T00:15:16.392ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232024-12-21T00:15:16.430ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7242024-12-21T00:15:16.486ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7252024-12-21T00:15:16.486ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262024-12-21T00:15:16.486ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462024-12-21T00:15:16.487ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472024-12-21T00:15:16.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 968.093365ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7482024-12-21T00:15:16.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18404268949976698426 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
7492024-12-21T00:15:16.684ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16983613855386893869 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
7502024-12-21T00:15:17.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 944.44268ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
7512024-12-21T00:15:17.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 726.912783ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
7522024-12-21T00:15:17.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 508.587997ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7532024-12-21T00:15:18.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 763.030808ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7542024-12-21T00:15:18.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 911.570353ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
7552024-12-21T00:15:18.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 1.441996004s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
7562024-12-21T00:15:18.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461") failed: Property not found. retry in 1.381780486s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7572024-12-21T00:15:19.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293") failed: Property not found. retry in 1.48806973s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
7582024-12-21T00:15:19.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392") failed: Property not found. retry in 898.818659ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
7592024-12-21T00:15:20.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_b4abb0af-25f6-4c6c-815c-15cf2ec22293
7602024-12-21T00:15:20.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_55ab552b-1ee4-4e5b-9abb-60c1f61a0461
7612024-12-21T00:15:20.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_dc4ff2cf-ea9e-4712-9b04-a7dae9001392
7622024-12-21T00:15:20.741ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632024-12-21T00:15:20.741ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642024-12-21T00:15:20.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8137176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44251 req_id = 90bc218c-5c33-4527-bb4a-35179ba41247 response_code = 204 uri = /omicron-zones
7652024-12-21T00:15:20.743ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7662024-12-21T00:15:20.922ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 136.098865ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7672024-12-21T00:15:21.076ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682024-12-21T00:15:21.182ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 81.363733ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7692024-12-21T00:15:21.280ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702024-12-21T00:15:21.310ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 146.084002ms) dns_config_addr = [fd00:1122:3344:3::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:3::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712024-12-21T00:15:21.476ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7722024-12-21T00:15:21.476ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7732024-12-21T00:15:21.507ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7742024-12-21T00:15:21.508ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7752024-12-21T00:15:21.508ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7762024-12-21T00:15:21.537ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: dc4ff2cf-ea9e-4712-9b04-a7dae9001392 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 55ab552b-1ee4-4e5b-9abb-60c1f61a0461 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b4abb0af-25f6-4c6c-815c-15cf2ec22293 (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ccd7e387-2cbf-400c-bdd1-d34eaba15b0a (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: ea2a5a90-4620-4783-b17c-e23d54b44517, kind: Service { id: ccd7e387-2cbf-400c-bdd1-d34eaba15b0a }, name: Name("ntp-ccd7e387-2cbf-400c-bdd1-d34eaba15b0a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 213])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7772024-12-21T00:15:21.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49846
7782024-12-21T00:15:21.538ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792024-12-21T00:15:21.538ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802024-12-21T00:15:21.548ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812024-12-21T00:15:21.548ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822024-12-21T00:15:21.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-21T00:15:21.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-21T00:15:21.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7852024-12-21T00:15:21.565ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
7862024-12-21T00:15:21.565ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
7872024-12-21T00:15:21.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7882024-12-21T00:15:21.577ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7892024-12-21T00:15:21.609ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7902024-12-21T00:15:21.609ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7912024-12-21T00:15:21.609ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7922024-12-21T00:15:21.639ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 212, 213]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7932024-12-21T00:15:21.639ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7942024-12-21T00:15:21.639ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7952024-12-21T00:15:21.639ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7962024-12-21T00:15:21.640ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7972024-12-21T00:15:21.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7982024-12-21T00:15:21.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a file = illumos-utils/src/zone.rs:325
7992024-12-21T00:15:21.684ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a file = illumos-utils/src/zone.rs:363
8002024-12-21T00:15:22.299ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8012024-12-21T00:15:22.299ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8022024-12-21T00:15:22.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 27.798706ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8032024-12-21T00:15:22.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 105.739923ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8042024-12-21T00:15:22.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 149.313303ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8052024-12-21T00:15:22.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 470.616068ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8062024-12-21T00:15:23.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 858.576714ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8072024-12-21T00:15:24.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 1.201539822s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8082024-12-21T00:15:25.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6503977298491904856 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8092024-12-21T00:15:25.239ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 928197658715517542 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8102024-12-21T00:15:25.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 809.832991ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8112024-12-21T00:15:26.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 648.977106ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8122024-12-21T00:15:26.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18404268949976698426 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8132024-12-21T00:15:26.687ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16983613855386893869 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8142024-12-21T00:15:26.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 963.755642ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8152024-12-21T00:15:27.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a") failed: Property not found. retry in 1.083146927s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8162024-12-21T00:15:28.876ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a
8172024-12-21T00:15:28.876ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182024-12-21T00:15:28.876ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192024-12-21T00:15:28.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7338869 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49846 req_id = 7ede7f5f-a4ef-494c-8b09-3ec31b7fbd30 response_code = 204 uri = /omicron-zones
8202024-12-21T00:15:28.879ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8212024-12-21T00:15:28.909ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222024-12-21T00:15:28.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63566
8232024-12-21T00:15:28.918ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8242024-12-21T00:15:28.918ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63566 req_id = 9c722f1b-cd68-4a52-afa5-3c59d8817800 response_code = 500 uri = /timesync
8252024-12-21T00:15:28.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8262024-12-21T00:15:29.039ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-21T00:15:29.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42125
8282024-12-21T00:15:30.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229318743076386008 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8292024-12-21T00:15:30.639ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1428232282330113299 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8302024-12-21T00:15:30.743ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16795303947646262088 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8312024-12-21T00:15:33.047ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8322024-12-21T00:15:33.047ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4007863 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42125 req_id = 6a258ad0-fa10-4382-96ac-215286c27ff2 response_code = 500 uri = /timesync
8332024-12-21T00:15:33.050ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8342024-12-21T00:15:33.198ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8352024-12-21T00:15:33.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36154
8362024-12-21T00:15:33.207ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8372024-12-21T00:15:33.207ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8936 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36154 req_id = 0539899f-8b7b-49de-a08a-c7428de77d78 response_code = 500 uri = /timesync
8382024-12-21T00:15:33.210ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392024-12-21T00:15:33.420ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402024-12-21T00:15:33.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60614
8412024-12-21T00:15:33.429ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ccd7e387-2cbf-400c-bdd1-d34eaba15b0a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8422024-12-21T00:15:33.429ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8532 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60614 req_id = 4f17f132-ca00-4914-bc0c-a01df69b24a2 response_code = 500 uri = /timesync
8432024-12-21T00:15:33.432ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442024-12-21T00:15:33.650ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452024-12-21T00:15:33.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60879
8462024-12-21T00:15:35.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6503977298491904856 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8472024-12-21T00:15:35.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 928197658715517542 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8482024-12-21T00:15:36.494ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18404268949976698426 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8492024-12-21T00:15:36.494ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16983613855386893869 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8502024-12-21T00:15:37.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4008482 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60879 req_id = 971e587d-c711-4020-a9fd-28a4baf83afd response_code = 200 uri = /timesync
8512024-12-21T00:15:37.468ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.057980046 } file = sled-agent/src/rack_setup/service.rs:743
8522024-12-21T00:15:37.468ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532024-12-21T00:15:37.805ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542024-12-21T00:15:37.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37872
8552024-12-21T00:15:37.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37872 req_id = b8419cf1-e804-4a58-b984-df6e0323a4ec response_code = 200 uri = /timesync
8562024-12-21T00:15:37.817ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.057033923 } file = sled-agent/src/rack_setup/service.rs:743
8572024-12-21T00:15:37.817ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-21T00:15:38.038ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-21T00:15:38.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51172
8602024-12-21T00:15:38.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8815 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51172 req_id = beca9ffe-aaa6-4e74-a05f-acd5490e534f response_code = 200 uri = /timesync
8612024-12-21T00:15:38.051ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.056313056 } file = sled-agent/src/rack_setup/service.rs:743
8622024-12-21T00:15:38.051ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-21T00:15:38.411ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-21T00:15:38.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63961
8652024-12-21T00:15:38.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63961 req_id = 2d2aedd9-9ffd-418c-97ad-f39ec9e2a51d response_code = 200 uri = /timesync
8662024-12-21T00:15:38.421ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.055308271 } file = sled-agent/src/rack_setup/service.rs:743
8672024-12-21T00:15:38.421ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-21T00:15:38.689ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12206634097050054226 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8692024-12-21T00:15:38.690ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1558395307777315872 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8702024-12-21T00:15:38.974ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8712024-12-21T00:15:38.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35429
8722024-12-21T00:15:38.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8071 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35429 req_id = c7c6a908-2fed-447c-a2f1-2dcbd92bb1eb response_code = 200 uri = /timesync
8732024-12-21T00:15:38.984ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.053785611 } file = sled-agent/src/rack_setup/service.rs:743
8742024-12-21T00:15:38.984ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8752024-12-21T00:15:39.333ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762024-12-21T00:15:39.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49750
8772024-12-21T00:15:39.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49750 req_id = 3681dd74-5986-42fe-8506-2fb8790842cc response_code = 200 uri = /timesync
8782024-12-21T00:15:39.344ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.052822657 } file = sled-agent/src/rack_setup/service.rs:743
8792024-12-21T00:15:39.344ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802024-12-21T00:15:40.063ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2229318743076386008 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8812024-12-21T00:15:40.141ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8822024-12-21T00:15:40.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42057
8832024-12-21T00:15:40.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42057 req_id = 48c049a5-0182-4f9b-b17a-33bed4bab771 response_code = 200 uri = /timesync
8842024-12-21T00:15:40.152ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.048871107 } file = sled-agent/src/rack_setup/service.rs:743
8852024-12-21T00:15:40.152ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8862024-12-21T00:15:40.455ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1428232282330113299 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8872024-12-21T00:15:40.559ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16795303947646262088 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
8882024-12-21T00:15:40.645ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8892024-12-21T00:15:40.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58927
8902024-12-21T00:15:40.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58927 req_id = a8a3c688-f9af-4ad5-8df5-b4462dd3eb97 response_code = 200 uri = /timesync
8912024-12-21T00:15:40.655ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.047513589 } file = sled-agent/src/rack_setup/service.rs:743
8922024-12-21T00:15:40.655ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8932024-12-21T00:15:41.743ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8942024-12-21T00:15:41.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39088
8952024-12-21T00:15:41.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39088 req_id = c90fdbd8-f4f9-4dee-85bc-5303a1f49449 response_code = 200 uri = /timesync
8962024-12-21T00:15:41.767ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2180654074, ip_addr: 129.250.35.250, stratum: 3, ref_time: 1734740140.587037, correction: 0.044306412 } file = sled-agent/src/rack_setup/service.rs:743
8972024-12-21T00:15:41.767ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8982024-12-21T00:15:41.798ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: dc4ff2cf-ea9e-4712-9b04-a7dae9001392 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 55ab552b-1ee4-4e5b-9abb-60c1f61a0461 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b4abb0af-25f6-4c6c-815c-15cf2ec22293 (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ccd7e387-2cbf-400c-bdd1-d34eaba15b0a (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: ea2a5a90-4620-4783-b17c-e23d54b44517, kind: Service { id: ccd7e387-2cbf-400c-bdd1-d34eaba15b0a }, name: Name("ntp-ccd7e387-2cbf-400c-bdd1-d34eaba15b0a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 213])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e79134c2-5609-488f-bf0f-9d25439a6aa4 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66a21e2f-011a-4911-94a4-60223079a336 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } } } }, OmicronZoneConfig { id: 45406af0-64d3-4380-bd4f-37d1916b072f (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } } } }, OmicronZoneConfig { id: cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef (service), filesystem_pool: Some(ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External } } } }, OmicronZoneConfig { id: e25154a0-a423-4181-be92-93f6aa455269 (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8992024-12-21T00:15:41.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59152
9002024-12-21T00:15:41.798ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9012024-12-21T00:15:41.798ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9022024-12-21T00:15:41.809ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9032024-12-21T00:15:41.809ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9042024-12-21T00:15:41.818ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9052024-12-21T00:15:41.818ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9062024-12-21T00:15:41.827ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9072024-12-21T00:15:41.827ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9082024-12-21T00:15:41.837ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9092024-12-21T00:15:41.837ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9102024-12-21T00:15:41.847ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9112024-12-21T00:15:41.847ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9122024-12-21T00:15:41.855ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9132024-12-21T00:15:41.855ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9142024-12-21T00:15:41.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9152024-12-21T00:15:41.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9162024-12-21T00:15:41.874ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172024-12-21T00:15:41.874ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
9182024-12-21T00:15:41.875ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
9192024-12-21T00:15:41.875ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202024-12-21T00:15:41.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212024-12-21T00:15:41.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9222024-12-21T00:15:41.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9232024-12-21T00:15:41.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9242024-12-21T00:15:41.958ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9252024-12-21T00:15:42.052ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269 file = illumos-utils/src/zone.rs:325
9262024-12-21T00:15:42.056ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4 file = illumos-utils/src/zone.rs:325
9272024-12-21T00:15:42.061ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336 file = illumos-utils/src/zone.rs:325
9282024-12-21T00:15:42.065ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f file = illumos-utils/src/zone.rs:325
9292024-12-21T00:15:42.070ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef file = illumos-utils/src/zone.rs:325
9302024-12-21T00:15:42.075ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269 file = illumos-utils/src/zone.rs:363
9312024-12-21T00:15:42.079ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4 file = illumos-utils/src/zone.rs:363
9322024-12-21T00:15:42.084ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336 file = illumos-utils/src/zone.rs:363
9332024-12-21T00:15:42.088ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f file = illumos-utils/src/zone.rs:363
9342024-12-21T00:15:42.093ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef file = illumos-utils/src/zone.rs:363
9352024-12-21T00:15:45.165ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e79134c2-5609-488f-bf0f-9d25439a6aa4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9362024-12-21T00:15:45.165ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9372024-12-21T00:15:45.186ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e25154a0-a423-4181-be92-93f6aa455269'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382024-12-21T00:15:45.186ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9392024-12-21T00:15:45.199ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='45406af0-64d3-4380-bd4f-37d1916b072f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9402024-12-21T00:15:45.199ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9412024-12-21T00:15:45.205ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9422024-12-21T00:15:45.205ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9432024-12-21T00:15:45.305ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='66a21e2f-011a-4911-94a4-60223079a336'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9442024-12-21T00:15:45.305ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9452024-12-21T00:15:45.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 47.920804ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9462024-12-21T00:15:45.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 73.250654ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9472024-12-21T00:15:45.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 55.324016ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9482024-12-21T00:15:45.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 71.533638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9492024-12-21T00:15:45.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 73.331974ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9502024-12-21T00:15:45.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 93.345054ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9512024-12-21T00:15:45.570ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 299.003467ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
9522024-12-21T00:15:45.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 82.529884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9532024-12-21T00:15:45.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 138.772917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9542024-12-21T00:15:46.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 217.160356ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9552024-12-21T00:15:46.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 99.790159ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9562024-12-21T00:15:46.447ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41632
9572024-12-21T00:15:46.447ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41632 req_id = 480771e4-732c-4831-8092-2e1b911cb968 response_code = 200 uri = /baseboard
9582024-12-21T00:15:46.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 220.880471ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9592024-12-21T00:15:46.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 363.858186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9602024-12-21T00:15:46.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 47.319843ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9612024-12-21T00:15:46.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 422.952739ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9622024-12-21T00:15:46.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 287.931044ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9632024-12-21T00:15:46.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 148.50822ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9642024-12-21T00:15:46.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 227.724444ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9652024-12-21T00:15:46.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 248.163067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9662024-12-21T00:15:46.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.092636163s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9672024-12-21T00:15:46.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 211.91616ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9682024-12-21T00:15:46.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 446.037209ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9692024-12-21T00:15:47.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.199099834s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9702024-12-21T00:15:47.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 230.413724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9712024-12-21T00:15:47.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 544.586469ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9722024-12-21T00:15:47.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.034197967s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9732024-12-21T00:15:47.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.341267578s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9742024-12-21T00:15:47.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 618.716581ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9752024-12-21T00:15:47.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.062253106s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9762024-12-21T00:15:48.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 922.350358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9772024-12-21T00:15:48.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 900.302011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9782024-12-21T00:15:48.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 709.209569ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9792024-12-21T00:15:48.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.189080627s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9802024-12-21T00:15:49.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.497499158s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9812024-12-21T00:15:49.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 664.536724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9822024-12-21T00:15:49.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 558.084742ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9832024-12-21T00:15:49.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 1.470562174s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9842024-12-21T00:15:49.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.326031064s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9852024-12-21T00:15:49.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.141687299s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9862024-12-21T00:15:49.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 612.444459ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9872024-12-21T00:15:50.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 828.320211ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9882024-12-21T00:15:50.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 807.074205ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9892024-12-21T00:15:50.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 1.430554732s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9902024-12-21T00:15:50.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 520.898385ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9912024-12-21T00:15:51.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.153406468s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9922024-12-21T00:15:51.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.436678462s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
9932024-12-21T00:15:51.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 702.523702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9942024-12-21T00:15:51.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.314999282s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9952024-12-21T00:15:52.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.433975499s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
9962024-12-21T00:15:52.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 715.544764ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
9972024-12-21T00:15:52.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.177425643s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
9982024-12-21T00:15:52.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 665.162255ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
9992024-12-21T00:15:52.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.274942399s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10002024-12-21T00:15:52.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 1.047788144s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10012024-12-21T00:15:53.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.251178008s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10022024-12-21T00:15:53.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 860.618583ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10032024-12-21T00:15:53.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 923.382924ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10042024-12-21T00:15:53.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 1.05360684s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10052024-12-21T00:15:54.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 990.597421ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10062024-12-21T00:15:54.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.297254368s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10072024-12-21T00:15:54.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.078197398s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10082024-12-21T00:15:54.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.019132085s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10092024-12-21T00:15:55.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 1.164478187s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10102024-12-21T00:15:55.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.481622551s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10112024-12-21T00:15:55.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.253346486s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10122024-12-21T00:15:55.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.231062749s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10132024-12-21T00:15:55.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 515.242276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10142024-12-21T00:15:56.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 709.930168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10152024-12-21T00:15:56.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.452518138s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10162024-12-21T00:15:56.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 867.968005ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10172024-12-21T00:15:56.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.004423002s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10182024-12-21T00:15:56.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.406165375s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10192024-12-21T00:15:56.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 991.884372ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10202024-12-21T00:15:57.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.189883433s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10212024-12-21T00:15:57.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 1.099637984s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10222024-12-21T00:15:57.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 1.03109683s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10232024-12-21T00:15:57.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 1.059389951s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10242024-12-21T00:15:58.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 898.235766ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10252024-12-21T00:15:58.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269") failed: Property not found. retry in 1.349842266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10262024-12-21T00:15:58.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f") failed: Property not found. retry in 866.928126ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10272024-12-21T00:15:58.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4") failed: Property not found. retry in 950.363634ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10282024-12-21T00:15:59.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef") failed: Property not found. retry in 908.814192ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10292024-12-21T00:15:59.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336") failed: Property not found. retry in 1.261764273s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10302024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_e25154a0-a423-4181-be92-93f6aa455269
10312024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_e79134c2-5609-488f-bf0f-9d25439a6aa4
10322024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_66a21e2f-011a-4911-94a4-60223079a336
10332024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f
10342024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef
10352024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10362024-12-21T00:16:00.517ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10372024-12-21T00:16:00.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18675233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59152 req_id = d85b0e16-4077-4059-9e90-5914ff3798f1 response_code = 204 uri = /omicron-zones
10382024-12-21T00:16:00.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65478
10392024-12-21T00:16:00.580ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = 6d819ddc-d99a-469f-90dc-13d85da6880c response_code = 500 uri = /cockroachdb
10402024-12-21T00:16:00.581ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6d819ddc-d99a-469f-90dc-13d85da6880c", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6d819ddc-d99a-469f-90dc-13d85da6880c" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 86.001216ms
10412024-12-21T00:16:00.694ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = 55a5e941-6c54-44f3-964d-38110b8bbb28 response_code = 500 uri = /cockroachdb
10422024-12-21T00:16:00.694ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "55a5e941-6c54-44f3-964d-38110b8bbb28", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "55a5e941-6c54-44f3-964d-38110b8bbb28" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 155.576094ms
10432024-12-21T00:16:00.877ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = 6d77e1a5-25ee-424b-ac5a-2c90b718fa0f response_code = 500 uri = /cockroachdb
10442024-12-21T00:16:00.877ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6d77e1a5-25ee-424b-ac5a-2c90b718fa0f", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6d77e1a5-25ee-424b-ac5a-2c90b718fa0f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 104.107382ms
10452024-12-21T00:16:01.008ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26222 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = ae41d452-4f77-487f-8657-9364cb9a014f response_code = 500 uri = /cockroachdb
10462024-12-21T00:16:01.009ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ae41d452-4f77-487f-8657-9364cb9a014f", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ae41d452-4f77-487f-8657-9364cb9a014f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 220.830231ms
10472024-12-21T00:16:01.258ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = c985d0f0-6922-444b-850e-e5cffb6a1cdf response_code = 500 uri = /cockroachdb
10482024-12-21T00:16:01.258ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c985d0f0-6922-444b-850e-e5cffb6a1cdf", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c985d0f0-6922-444b-850e-e5cffb6a1cdf" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 232.24129ms
10492024-12-21T00:16:01.517ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = ed8784c5-2f30-41d6-b663-49ae88a181bf response_code = 500 uri = /cockroachdb
10502024-12-21T00:16:01.517ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ed8784c5-2f30-41d6-b663-49ae88a181bf", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ed8784c5-2f30-41d6-b663-49ae88a181bf" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 281.499131ms
10512024-12-21T00:16:01.520ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 401.346944ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
10522024-12-21T00:16:01.826ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27013 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = b8f66d9a-ffe4-4c77-b0a8-ffdf992ad5b5 response_code = 500 uri = /cockroachdb
10532024-12-21T00:16:01.827ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b8f66d9a-ffe4-4c77-b0a8-ffdf992ad5b5", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b8f66d9a-ffe4-4c77-b0a8-ffdf992ad5b5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 412.370727ms
10542024-12-21T00:16:02.265ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25440 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = 42928ca6-6219-430f-be67-4c1f7c904d70 response_code = 500 uri = /cockroachdb
10552024-12-21T00:16:02.266ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "42928ca6-6219-430f-be67-4c1f7c904d70", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "42928ca6-6219-430f-be67-4c1f7c904d70" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 208.335355ms
10562024-12-21T00:16:02.501ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = d9526880-9d0d-447e-99fc-f23f53672f61 response_code = 500 uri = /cockroachdb
10572024-12-21T00:16:02.501ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d9526880-9d0d-447e-99fc-f23f53672f61", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d9526880-9d0d-447e-99fc-f23f53672f61" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 468.123311ms
10582024-12-21T00:16:03.004ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 33732 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = 442463be-0f82-433c-bf45-a2b3ce71bac8 response_code = 500 uri = /cockroachdb
10592024-12-21T00:16:03.004ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "442463be-0f82-433c-bf45-a2b3ce71bac8", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "442463be-0f82-433c-bf45-a2b3ce71bac8" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 528.11528ms
10602024-12-21T00:16:03.558ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_45406af0-64d3-4380-bd4f-37d1916b072f /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = a2c48f78-e64a-4dee-83a1-ae6b3dc6b3af response_code = 500 uri = /cockroachdb
10612024-12-21T00:16:03.558ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a2c48f78-e64a-4dee-83a1-ae6b3dc6b3af", "content-length": "124", "date": "Sat, 21 Dec 2024 00:16:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a2c48f78-e64a-4dee-83a1-ae6b3dc6b3af" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 926.348038ms
10622024-12-21T00:16:04.516ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3758
10632024-12-21T00:16:14.128ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10642024-12-21T00:16:18.640ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10652024-12-21T00:16:18.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14156712 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:65478 req_id = 02b7afc0-7fbc-454a-b3b9-d6acb28909cd response_code = 204 uri = /cockroachdb
10662024-12-21T00:16:18.646ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39644
10672024-12-21T00:16:18.647ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 575 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39644 req_id = c978a8d4-6a6b-42b6-a65d-9243281a0b24 response_code = 200 uri = /baseboard
10682024-12-21T00:16:18.663ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.103397983s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
10692024-12-21T00:16:18.697ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: dc4ff2cf-ea9e-4712-9b04-a7dae9001392 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 55ab552b-1ee4-4e5b-9abb-60c1f61a0461 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: b4abb0af-25f6-4c6c-815c-15cf2ec22293 (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ccd7e387-2cbf-400c-bdd1-d34eaba15b0a (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: ea2a5a90-4620-4783-b17c-e23d54b44517, kind: Service { id: ccd7e387-2cbf-400c-bdd1-d34eaba15b0a }, name: Name("ntp-ccd7e387-2cbf-400c-bdd1-d34eaba15b0a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 212, 213])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: e79134c2-5609-488f-bf0f-9d25439a6aa4 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66a21e2f-011a-4911-94a4-60223079a336 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } } } }, OmicronZoneConfig { id: 45406af0-64d3-4380-bd4f-37d1916b072f (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } } } }, OmicronZoneConfig { id: cd9bdd43-36f7-4ebb-9fe1-ad69c52e4eef (service), filesystem_pool: Some(ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External } } } }, OmicronZoneConfig { id: e25154a0-a423-4181-be92-93f6aa455269 (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 2455a969-e1b3-4c7e-950a-619db01e265b (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 (service), filesystem_pool: Some(ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: daba7770-826f-4668-845b-d5a56b28a4da (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c87c1761-8b9f-4711-941e-05b68d81f15d (service), filesystem_pool: Some(ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 7640851e-47ed-4bb8-8c56-480d800da5ed (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: b3b3a8de-f745-4959-836e-142fc2f35a72 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } } } }, OmicronZoneConfig { id: d19eb6b5-eacf-4b65-bb72-d39f9c82cadd (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 6cd24330-ba72-467e-80f7-177e207ea4ce (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 28a3e178-182d-4afd-8c6e-917da2804a56 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: fd04f315-5604-41b4-b567-c30c5bf393c1 (service), filesystem_pool: Some(ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External } } } }, OmicronZoneConfig { id: a24b4924-d264-494e-afb2-18cd8c43f153 (service), filesystem_pool: Some(ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External } } } }, OmicronZoneConfig { id: ed2af987-1d32-40f2-a4a1-d00fa4099ea9 (service), filesystem_pool: Some(ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0e7abe31-ae21-4461-b74e-ed0e976f967e (service), filesystem_pool: Some(ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External } } } }, OmicronZoneConfig { id: c701e67a-b8cc-4215-a9a7-4111b67eb636 (service), filesystem_pool: Some(ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 991350e2-6fb8-4ba4-b78f-5ff83ecb2742 (service), filesystem_pool: Some(ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External } } } }, OmicronZoneConfig { id: b7186b59-38a0-453f-acf2-a1d3459fff6a (service), filesystem_pool: Some(ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External } } } }, OmicronZoneConfig { id: 54aaf7ad-300c-451b-9bb2-e83694e79b64 (service), filesystem_pool: Some(ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 38919fd8-ed9f-4938-b0ce-1587b7303a35 (service), filesystem_pool: Some(ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10702024-12-21T00:16:18.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52425
10712024-12-21T00:16:18.700ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10722024-12-21T00:16:18.700ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10732024-12-21T00:16:18.714ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10742024-12-21T00:16:18.714ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10752024-12-21T00:16:18.723ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10762024-12-21T00:16:18.723ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10772024-12-21T00:16:18.734ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10782024-12-21T00:16:18.734ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10792024-12-21T00:16:18.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10802024-12-21T00:16:18.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10812024-12-21T00:16:18.754ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10822024-12-21T00:16:18.754ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10832024-12-21T00:16:18.763ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10842024-12-21T00:16:18.763ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10852024-12-21T00:16:18.773ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10862024-12-21T00:16:18.773ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10872024-12-21T00:16:18.785ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10882024-12-21T00:16:18.785ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10892024-12-21T00:16:18.795ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10902024-12-21T00:16:18.795ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10912024-12-21T00:16:18.806ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10922024-12-21T00:16:18.806ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10932024-12-21T00:16:18.815ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10942024-12-21T00:16:18.816ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, kind: Crucible }, responder: ... }
10952024-12-21T00:16:18.826ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10962024-12-21T00:16:18.826ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, kind: Crucible }, responder: ... }
10972024-12-21T00:16:18.835ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10982024-12-21T00:16:18.835ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, kind: Crucible }, responder: ... }
10992024-12-21T00:16:18.844ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11002024-12-21T00:16:18.844ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, kind: Crucible }, responder: ... }
11012024-12-21T00:16:18.855ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11022024-12-21T00:16:18.855ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, kind: Crucible }, responder: ... }
11032024-12-21T00:16:18.866ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11042024-12-21T00:16:18.866ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, kind: Crucible }, responder: ... }
11052024-12-21T00:16:18.875ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11062024-12-21T00:16:18.875ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, kind: Crucible }, responder: ... }
11072024-12-21T00:16:18.887ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11082024-12-21T00:16:18.887ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11092024-12-21T00:16:18.899ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11102024-12-21T00:16:18.899ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, kind: Crucible }, responder: ... }
11112024-12-21T00:16:18.911ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11122024-12-21T00:16:18.911ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
11132024-12-21T00:16:18.912ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
11142024-12-21T00:16:18.912ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11152024-12-21T00:16:19.030ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11162024-12-21T00:16:19.033ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11172024-12-21T00:16:19.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11182024-12-21T00:16:19.046ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11192024-12-21T00:16:19.047ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11202024-12-21T00:16:19.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212024-12-21T00:16:19.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11222024-12-21T00:16:19.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11232024-12-21T00:16:19.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11242024-12-21T00:16:19.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11252024-12-21T00:16:19.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262024-12-21T00:16:19.279ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11272024-12-21T00:16:19.279ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282024-12-21T00:16:19.279ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292024-12-21T00:16:19.279ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302024-12-21T00:16:19.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312024-12-21T00:16:19.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11322024-12-21T00:16:19.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11332024-12-21T00:16:19.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342024-12-21T00:16:19.318ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56 file = illumos-utils/src/zone.rs:325
11352024-12-21T00:16:19.324ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64 file = illumos-utils/src/zone.rs:325
11362024-12-21T00:16:19.329ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742 file = illumos-utils/src/zone.rs:325
11372024-12-21T00:16:19.335ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9 file = illumos-utils/src/zone.rs:325
11382024-12-21T00:16:19.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a file = illumos-utils/src/zone.rs:325
11392024-12-21T00:16:19.346ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce file = illumos-utils/src/zone.rs:325
11402024-12-21T00:16:19.351ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed file = illumos-utils/src/zone.rs:325
11412024-12-21T00:16:19.504ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56 file = illumos-utils/src/zone.rs:363
11422024-12-21T00:16:19.510ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64 file = illumos-utils/src/zone.rs:363
11432024-12-21T00:16:19.515ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742 file = illumos-utils/src/zone.rs:363
11442024-12-21T00:16:19.520ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9 file = illumos-utils/src/zone.rs:363
11452024-12-21T00:16:19.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a file = illumos-utils/src/zone.rs:363
11462024-12-21T00:16:19.531ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce file = illumos-utils/src/zone.rs:363
11472024-12-21T00:16:19.536ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed file = illumos-utils/src/zone.rs:363
11482024-12-21T00:16:19.541ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1 file = illumos-utils/src/zone.rs:325
11492024-12-21T00:16:19.547ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e file = illumos-utils/src/zone.rs:325
11502024-12-21T00:16:19.552ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153 file = illumos-utils/src/zone.rs:325
11512024-12-21T00:16:19.557ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72 file = illumos-utils/src/zone.rs:325
11522024-12-21T00:16:19.563ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd file = illumos-utils/src/zone.rs:325
11532024-12-21T00:16:19.569ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636 file = illumos-utils/src/zone.rs:325
11542024-12-21T00:16:19.575ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35 file = illumos-utils/src/zone.rs:325
11552024-12-21T00:16:19.637ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11562024-12-21T00:16:19.638ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1 file = illumos-utils/src/zone.rs:363
11572024-12-21T00:16:19.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e file = illumos-utils/src/zone.rs:363
11582024-12-21T00:16:19.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153 file = illumos-utils/src/zone.rs:363
11592024-12-21T00:16:19.673ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72 file = illumos-utils/src/zone.rs:363
11602024-12-21T00:16:19.687ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd file = illumos-utils/src/zone.rs:363
11612024-12-21T00:16:19.701ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636 file = illumos-utils/src/zone.rs:363
11622024-12-21T00:16:19.710ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35 file = illumos-utils/src/zone.rs:363
11632024-12-21T00:16:19.782ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11642024-12-21T00:16:19.850ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11652024-12-21T00:16:19.909ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11662024-12-21T00:16:19.974ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11672024-12-21T00:16:19.979ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11682024-12-21T00:16:19.979ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11692024-12-21T00:16:20.039ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 185, 105]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11702024-12-21T00:16:20.039ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11712024-12-21T00:16:20.045ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11722024-12-21T00:16:20.045ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11732024-12-21T00:16:20.101ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 228, 248]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11742024-12-21T00:16:20.101ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11752024-12-21T00:16:20.103ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11762024-12-21T00:16:20.103ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11772024-12-21T00:16:20.158ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 157, 44]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11782024-12-21T00:16:20.158ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11792024-12-21T00:16:20.160ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11802024-12-21T00:16:20.160ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11812024-12-21T00:16:20.214ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 250, 40]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11822024-12-21T00:16:20.214ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11832024-12-21T00:16:20.216ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11842024-12-21T00:16:20.216ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11852024-12-21T00:16:20.290ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 233, 76]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11862024-12-21T00:16:20.290ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11872024-12-21T00:16:20.290ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11882024-12-21T00:16:20.290ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11892024-12-21T00:16:20.291ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11902024-12-21T00:16:20.291ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11912024-12-21T00:16:20.291ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11922024-12-21T00:16:20.291ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11932024-12-21T00:16:20.292ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11942024-12-21T00:16:20.292ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11952024-12-21T00:16:20.314ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11962024-12-21T00:16:20.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11972024-12-21T00:16:20.316ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11982024-12-21T00:16:20.316ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11992024-12-21T00:16:20.380ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12002024-12-21T00:16:20.384ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12012024-12-21T00:16:20.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12022024-12-21T00:16:20.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12032024-12-21T00:16:20.387ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12042024-12-21T00:16:20.390ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12052024-12-21T00:16:20.398ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12062024-12-21T00:16:20.398ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12072024-12-21T00:16:20.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b file = illumos-utils/src/zone.rs:325
12082024-12-21T00:16:20.695ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 file = illumos-utils/src/zone.rs:325
12092024-12-21T00:16:20.712ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081 file = illumos-utils/src/zone.rs:325
12102024-12-21T00:16:20.731ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da file = illumos-utils/src/zone.rs:325
12112024-12-21T00:16:20.750ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d file = illumos-utils/src/zone.rs:325
12122024-12-21T00:16:20.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b file = illumos-utils/src/zone.rs:363
12132024-12-21T00:16:20.771ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 file = illumos-utils/src/zone.rs:363
12142024-12-21T00:16:20.781ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081 file = illumos-utils/src/zone.rs:363
12152024-12-21T00:16:20.790ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da file = illumos-utils/src/zone.rs:363
12162024-12-21T00:16:20.798ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d file = illumos-utils/src/zone.rs:363
12172024-12-21T00:16:28.335ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_96dd6601-21c1-4f69-a871-ce8980776531/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dd6cb0c6-97c9-4b39-a732-5adf29123a82'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12182024-12-21T00:16:28.336ZINFOSledAgent (ServiceManager): Booting oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
12192024-12-21T00:16:28.345ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='14fabbf6-9344-4504-b3e7-41b4c0aa374b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202024-12-21T00:16:28.345ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8504df1b-d5a7-40bd-ad45-c55449857140/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c6024787-9002-40c2-870a-a66134c2d7cd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12212024-12-21T00:16:28.346ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_db606984-291b-40d5-964e-14a228d68e45/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f982a805-ca36-4d5c-9ac5-484375d9c121'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222024-12-21T00:16:28.347ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12232024-12-21T00:16:28.347ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8ddcdd4a-94ae-456d-b5bf-759a63ffb464'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12242024-12-21T00:16:28.348ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_30f2f8a7-d49b-4582-9153-44098dd8db06/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='df71efca-6b38-434c-826e-afc6cc1598c2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252024-12-21T00:16:28.348ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b3c5770f-c2a5-4687-9844-df947021ecd9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='68035b3e-faee-41a1-a74c-9879c51eba2c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12262024-12-21T00:16:28.349ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
12272024-12-21T00:16:28.360ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
12282024-12-21T00:16:28.367ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
12292024-12-21T00:16:28.375ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
12302024-12-21T00:16:28.382ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
12312024-12-21T00:16:28.390ZINFOSledAgent (ServiceManager): Booting oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
12322024-12-21T00:16:28.398ZINFOSledAgent (ServiceManager): Booting oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
12332024-12-21T00:16:28.592ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='7640851e-47ed-4bb8-8c56-480d800da5ed'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-12-21T00:16:28.592ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
12352024-12-21T00:16:28.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 51.738622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
12362024-12-21T00:16:28.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 37.634021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
12372024-12-21T00:16:28.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 48.722158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
12382024-12-21T00:16:28.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 48.931285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
12392024-12-21T00:16:28.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 34.839843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
12402024-12-21T00:16:29.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 45.957118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
12412024-12-21T00:16:29.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 41.376172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
12422024-12-21T00:16:29.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 27.956167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
12432024-12-21T00:16:29.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 127.786457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
12442024-12-21T00:16:29.186ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12452024-12-21T00:16:29.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 63.244792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
12462024-12-21T00:16:29.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 55.294466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
12472024-12-21T00:16:29.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 121.867299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
12482024-12-21T00:16:29.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 79.540561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
12492024-12-21T00:16:29.233ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12502024-12-21T00:16:29.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 38.151968ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
12512024-12-21T00:16:29.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 92.706708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
12522024-12-21T00:16:29.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 117.776351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
12532024-12-21T00:16:29.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 117.43617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
12542024-12-21T00:16:29.290ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
12552024-12-21T00:16:29.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 251.471926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
12562024-12-21T00:16:29.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 201.476848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
12572024-12-21T00:16:29.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 140.4261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
12582024-12-21T00:16:29.352ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
12592024-12-21T00:16:29.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 141.216845ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
12602024-12-21T00:16:29.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 227.957964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
12612024-12-21T00:16:29.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 199.604254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
12622024-12-21T00:16:29.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 129.176105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
12632024-12-21T00:16:29.414ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9a11160d-22ea-4d84-8062-212ac0c81eaf'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12642024-12-21T00:16:29.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 179.494945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
12652024-12-21T00:16:29.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 149.819501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
12662024-12-21T00:16:29.442ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
12672024-12-21T00:16:29.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 400.990989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
12682024-12-21T00:16:29.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 187.816881ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
12692024-12-21T00:16:29.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 590.057764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
12702024-12-21T00:16:29.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 300.48679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
12712024-12-21T00:16:29.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 215.597325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
12722024-12-21T00:16:29.594ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9c56d02c-7544-4011-8e1b-1d25faf5ba7a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12732024-12-21T00:16:29.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 206.789524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
12742024-12-21T00:16:29.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 527.298409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
12752024-12-21T00:16:29.632ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
12762024-12-21T00:16:29.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 402.894899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
12772024-12-21T00:16:29.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 477.157893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
12782024-12-21T00:16:29.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 46.052369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
12792024-12-21T00:16:29.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 25.474899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
12802024-12-21T00:16:29.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 236.021369ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
12812024-12-21T00:16:29.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 90.473191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
12822024-12-21T00:16:29.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 79.478888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
12832024-12-21T00:16:29.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 54.240624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
12842024-12-21T00:16:29.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 579.643212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
12852024-12-21T00:16:29.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.106187722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
12862024-12-21T00:16:29.857ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12872024-12-21T00:16:29.858ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
12882024-12-21T00:16:29.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 159.166154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
12892024-12-21T00:16:29.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 778.135549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
12902024-12-21T00:16:29.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.120498866s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
12912024-12-21T00:16:29.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 149.291837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
12922024-12-21T00:16:29.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 123.176252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
12932024-12-21T00:16:29.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 44.095448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
12942024-12-21T00:16:30.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 568.210341ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
12952024-12-21T00:16:30.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 106.114563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
12962024-12-21T00:16:30.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 412.168684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
12972024-12-21T00:16:30.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 615.080653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
12982024-12-21T00:16:30.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 476.168262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
12992024-12-21T00:16:30.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 219.303384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
13002024-12-21T00:16:30.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 407.144268ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
13012024-12-21T00:16:30.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 158.732973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13022024-12-21T00:16:30.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.050238402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
13032024-12-21T00:16:30.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 644.721917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
13042024-12-21T00:16:30.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 41.338611ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13052024-12-21T00:16:30.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.255761361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
13062024-12-21T00:16:30.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 56.987993ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13072024-12-21T00:16:30.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 303.506944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13082024-12-21T00:16:30.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 262.117108ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13092024-12-21T00:16:30.592ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13102024-12-21T00:16:30.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 712.409271ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
13112024-12-21T00:16:30.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 245.630728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
13122024-12-21T00:16:30.629ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13132024-12-21T00:16:30.629ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13142024-12-21T00:16:30.640ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13152024-12-21T00:16:30.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 896.019222ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
13162024-12-21T00:16:30.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 750.911053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
13172024-12-21T00:16:30.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.46364781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
13182024-12-21T00:16:30.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.165668546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
13192024-12-21T00:16:30.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 339.903063ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13202024-12-21T00:16:30.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 721.948626ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
13212024-12-21T00:16:30.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.015185169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
13222024-12-21T00:16:30.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 616.983345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13232024-12-21T00:16:30.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 72.643527ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13242024-12-21T00:16:30.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 918.336114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
13252024-12-21T00:16:31.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 56.126777ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13262024-12-21T00:16:31.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 86.440479ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13272024-12-21T00:16:31.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.079082688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
13282024-12-21T00:16:31.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 541.85116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
13292024-12-21T00:16:31.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 81.559836ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13302024-12-21T00:16:31.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 232.170981ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13312024-12-21T00:16:31.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 223.712698ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13322024-12-21T00:16:31.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 892.961125ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13332024-12-21T00:16:31.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 748.773703ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
13342024-12-21T00:16:31.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 446.21571ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13352024-12-21T00:16:31.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.383958431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
13362024-12-21T00:16:31.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 596.851111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13372024-12-21T00:16:31.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 770.460956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
13382024-12-21T00:16:31.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.294771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13392024-12-21T00:16:31.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.207084531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
13402024-12-21T00:16:31.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 728.630777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
13412024-12-21T00:16:31.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 896.424952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
13422024-12-21T00:16:31.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 791.19967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
13432024-12-21T00:16:31.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 942.722815ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13442024-12-21T00:16:31.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.312521794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
13452024-12-21T00:16:31.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.237590655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
13462024-12-21T00:16:31.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.17941121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
13472024-12-21T00:16:32.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 511.435026ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13482024-12-21T00:16:32.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 845.545759ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
13492024-12-21T00:16:32.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.295805607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
13502024-12-21T00:16:32.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 954.915435ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13512024-12-21T00:16:32.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 864.207493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
13522024-12-21T00:16:32.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.038770625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
13532024-12-21T00:16:32.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.104757499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
13542024-12-21T00:16:32.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 790.896699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
13552024-12-21T00:16:32.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.278906846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
13562024-12-21T00:16:32.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 773.003985ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13572024-12-21T00:16:32.724ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13582024-12-21T00:16:32.724ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
13592024-12-21T00:16:32.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.394014975s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13602024-12-21T00:16:32.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.417212084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
13612024-12-21T00:16:32.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 592.865494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
13622024-12-21T00:16:32.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 763.682581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13632024-12-21T00:16:32.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.172056143s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
13642024-12-21T00:16:33.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 48.534583ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
13652024-12-21T00:16:33.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 70.20207ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
13662024-12-21T00:16:33.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.039647148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
13672024-12-21T00:16:33.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.027303848s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13682024-12-21T00:16:33.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 151.899185ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
13692024-12-21T00:16:33.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.114637656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
13702024-12-21T00:16:33.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 503.13795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
13712024-12-21T00:16:33.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.351162799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
13722024-12-21T00:16:33.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.479719033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
13732024-12-21T00:16:33.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 503.314163ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
13742024-12-21T00:16:33.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.463006985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
13752024-12-21T00:16:33.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.208112106s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13762024-12-21T00:16:33.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 740.800784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
13772024-12-21T00:16:33.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 528.251838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
13782024-12-21T00:16:33.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.435457594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
13792024-12-21T00:16:33.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 772.34827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13802024-12-21T00:16:33.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 749.434588ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
13812024-12-21T00:16:33.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.118651512s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
13822024-12-21T00:16:33.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.240545181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
13832024-12-21T00:16:34.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 929.221903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
13842024-12-21T00:16:34.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.31432102s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
13852024-12-21T00:16:34.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.392344527s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
13862024-12-21T00:16:34.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 810.79028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
13872024-12-21T00:16:34.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.099595252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
13882024-12-21T00:16:34.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.026706063s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
13892024-12-21T00:16:34.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 887.279882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
13902024-12-21T00:16:34.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 726.543422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
13912024-12-21T00:16:34.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.217269737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
13922024-12-21T00:16:34.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.418436283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
13932024-12-21T00:16:34.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 762.549576ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
13942024-12-21T00:16:34.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.422532735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
13952024-12-21T00:16:34.716ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13962024-12-21T00:16:34.716ZINFOSledAgent (ServiceManager): Booting oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
13972024-12-21T00:16:34.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.422808635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
13982024-12-21T00:16:34.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 542.355107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
13992024-12-21T00:16:34.994ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.757916067s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
14002024-12-21T00:16:35.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 598.593523ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
14012024-12-21T00:16:35.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 26.231949ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14022024-12-21T00:16:35.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 640.273175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
14032024-12-21T00:16:35.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 883.96266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
14042024-12-21T00:16:35.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.405983082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
14052024-12-21T00:16:35.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 795.493779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
14062024-12-21T00:16:35.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 50.200391ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14072024-12-21T00:16:35.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 634.214422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
14082024-12-21T00:16:35.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 197.698166ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14092024-12-21T00:16:35.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.273992594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
14102024-12-21T00:16:35.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 871.902958ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
14112024-12-21T00:16:35.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.327490809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
14122024-12-21T00:16:35.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 319.356316ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14132024-12-21T00:16:35.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.490180971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
14142024-12-21T00:16:35.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.060737484s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
14152024-12-21T00:16:35.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 886.282968ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
14162024-12-21T00:16:35.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 834.570676ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
14172024-12-21T00:16:35.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.038602553s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
14182024-12-21T00:16:35.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.202509458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
14192024-12-21T00:16:35.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 938.984049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14202024-12-21T00:16:35.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 876.675688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
14212024-12-21T00:16:35.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.05447388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
14222024-12-21T00:16:35.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.07074321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
14232024-12-21T00:16:35.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.079880884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
14242024-12-21T00:16:35.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.28436624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
14252024-12-21T00:16:36.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 748.447559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
14262024-12-21T00:16:36.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.083133834s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
14272024-12-21T00:16:36.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 867.963419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
14282024-12-21T00:16:36.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.264215739s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
14292024-12-21T00:16:36.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.321394406s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
14302024-12-21T00:16:36.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.440258417s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
14312024-12-21T00:16:36.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.431934677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
14322024-12-21T00:16:36.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 882.551991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
14332024-12-21T00:16:36.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.155532667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
14342024-12-21T00:16:36.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 535.721359ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14352024-12-21T00:16:36.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 557.977468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
14362024-12-21T00:16:36.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.072931578s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
14372024-12-21T00:16:36.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 961.571717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
14382024-12-21T00:16:36.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.28646275s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
14392024-12-21T00:16:36.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.033212065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
14402024-12-21T00:16:36.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.315745505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
14412024-12-21T00:16:36.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 546.322161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
14422024-12-21T00:16:36.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 565.089568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
14432024-12-21T00:16:37.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 692.033527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
14442024-12-21T00:16:37.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 857.381859ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14452024-12-21T00:16:37.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.033813845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
14462024-12-21T00:16:37.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 612.5716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
14472024-12-21T00:16:37.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.291755323s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
14482024-12-21T00:16:37.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.275574749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
14492024-12-21T00:16:37.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.019889579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
14502024-12-21T00:16:37.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.035111873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
14512024-12-21T00:16:37.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.298979875s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
14522024-12-21T00:16:37.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.425562426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
14532024-12-21T00:16:37.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 677.122243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
14542024-12-21T00:16:37.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 693.010068ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
14552024-12-21T00:16:37.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.272661207s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
14562024-12-21T00:16:37.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.394587905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
14572024-12-21T00:16:37.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.243750929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
14582024-12-21T00:16:37.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.130004459s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
14592024-12-21T00:16:37.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.121578581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
14602024-12-21T00:16:37.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.267668981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
14612024-12-21T00:16:38.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 972.389902ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14622024-12-21T00:16:38.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.431814125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
14632024-12-21T00:16:38.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.402144911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
14642024-12-21T00:16:38.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 637.457066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
14652024-12-21T00:16:38.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.479357504s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
14662024-12-21T00:16:38.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.463076102s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
14672024-12-21T00:16:38.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 530.144787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
14682024-12-21T00:16:38.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 988.705234ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
14692024-12-21T00:16:38.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 569.593815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
14702024-12-21T00:16:38.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 965.207793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
14712024-12-21T00:16:38.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.47447012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
14722024-12-21T00:16:38.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.116313895s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
14732024-12-21T00:16:38.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 1.004784032s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14742024-12-21T00:16:39.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 653.69439ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
14752024-12-21T00:16:39.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 930.012936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
14762024-12-21T00:16:39.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.320970335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
14772024-12-21T00:16:39.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.450811902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
14782024-12-21T00:16:39.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 828.573845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
14792024-12-21T00:16:39.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 695.941917ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
14802024-12-21T00:16:39.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 608.263888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
14812024-12-21T00:16:39.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 806.27893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
14822024-12-21T00:16:39.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.078176701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
14832024-12-21T00:16:39.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 594.885065ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
14842024-12-21T00:16:39.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.141271565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
14852024-12-21T00:16:39.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.004927851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
14862024-12-21T00:16:39.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 931.631749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
14872024-12-21T00:16:39.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 797.343136ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
14882024-12-21T00:16:39.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.230955005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
14892024-12-21T00:16:39.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.309995714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
14902024-12-21T00:16:39.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.495893879s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
14912024-12-21T00:16:39.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 596.545953ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
14922024-12-21T00:16:39.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.359291329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
14932024-12-21T00:16:39.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 899.686118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
14942024-12-21T00:16:40.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 771.796646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
14952024-12-21T00:16:40.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.23835985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
14962024-12-21T00:16:40.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.151259691s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
14972024-12-21T00:16:40.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 772.734963ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
14982024-12-21T00:16:40.176ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14992024-12-21T00:16:40.177ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15002024-12-21T00:16:40.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.385275892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
15012024-12-21T00:16:40.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.085703492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
15022024-12-21T00:16:40.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 591.736284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
15032024-12-21T00:16:40.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 37.549832ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15042024-12-21T00:16:40.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 74.595749ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15052024-12-21T00:16:40.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.122246361s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
15062024-12-21T00:16:40.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.041272525s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
15072024-12-21T00:16:40.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.188558879s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
15082024-12-21T00:16:40.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 175.101243ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15092024-12-21T00:16:40.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 819.626173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
15102024-12-21T00:16:40.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.063853543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
15112024-12-21T00:16:40.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 447.184934ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15122024-12-21T00:16:40.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 659.816984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
15132024-12-21T00:16:40.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 838.237873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
15142024-12-21T00:16:40.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 749.345088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
15152024-12-21T00:16:40.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.314913936s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
15162024-12-21T00:16:41.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.419359914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
15172024-12-21T00:16:41.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 550.517273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
15182024-12-21T00:16:41.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.306523029s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
15192024-12-21T00:16:41.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 554.797086ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15202024-12-21T00:16:41.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 674.30458ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
15212024-12-21T00:16:41.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.187835947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
15222024-12-21T00:16:41.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 515.258905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
15232024-12-21T00:16:41.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.49193522s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
15242024-12-21T00:16:41.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.114151172s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
15252024-12-21T00:16:41.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.34073248s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
15262024-12-21T00:16:41.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 992.437708ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
15272024-12-21T00:16:41.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.138411869s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
15282024-12-21T00:16:41.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.362801226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
15292024-12-21T00:16:41.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 828.196706ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
15302024-12-21T00:16:41.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 826.671397ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
15312024-12-21T00:16:41.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.053536894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
15322024-12-21T00:16:41.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 706.237772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
15332024-12-21T00:16:41.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.164778881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
15342024-12-21T00:16:41.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.164346807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
15352024-12-21T00:16:41.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 941.155517ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15362024-12-21T00:16:41.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 853.336519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
15372024-12-21T00:16:41.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.307690253s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
15382024-12-21T00:16:42.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 658.022894ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
15392024-12-21T00:16:42.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 713.881924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
15402024-12-21T00:16:42.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 849.376023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
15412024-12-21T00:16:42.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.169164843s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
15422024-12-21T00:16:42.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 896.260755ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
15432024-12-21T00:16:42.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.310249895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
15442024-12-21T00:16:42.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 956.710606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
15452024-12-21T00:16:42.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.087904167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
15462024-12-21T00:16:42.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.048351392s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
15472024-12-21T00:16:42.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.048648268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
15482024-12-21T00:16:42.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 708.155776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
15492024-12-21T00:16:42.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 989.362267ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15502024-12-21T00:16:42.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.104472571s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
15512024-12-21T00:16:42.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 915.831262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
15522024-12-21T00:16:42.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 677.32438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
15532024-12-21T00:16:42.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.098776062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
15542024-12-21T00:16:42.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 773.780775ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
15552024-12-21T00:16:42.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 960.916181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
15562024-12-21T00:16:42.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 785.682819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
15572024-12-21T00:16:43.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 820.039787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
15582024-12-21T00:16:43.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 703.493493ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
15592024-12-21T00:16:43.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.292099338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
15602024-12-21T00:16:43.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 874.141602ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
15612024-12-21T00:16:43.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.145883966s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
15622024-12-21T00:16:43.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.199616024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
15632024-12-21T00:16:43.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 733.235018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
15642024-12-21T00:16:43.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 856.992019ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
15652024-12-21T00:16:43.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 581.840303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
15662024-12-21T00:16:43.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 754.176625ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
15672024-12-21T00:16:43.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.240599779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
15682024-12-21T00:16:43.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 672.071877ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
15692024-12-21T00:16:43.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 1.091697614s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15702024-12-21T00:16:43.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.215393812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
15712024-12-21T00:16:43.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.371420111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
15722024-12-21T00:16:43.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.149428369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
15732024-12-21T00:16:43.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.11893485s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
15742024-12-21T00:16:43.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.177483006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
15752024-12-21T00:16:43.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.200822718s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
15762024-12-21T00:16:43.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.350861573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
15772024-12-21T00:16:44.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.043999985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
15782024-12-21T00:16:44.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 760.590391ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
15792024-12-21T00:16:44.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 604.48551ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
15802024-12-21T00:16:44.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.266175983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
15812024-12-21T00:16:44.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.046425268s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
15822024-12-21T00:16:44.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 788.290612ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
15832024-12-21T00:16:44.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 640.687981ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
15842024-12-21T00:16:44.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 988.219324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
15852024-12-21T00:16:44.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 611.405034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
15862024-12-21T00:16:44.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 789.088188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
15872024-12-21T00:16:44.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 619.872611ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
15882024-12-21T00:16:44.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 683.726426ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
15892024-12-21T00:16:44.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.008562915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
15902024-12-21T00:16:44.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.094571024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
15912024-12-21T00:16:44.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.11219822s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
15922024-12-21T00:16:44.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 924.110408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
15932024-12-21T00:16:45.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 726.820004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
15942024-12-21T00:16:45.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.051466035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
15952024-12-21T00:16:45.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 764.095562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
15962024-12-21T00:16:45.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.258853854s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
15972024-12-21T00:16:45.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 1.112811333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
15982024-12-21T00:16:45.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.119583995s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
15992024-12-21T00:16:45.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.16415065s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
16002024-12-21T00:16:45.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 948.38988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
16012024-12-21T00:16:45.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.032107331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
16022024-12-21T00:16:45.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 638.99135ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16032024-12-21T00:16:45.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.49934328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
16042024-12-21T00:16:45.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.021832276s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
16052024-12-21T00:16:45.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 1.263726704s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
16062024-12-21T00:16:45.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.39559363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
16072024-12-21T00:16:45.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 999.147656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
16082024-12-21T00:16:45.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.264578321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
16092024-12-21T00:16:45.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 597.787961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
16102024-12-21T00:16:45.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.294827948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
16112024-12-21T00:16:45.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 733.916808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
16122024-12-21T00:16:46.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.403474588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
16132024-12-21T00:16:46.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 770.468054ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
16142024-12-21T00:16:46.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 556.200131ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16152024-12-21T00:16:46.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 679.904431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
16162024-12-21T00:16:46.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.424130415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
16172024-12-21T00:16:46.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 543.33329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
16182024-12-21T00:16:46.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 596.250687ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
16192024-12-21T00:16:46.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.279550544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
16202024-12-21T00:16:46.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 572.66589ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
16212024-12-21T00:16:46.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.189993884s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
16222024-12-21T00:16:46.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 776.200918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
16232024-12-21T00:16:46.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.487020081s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
16242024-12-21T00:16:46.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 690.361173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
16252024-12-21T00:16:46.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 556.01251ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16262024-12-21T00:16:46.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 898.587022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
16272024-12-21T00:16:46.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.408695664s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
16282024-12-21T00:16:46.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 945.829439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
16292024-12-21T00:16:46.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 545.078133ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
16302024-12-21T00:16:46.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 692.138301ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
16312024-12-21T00:16:46.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.051902789s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
16322024-12-21T00:16:46.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.043940306s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
16332024-12-21T00:16:46.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.320557801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
16342024-12-21T00:16:47.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 902.055451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
16352024-12-21T00:16:47.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 1.329822865s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
16362024-12-21T00:16:47.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.382979703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
16372024-12-21T00:16:47.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 1.283953544s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16382024-12-21T00:16:47.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 849.316415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
16392024-12-21T00:16:47.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 831.849472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
16402024-12-21T00:16:47.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 1.344190641s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
16412024-12-21T00:16:47.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 531.809504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
16422024-12-21T00:16:47.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 682.883893ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
16432024-12-21T00:16:47.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.004276944s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
16442024-12-21T00:16:47.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.350841671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
16452024-12-21T00:16:47.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.003648335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
16462024-12-21T00:16:47.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 856.911241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
16472024-12-21T00:16:47.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 869.724308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
16482024-12-21T00:16:47.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 504.726266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
16492024-12-21T00:16:47.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 750.488137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
16502024-12-21T00:16:48.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.471310511s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
16512024-12-21T00:16:48.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 538.251086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
16522024-12-21T00:16:48.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.190101568s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
16532024-12-21T00:16:48.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 1.323114054s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
16542024-12-21T00:16:48.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.125061877s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
16552024-12-21T00:16:48.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.466313882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
16562024-12-21T00:16:48.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.363884546s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
16572024-12-21T00:16:48.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 979.669848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
16582024-12-21T00:16:48.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 659.050269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
16592024-12-21T00:16:48.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.202043392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
16602024-12-21T00:16:48.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 762.589133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
16612024-12-21T00:16:48.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 1.002693854s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16622024-12-21T00:16:48.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 1.115655967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
16632024-12-21T00:16:48.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.279634599s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
16642024-12-21T00:16:48.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.287347892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
16652024-12-21T00:16:48.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.447341736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
16662024-12-21T00:16:48.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742") failed: Property not found. retry in 676.255455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
16672024-12-21T00:16:48.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 965.992081ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
16682024-12-21T00:16:48.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 1.472240567s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
16692024-12-21T00:16:48.901ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33369
16702024-12-21T00:16:48.932ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9630 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33369 req_id = 6e52a4fc-4597-4e30-b1d3-6a0db464f31a response_code = 200 uri = /baseboard
16712024-12-21T00:16:48.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 1.073361172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
16722024-12-21T00:16:49.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 527.686601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
16732024-12-21T00:16:49.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 885.476518ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
16742024-12-21T00:16:49.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636") failed: Property not found. retry in 1.007322539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
16752024-12-21T00:16:49.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 955.910188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
16762024-12-21T00:16:49.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 870.500547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
16772024-12-21T00:16:49.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 817.661035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
16782024-12-21T00:16:49.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d") failed: Property not found. retry in 1.214574126s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
16792024-12-21T00:16:49.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 915.155621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
16802024-12-21T00:16:49.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 600.761824ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16812024-12-21T00:16:49.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd") failed: Property not found. retry in 1.371989748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
16822024-12-21T00:16:49.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 1.128677908s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
16832024-12-21T00:16:49.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 940.558977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
16842024-12-21T00:16:49.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed") failed: Property not found. retry in 1.29365417s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
16852024-12-21T00:16:49.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64") failed: Property not found. retry in 1.0278158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
16862024-12-21T00:16:49.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 678.77406ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
16872024-12-21T00:16:49.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 527.066736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
16882024-12-21T00:16:50.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce") failed: Property not found. retry in 824.52752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
16892024-12-21T00:16:50.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35") failed: Property not found. retry in 1.086990028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
16902024-12-21T00:16:50.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b") failed: Property not found. retry in 1.389716416s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
16912024-12-21T00:16:50.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 912.912183ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
16922024-12-21T00:16:50.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1") failed: Property not found. retry in 1.485391921s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
16932024-12-21T00:16:50.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da") failed: Property not found. retry in 772.793324ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
16942024-12-21T00:16:50.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56") failed: Property not found. retry in 1.228078356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
16952024-12-21T00:16:50.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9") failed: Property not found. retry in 940.295318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
16962024-12-21T00:16:50.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a") failed: Property not found. retry in 1.285105935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
16972024-12-21T00:16:50.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e") failed: Property not found. retry in 523.922743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
16982024-12-21T00:16:50.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5") failed: Property not found. retry in 1.221647402s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
16992024-12-21T00:16:50.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153") failed: Property not found. retry in 854.265139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
17002024-12-21T00:16:50.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081") failed: Property not found. retry in 561.569329ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
17012024-12-21T00:16:51.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72") failed: Property not found. retry in 936.807811ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
17022024-12-21T00:16:51.874ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.665331835s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
17032024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_2455a969-e1b3-4c7e-950a-619db01e265b
17042024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_28a3e178-182d-4afd-8c6e-917da2804a56
17052024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_b9d305f8-932f-45eb-802f-6ae1f5c4e9d5
17062024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_5dcc4d7f-195b-48bd-af9a-8171e5938081
17072024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_daba7770-826f-4668-845b-d5a56b28a4da
17082024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_54aaf7ad-300c-451b-9bb2-e83694e79b64
17092024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_991350e2-6fb8-4ba4-b78f-5ff83ecb2742
17102024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_ed2af987-1d32-40f2-a4a1-d00fa4099ea9
17112024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_b7186b59-38a0-453f-acf2-a1d3459fff6a
17122024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_6cd24330-ba72-467e-80f7-177e207ea4ce
17132024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_7640851e-47ed-4bb8-8c56-480d800da5ed
17142024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_fd04f315-5604-41b4-b567-c30c5bf393c1
17152024-12-21T00:16:52.093ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_0e7abe31-ae21-4461-b74e-ed0e976f967e
17162024-12-21T00:16:52.094ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a24b4924-d264-494e-afb2-18cd8c43f153
17172024-12-21T00:16:52.094ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_c87c1761-8b9f-4711-941e-05b68d81f15d
17182024-12-21T00:16:52.094ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_b3b3a8de-f745-4959-836e-142fc2f35a72
17192024-12-21T00:16:52.094ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_d19eb6b5-eacf-4b65-bb72-d39f9c82cadd
17202024-12-21T00:16:52.094ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_c701e67a-b8cc-4215-a9a7-4111b67eb636
17212024-12-21T00:16:52.094ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_38919fd8-ed9f-4938-b0ce-1587b7303a35
17222024-12-21T00:16:52.101ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17232024-12-21T00:16:52.107ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17242024-12-21T00:16:52.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33418634 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52425 req_id = d2cb858b-4192-4044-b0f1-8dfb83790128 response_code = 204 uri = /omicron-zones
17252024-12-21T00:16:52.131ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17262024-12-21T00:16:52.383ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17272024-12-21T00:16:52.388ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
17282024-12-21T00:16:52.467ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17292024-12-21T00:16:54.493ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17302024-12-21T00:16:54.639ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17312024-12-21T00:16:54.785ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17322024-12-21T00:16:54.944ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17332024-12-21T00:16:55.114ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17342024-12-21T00:16:55.336ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17352024-12-21T00:16:55.482ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17362024-12-21T00:16:55.698ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17372024-12-21T00:16:55.965ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17382024-12-21T00:16:56.530ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17392024-12-21T00:16:56.577ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.40765385s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
17402024-12-21T00:16:56.961ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17412024-12-21T00:16:57.552ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/a8c36764-00e1-4685-8f8d-23cc231b3f7b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17422024-12-21T00:16:58.788ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "91ec3a08-f581-4691-8626-47c15cd329e3", "content-length": "113", "date": "Sat, 21 Dec 2024 00:16:58 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "91ec3a08-f581-4691-8626-47c15cd329e3" } file = sled-agent/src/rack_setup/service.rs:1078
17432024-12-21T00:16:59.375ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "bef63fca-a1ce-474a-8585-afd60cc6a2db", "content-length": "113", "date": "Sat, 21 Dec 2024 00:16:59 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "bef63fca-a1ce-474a-8585-afd60cc6a2db" } file = sled-agent/src/rack_setup/service.rs:1078
17442024-12-21T00:17:00.719ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6f0f1eac-c8ae-470f-a80b-b90e03a418f7", "content-length": "173", "date": "Sat, 21 Dec 2024 00:16:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"a8c36764-00e1-4685-8f8d-23cc231b3f7b\"", request_id: "6f0f1eac-c8ae-470f-a80b-b90e03a418f7" } file = sled-agent/src/rack_setup/service.rs:1078
17452024-12-21T00:17:03.088ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7acfaf5c-d412-4f14-8639-c197913543a3", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "7acfaf5c-d412-4f14-8639-c197913543a3" } file = sled-agent/src/rack_setup/service.rs:1078
17462024-12-21T00:17:05.768ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3f1b1339-e65d-450a-8892-6464d665faeb", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "3f1b1339-e65d-450a-8892-6464d665faeb" } file = sled-agent/src/rack_setup/service.rs:1078
17472024-12-21T00:17:07.681ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "96bb63e5-5599-4884-a182-167d69819870", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "96bb63e5-5599-4884-a182-167d69819870" } file = sled-agent/src/rack_setup/service.rs:1078
17482024-12-21T00:17:10.267ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f3628642-ea93-433d-a7e7-9e607cf13334", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "f3628642-ea93-433d-a7e7-9e607cf13334" } file = sled-agent/src/rack_setup/service.rs:1078
17492024-12-21T00:17:13.851ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "139b8bec-b42c-480b-aea3-166682c35520", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "139b8bec-b42c-480b-aea3-166682c35520" } file = sled-agent/src/rack_setup/service.rs:1078
17502024-12-21T00:17:16.105ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a8c39dd8-99f2-4def-b92a-3e350064ada1", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "a8c39dd8-99f2-4def-b92a-3e350064ada1" } file = sled-agent/src/rack_setup/service.rs:1078
17512024-12-21T00:17:18.967ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65482
17522024-12-21T00:17:18.967ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65482 req_id = 006982a5-b345-47b4-b95f-97d7eeb825e1 response_code = 200 uri = /baseboard
17532024-12-21T00:17:20.501ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f25b6548-037e-4cb1-82ad-9c8b4daa921b", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "f25b6548-037e-4cb1-82ad-9c8b4daa921b" } file = sled-agent/src/rack_setup/service.rs:1078
17542024-12-21T00:17:26.867ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d3214d4d-523d-49de-af61-c8fa4be866ce", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "d3214d4d-523d-49de-af61-c8fa4be866ce" } file = sled-agent/src/rack_setup/service.rs:1078
17552024-12-21T00:17:30.051ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c710b2b6-6bcd-4454-a786-359c5a2f3fcd", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "c710b2b6-6bcd-4454-a786-359c5a2f3fcd" } file = sled-agent/src/rack_setup/service.rs:1078
17562024-12-21T00:17:36.351ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "668e5bf0-7fa0-4499-826e-84ad081337cc", "content-length": "173", "date": "Sat, 21 Dec 2024 00:17:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3\"", request_id: "668e5bf0-7fa0-4499-826e-84ad081337cc" } file = sled-agent/src/rack_setup/service.rs:1078
17572024-12-21T00:17:37.748ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
17582024-12-21T00:17:37.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47524
17592024-12-21T00:17:37.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17602024-12-21T00:17:37.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17612024-12-21T00:17:37.840ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
17622024-12-21T00:17:37.841ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
17632024-12-21T00:17:37.855ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17642024-12-21T00:17:37.855ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33
17652024-12-21T00:17:37.883ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17662024-12-21T00:17:37.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b
17672024-12-21T00:17:37.905ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17682024-12-21T00:17:37.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19
17692024-12-21T00:17:37.929ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17702024-12-21T00:17:37.929ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db606984-291b-40d5-964e-14a228d68e45
17712024-12-21T00:17:37.950ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17722024-12-21T00:17:37.950ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4
17732024-12-21T00:17:37.971ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17742024-12-21T00:17:37.971ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96dd6601-21c1-4f69-a871-ce8980776531
17752024-12-21T00:17:37.991ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17762024-12-21T00:17:37.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8504df1b-d5a7-40bd-ad45-c55449857140
17772024-12-21T00:17:38.010ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17782024-12-21T00:17:38.010ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3c5770f-c2a5-4687-9844-df947021ecd9
17792024-12-21T00:17:38.030ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17802024-12-21T00:17:38.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30f2f8a7-d49b-4582-9153-44098dd8db06
17812024-12-21T00:17:38.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204053 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47524 req_id = deb72fb1-995c-4cd4-a245-f9c347b7e8df response_code = 200 uri = /inventory
17822024-12-21T00:17:44.856ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:36671 remote_addr = [fd00:1122:3344:101::d]:63436 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
17832024-12-21T00:17:44.895ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39278 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = d6e8cff6-342f-4c22-b671-421d2ba2696b response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
17842024-12-21T00:17:46.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39907
17852024-12-21T00:17:46.737ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17862024-12-21T00:17:46.737ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17872024-12-21T00:17:46.738ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17882024-12-21T00:17:46.738ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17892024-12-21T00:17:46.738ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17902024-12-21T00:17:46.738ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17912024-12-21T00:17:46.738ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17922024-12-21T00:17:46.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4846 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39907 req_id = 2dbb7560-3686-4324-a4df-ef7fad1464e8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17932024-12-21T00:17:46.739ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
17942024-12-21T00:17:46.742ZINFOSledAgent (RSS): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17952024-12-21T00:17:46.742ZINFOSledAgent (RSS): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17962024-12-21T00:17:46.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45946
17972024-12-21T00:17:46.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17982024-12-21T00:17:46.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17992024-12-21T00:17:46.990ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
18002024-12-21T00:17:46.991ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
18012024-12-21T00:17:47.003ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18022024-12-21T00:17:47.003ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33
18032024-12-21T00:17:47.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49314
18042024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18052024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18062024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18072024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18082024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18092024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18102024-12-21T00:17:47.021ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18112024-12-21T00:17:47.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49314 req_id = 18295c04-3d11-4dad-988e-9f77880c4a31 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18122024-12-21T00:17:47.035ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18132024-12-21T00:17:47.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b
18142024-12-21T00:17:47.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18152024-12-21T00:17:47.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19
18162024-12-21T00:17:47.086ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18172024-12-21T00:17:47.086ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db606984-291b-40d5-964e-14a228d68e45
18182024-12-21T00:17:47.110ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18192024-12-21T00:17:47.110ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4
18202024-12-21T00:17:47.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18212024-12-21T00:17:47.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96dd6601-21c1-4f69-a871-ce8980776531
18222024-12-21T00:17:47.156ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18232024-12-21T00:17:47.156ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8504df1b-d5a7-40bd-ad45-c55449857140
18242024-12-21T00:17:47.178ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18252024-12-21T00:17:47.178ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3c5770f-c2a5-4687-9844-df947021ecd9
18262024-12-21T00:17:47.198ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18272024-12-21T00:17:47.198ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30f2f8a7-d49b-4582-9153-44098dd8db06
18282024-12-21T00:17:47.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219390 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45946 req_id = 0da68990-de07-4fc2-ae97-1396601b5234 response_code = 200 uri = /inventory
18292024-12-21T00:17:47.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46365
18302024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18312024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18322024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18332024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18342024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18352024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18362024-12-21T00:17:47.239ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18372024-12-21T00:17:47.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46365 req_id = 0fe0c4b0-5c1d-4676-b15f-875c9e79d479 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18382024-12-21T00:17:47.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59254
18392024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18402024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18412024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18422024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18442024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18452024-12-21T00:17:47.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18462024-12-21T00:17:47.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59254 req_id = 69cdb80f-d182-401e-b3ad-9d9c167ce80e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18472024-12-21T00:17:49.004ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64911
18482024-12-21T00:17:49.004ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64911 req_id = 0e66ee59-3de0-4885-bd2e-9209a5292ae8 response_code = 200 uri = /baseboard
18492024-12-21T00:17:51.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61158
18502024-12-21T00:17:51.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61158 req_id = 9d1a35fb-160b-4743-b2d1-ff4d8871a1c9 response_code = 200 uri = /vpc-routes
18512024-12-21T00:17:52.089ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
18522024-12-21T00:17:52.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61158 req_id = 0df442f0-0ff7-41e9-aa2d-eb8a29bd7a5d response_code = 204 uri = /eip-gateways
18532024-12-21T00:17:52.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61158 req_id = ee1abba8-3949-40ef-848b-3a50853ca203 response_code = 204 uri = /vpc-routes
18542024-12-21T00:18:01.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42824
18552024-12-21T00:18:01.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42824 req_id = 7fc6fced-116b-4f2f-a9b0-47ec4d37954b response_code = 200 uri = /vpc-routes
18562024-12-21T00:18:01.609ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
18572024-12-21T00:18:01.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42824 req_id = 3eed01d0-d3a6-451a-80de-3bc16ea37c7b response_code = 204 uri = /eip-gateways
18582024-12-21T00:18:01.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42824 req_id = 1583f81c-3147-4b4f-bc3f-97058127a205 response_code = 204 uri = /vpc-routes
18592024-12-21T00:18:01.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44383
18602024-12-21T00:18:01.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44383 req_id = 2c9477dd-8985-438d-bc70-04e3a7d6c9bc response_code = 200 uri = /v2p
18612024-12-21T00:18:01.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50688
18622024-12-21T00:18:01.707ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18632024-12-21T00:18:01.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18642024-12-21T00:18:01.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50688 req_id = c742782a-9952-4a7e-bc35-ea19aa1ff01d response_code = 204 uri = /switch-ports
18652024-12-21T00:18:01.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50688 req_id = da399228-c1d6-4d46-9a92-078298eda8e3 response_code = 200 uri = /network-bootstore-config
18662024-12-21T00:18:01.885ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18672024-12-21T00:18:01.887ZINFOSledAgent (bootstore): Writing ledger to /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18682024-12-21T00:18:01.889ZINFOSledAgent (bootstore): Writing ledger to /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18692024-12-21T00:18:01.890ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18702024-12-21T00:18:01.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50688 req_id = bdfbb100-2291-4991-b6f6-df97b36c46c5 response_code = 204 uri = /network-bootstore-config
18712024-12-21T00:18:02.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55426
18722024-12-21T00:18:02.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55426 req_id = 897c5d9b-0677-483d-895e-d66d07b823bc response_code = 200 uri = /vpc-routes
18732024-12-21T00:18:02.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
18742024-12-21T00:18:02.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55426 req_id = 504f442e-12e6-43c1-93f3-c7faeeb3711e response_code = 204 uri = /eip-gateways
18752024-12-21T00:18:02.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55426 req_id = 0665bcfb-5fca-466d-b996-25a07766f881 response_code = 204 uri = /vpc-routes
18762024-12-21T00:18:02.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40427
18772024-12-21T00:18:02.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40427 req_id = 9914c9c1-ff9b-4452-b013-9d69d0b5f6bc response_code = 200 uri = /vpc-routes
18782024-12-21T00:18:02.382ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
18792024-12-21T00:18:02.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40427 req_id = c5086ffe-1f42-47c7-8760-a222a618f412 response_code = 204 uri = /eip-gateways
18802024-12-21T00:18:02.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40427 req_id = cf196e2a-5628-44e5-89fa-ee6cd93ca60a response_code = 204 uri = /vpc-routes
18812024-12-21T00:18:02.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50275
18822024-12-21T00:18:02.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50275 req_id = 752cfbd3-298b-495a-a8b4-3a4f8f4ff3aa response_code = 200 uri = /v2p
18832024-12-21T00:18:02.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40721
18842024-12-21T00:18:02.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40721 req_id = 705eae30-9897-4b45-b950-2da4fe6483f1 response_code = 200 uri = /v2p
18852024-12-21T00:18:02.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49634
18862024-12-21T00:18:02.726ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18872024-12-21T00:18:02.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18882024-12-21T00:18:02.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96612 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49634 req_id = 8e95a445-a698-4899-8880-e629e651a824 response_code = 204 uri = /switch-ports
18892024-12-21T00:18:02.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45325
18902024-12-21T00:18:02.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18912024-12-21T00:18:02.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18922024-12-21T00:18:02.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89483 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45325 req_id = e8187958-c7b2-432e-b891-5e7e4cae6296 response_code = 204 uri = /switch-ports
18932024-12-21T00:18:02.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45325 req_id = 0ba0cc0b-adf6-42b7-9052-2ee4f2422f55 response_code = 200 uri = /network-bootstore-config
18942024-12-21T00:18:02.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49634 req_id = e86fd9e9-b756-427a-b495-32059ea4d26f response_code = 200 uri = /network-bootstore-config
18952024-12-21T00:18:14.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8388 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 840e88ea-cbf0-4047-ac64-3481edcb5a42 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
18962024-12-21T00:18:19.036ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46679
18972024-12-21T00:18:19.037ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46679 req_id = 634f66cc-7e63-41e6-9344-ba0e56d34ea4 response_code = 200 uri = /baseboard
18982024-12-21T00:18:31.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44968
18992024-12-21T00:18:31.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44968 req_id = 04fa1e8d-e36f-479e-a75f-c25d5f419b95 response_code = 200 uri = /vpc-routes
19002024-12-21T00:18:31.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19012024-12-21T00:18:31.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44968 req_id = 9015b2b8-824b-4241-b6fb-2c29354b11ad response_code = 204 uri = /eip-gateways
19022024-12-21T00:18:31.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44968 req_id = ca57beb2-75cc-4166-bac0-fccb9059fde4 response_code = 204 uri = /vpc-routes
19032024-12-21T00:18:31.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35602
19042024-12-21T00:18:31.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35602 req_id = dd9b2fab-0835-40a7-8f0b-a8f1a53f80be response_code = 200 uri = /v2p
19052024-12-21T00:18:31.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57797
19062024-12-21T00:18:31.599ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19072024-12-21T00:18:31.639ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19082024-12-21T00:18:31.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57797 req_id = c1c1411d-090e-4a2a-af01-4d9287360f7e response_code = 204 uri = /switch-ports
19092024-12-21T00:18:31.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57797 req_id = 4a60c5cf-75c1-4e7f-b5b1-de7e0a684651 response_code = 200 uri = /network-bootstore-config
19102024-12-21T00:18:32.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56323
19112024-12-21T00:18:32.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56323 req_id = 2138a14f-fc0a-4e5c-9144-64604afe07e5 response_code = 200 uri = /vpc-routes
19122024-12-21T00:18:32.243ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19132024-12-21T00:18:32.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56323 req_id = 1e979d25-7e80-4f1f-b3c3-29f70d5396b4 response_code = 204 uri = /eip-gateways
19142024-12-21T00:18:32.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54204
19152024-12-21T00:18:32.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54204 req_id = bec42e29-5779-4553-a337-4ccde20cca4b response_code = 200 uri = /vpc-routes
19162024-12-21T00:18:32.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53100
19172024-12-21T00:18:32.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19182024-12-21T00:18:32.309ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19192024-12-21T00:18:32.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53100 req_id = cd8724fe-b688-455a-a2bd-cb1eab9ed289 response_code = 204 uri = /switch-ports
19202024-12-21T00:18:32.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19212024-12-21T00:18:32.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54204 req_id = 461bf1fb-64e3-41e2-b9bd-efd855e6e848 response_code = 204 uri = /eip-gateways
19222024-12-21T00:18:32.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53100 req_id = 7111d67b-2e93-4dc2-8f5f-6e2fb786be93 response_code = 200 uri = /network-bootstore-config
19232024-12-21T00:18:32.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56323 req_id = 0af72699-e22c-4272-8dca-4fe47706390d response_code = 204 uri = /vpc-routes
19242024-12-21T00:18:32.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58102
19252024-12-21T00:18:32.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58102 req_id = 83cde34a-afda-47d2-bb79-a07d67f96f2c response_code = 200 uri = /v2p
19262024-12-21T00:18:32.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64578
19272024-12-21T00:18:32.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64578 req_id = 1dce3330-a913-4118-beef-b9cdbfccb09e response_code = 200 uri = /v2p
19282024-12-21T00:18:32.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54204 req_id = 44ee26c6-bb72-4ea1-8152-014ba79fc2b5 response_code = 204 uri = /vpc-routes
19292024-12-21T00:18:32.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38890
19302024-12-21T00:18:32.516ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19312024-12-21T00:18:32.554ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19322024-12-21T00:18:32.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38890 req_id = 2b523e2d-951a-42b9-b1e6-5a3054c6abd5 response_code = 204 uri = /switch-ports
19332024-12-21T00:18:32.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38890 req_id = 9687c762-383f-4070-9915-2b230e44ad2a response_code = 200 uri = /network-bootstore-config
19342024-12-21T00:18:44.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7742 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 1acf32c8-bb68-41ad-af9b-ec4e43c9bcca response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
19352024-12-21T00:18:49.069ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65496
19362024-12-21T00:18:49.070ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65496 req_id = b3e2d2be-b319-4855-9a61-01de5e001aea response_code = 200 uri = /baseboard
19372024-12-21T00:19:01.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34546
19382024-12-21T00:19:01.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34546 req_id = 540d2a0f-e00c-45e0-a54b-35b1633680c6 response_code = 200 uri = /vpc-routes
19392024-12-21T00:19:01.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56865
19402024-12-21T00:19:01.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56865 req_id = 9b7beeba-d3a6-4860-87df-fc9704fdf2fb response_code = 200 uri = /v2p
19412024-12-21T00:19:01.506ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19422024-12-21T00:19:01.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34546 req_id = 9bc0748d-a202-4714-a34c-2bcbfcf96829 response_code = 204 uri = /eip-gateways
19432024-12-21T00:19:01.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34546 req_id = ab527c84-a095-499d-8380-7fae8b632e8a response_code = 204 uri = /vpc-routes
19442024-12-21T00:19:01.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40389
19452024-12-21T00:19:01.762ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19462024-12-21T00:19:01.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19472024-12-21T00:19:01.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40389 req_id = 8a181fac-003d-40c6-a407-a2b8253198ca response_code = 204 uri = /switch-ports
19482024-12-21T00:19:01.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40389 req_id = 0fd76562-1dd5-4f68-b878-5cb5e0f37d00 response_code = 200 uri = /network-bootstore-config
19492024-12-21T00:19:02.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39013
19502024-12-21T00:19:02.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39013 req_id = e8ee9c63-2fe9-44fb-a22d-cd4352828a83 response_code = 200 uri = /vpc-routes
19512024-12-21T00:19:02.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36495
19522024-12-21T00:19:02.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36495 req_id = 3979cb8b-1b54-412a-8c4f-499cdd3954f7 response_code = 200 uri = /vpc-routes
19532024-12-21T00:19:02.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19542024-12-21T00:19:02.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39013 req_id = af0861ac-7c99-49f5-8d6b-59fb63b8db83 response_code = 204 uri = /eip-gateways
19552024-12-21T00:19:02.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53543
19562024-12-21T00:19:02.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53543 req_id = 2efa3e59-eea2-41a3-96c1-4ba9950461bf response_code = 200 uri = /v2p
19572024-12-21T00:19:02.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50130
19582024-12-21T00:19:02.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50130 req_id = 7d51102c-8ae2-4ab2-8aef-e7e510c7a210 response_code = 200 uri = /v2p
19592024-12-21T00:19:02.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39013 req_id = 2d75f22b-6af5-4aee-9d4c-538d57501d50 response_code = 204 uri = /vpc-routes
19602024-12-21T00:19:02.461ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19612024-12-21T00:19:02.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36495 req_id = 1e5d7b24-7c51-46a8-bb8b-4116bbeb76e8 response_code = 204 uri = /eip-gateways
19622024-12-21T00:19:02.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36495 req_id = 851ef0dc-d0c6-4120-aa43-43497e0af167 response_code = 204 uri = /vpc-routes
19632024-12-21T00:19:02.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36364
19642024-12-21T00:19:02.484ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19652024-12-21T00:19:02.525ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19662024-12-21T00:19:02.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36364 req_id = 56c5ef8c-68fa-45b7-a07e-b2e265e04a2d response_code = 204 uri = /switch-ports
19672024-12-21T00:19:02.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36364 req_id = d026b67e-d637-4e67-89c9-b5ec1820c4f7 response_code = 200 uri = /network-bootstore-config
19682024-12-21T00:19:02.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61729
19692024-12-21T00:19:02.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19702024-12-21T00:19:02.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19712024-12-21T00:19:02.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61729 req_id = e091aed4-07d4-41c0-be0a-bda1798fd63b response_code = 204 uri = /switch-ports
19722024-12-21T00:19:02.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61729 req_id = 126b951f-5ee6-4445-8c56-045aec6ab640 response_code = 200 uri = /network-bootstore-config
19732024-12-21T00:19:14.866ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10052 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 1ed49edf-6ae3-4f29-bcb8-8ad22c766c78 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
19742024-12-21T00:19:19.103ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52191
19752024-12-21T00:19:19.104ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52191 req_id = 21d88354-c6a2-4983-bb56-81d99e3a5bf6 response_code = 200 uri = /baseboard
19762024-12-21T00:19:31.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65283
19772024-12-21T00:19:31.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65283 req_id = 437a6cb2-ebd4-4136-be7e-c0e7fa58482e response_code = 200 uri = /vpc-routes
19782024-12-21T00:19:31.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59793
19792024-12-21T00:19:31.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59793 req_id = b77a0f31-f371-470d-919d-12cc18cdc7c9 response_code = 200 uri = /v2p
19802024-12-21T00:19:31.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49290
19812024-12-21T00:19:31.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19822024-12-21T00:19:31.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19832024-12-21T00:19:31.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49290 req_id = 0aae8ba5-a200-4025-8f2e-811046cdbc09 response_code = 204 uri = /switch-ports
19842024-12-21T00:19:31.483ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19852024-12-21T00:19:31.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65283 req_id = 9fdeda33-427f-435d-84ae-0ad0aa47bcfc response_code = 204 uri = /eip-gateways
19862024-12-21T00:19:31.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49290 req_id = 0da98b84-d651-4d63-91db-b3c81baf84fb response_code = 200 uri = /network-bootstore-config
19872024-12-21T00:19:31.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65283 req_id = 2d8d6785-59bf-4e83-a41e-381bd5211369 response_code = 204 uri = /vpc-routes
19882024-12-21T00:19:32.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51542
19892024-12-21T00:19:32.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51542 req_id = 8722b491-1572-4a0f-9b4e-d2ce6a00d51a response_code = 200 uri = /vpc-routes
19902024-12-21T00:19:32.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50120
19912024-12-21T00:19:32.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50120 req_id = d290ba2d-1890-4fbd-a246-d293f1e22757 response_code = 200 uri = /vpc-routes
19922024-12-21T00:19:32.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
19932024-12-21T00:19:32.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50120 req_id = 3bb5eca8-6581-406e-9e14-069f324ed0c0 response_code = 204 uri = /eip-gateways
19942024-12-21T00:19:32.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49595
19952024-12-21T00:19:32.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39717
19962024-12-21T00:19:32.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19972024-12-21T00:19:32.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6074 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49595 req_id = b68c71de-a3d6-4f2c-8bba-cc7026af7b10 response_code = 200 uri = /v2p
19982024-12-21T00:19:32.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50120 req_id = 6328043d-13a6-4728-8812-dbabbf327430 response_code = 204 uri = /vpc-routes
19992024-12-21T00:19:32.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20002024-12-21T00:19:32.297ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20012024-12-21T00:19:32.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51542 req_id = 62c6e6a2-d4a5-4886-9ba6-1a5bfb86c639 response_code = 204 uri = /eip-gateways
20022024-12-21T00:19:32.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51542 req_id = 93b81007-75df-4133-8fef-730c84f916e3 response_code = 204 uri = /vpc-routes
20032024-12-21T00:19:32.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51542
20042024-12-21T00:19:32.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51542 req_id = a1e1eec4-8a9c-404b-892d-e44fa8cb5595 response_code = 200 uri = /v2p
20052024-12-21T00:19:32.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108938 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39717 req_id = 1e143937-b608-4531-bb4d-78e1f35d05d4 response_code = 204 uri = /switch-ports
20062024-12-21T00:19:32.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39717 req_id = e83a8e5d-e5bb-4c56-9e99-0be02d0c4d71 response_code = 200 uri = /network-bootstore-config
20072024-12-21T00:19:32.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40190
20082024-12-21T00:19:32.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20092024-12-21T00:19:32.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20102024-12-21T00:19:32.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40190 req_id = 0d812f86-a58c-4761-9e32-48442d419761 response_code = 204 uri = /switch-ports
20112024-12-21T00:19:32.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40190 req_id = a07b3a95-382e-4a49-b493-6f289ce6f85a response_code = 200 uri = /network-bootstore-config
20122024-12-21T00:19:44.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8012 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = bfc11bec-bea9-48d5-a259-73d3b91eac44 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
20132024-12-21T00:19:49.137ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35442
20142024-12-21T00:19:49.137ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35442 req_id = 7d9703a0-0788-4aa5-bbc2-38bb39e6d570 response_code = 200 uri = /baseboard
20152024-12-21T00:20:01.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59463
20162024-12-21T00:20:01.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59463 req_id = e6006201-fabf-4b95-b078-4ae3c8499e80 response_code = 200 uri = /vpc-routes
20172024-12-21T00:20:01.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48678
20182024-12-21T00:20:01.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48678 req_id = ba362902-b4e4-49c7-ac94-4918f588c5ab response_code = 200 uri = /v2p
20192024-12-21T00:20:01.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20202024-12-21T00:20:01.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59463 req_id = ac53fb64-8479-411f-bd4c-3d37514e758c response_code = 204 uri = /eip-gateways
20212024-12-21T00:20:01.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59463 req_id = 3e1c07ed-c365-4718-8e04-91e880106eea response_code = 204 uri = /vpc-routes
20222024-12-21T00:20:01.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57322
20232024-12-21T00:20:01.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20242024-12-21T00:20:01.644ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20252024-12-21T00:20:01.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89005 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57322 req_id = 73ddaf6f-3040-49ef-bb2a-2c8d91d1326c response_code = 204 uri = /switch-ports
20262024-12-21T00:20:01.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57322 req_id = 81f00889-5c6d-4f44-8401-ada877aad768 response_code = 200 uri = /network-bootstore-config
20272024-12-21T00:20:02.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35088
20282024-12-21T00:20:02.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35088 req_id = 9083717b-6167-4911-8c06-4d8977cf4918 response_code = 200 uri = /vpc-routes
20292024-12-21T00:20:02.407ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37335
20302024-12-21T00:20:02.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37335 req_id = 1fd789e2-6c83-4c5f-a793-afcf63eb625a response_code = 200 uri = /vpc-routes
20312024-12-21T00:20:02.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20322024-12-21T00:20:02.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37335 req_id = 03c3836e-b751-4672-bda3-01cc7bf0b6b2 response_code = 204 uri = /eip-gateways
20332024-12-21T00:20:02.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37335 req_id = b91805e5-f7a1-4536-ad45-445eba5a84d6 response_code = 204 uri = /vpc-routes
20342024-12-21T00:20:02.488ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20352024-12-21T00:20:02.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35088 req_id = 77185fbb-dd0a-4b57-9213-ff0302018cbe response_code = 204 uri = /eip-gateways
20362024-12-21T00:20:02.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35088 req_id = 11dcc925-f5df-4f7c-a5f9-16d21249acaa response_code = 204 uri = /vpc-routes
20372024-12-21T00:20:02.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42184
20382024-12-21T00:20:02.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42184 req_id = c4f5c95b-fb51-41fb-8891-cf6db3b08144 response_code = 200 uri = /v2p
20392024-12-21T00:20:02.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49456
20402024-12-21T00:20:02.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49456 req_id = 2bb5458c-34eb-4f51-9b15-f4d43314784a response_code = 200 uri = /v2p
20412024-12-21T00:20:02.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40788
20422024-12-21T00:20:02.624ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20432024-12-21T00:20:02.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20442024-12-21T00:20:02.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94894 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40788 req_id = 598c9829-7bc4-4e39-9e0b-b95035bbed1a response_code = 204 uri = /switch-ports
20452024-12-21T00:20:02.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40788 req_id = b70584e5-0ff1-410f-a5a4-a90eed728738 response_code = 200 uri = /network-bootstore-config
20462024-12-21T00:20:02.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43840
20472024-12-21T00:20:02.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20482024-12-21T00:20:02.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20492024-12-21T00:20:02.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91249 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43840 req_id = 461e85d6-4a60-468b-8a0b-d5628af6098e response_code = 204 uri = /switch-ports
20502024-12-21T00:20:02.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43840 req_id = 11909865-d4a1-4eee-8dec-bc28afb91d53 response_code = 200 uri = /network-bootstore-config
20512024-12-21T00:20:09.232ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20522024-12-21T00:20:14.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7729 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 3b696772-cc69-4bf9-b392-d13b3e437af2 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
20532024-12-21T00:20:19.171ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50591
20542024-12-21T00:20:19.171ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50591 req_id = 97a047b6-e030-4eb7-9ee0-7a07616ccc56 response_code = 200 uri = /baseboard
20552024-12-21T00:20:31.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35794
20562024-12-21T00:20:31.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35794 req_id = 62f3115a-ab37-49f3-ad8e-5769d5fbc856 response_code = 200 uri = /vpc-routes
20572024-12-21T00:20:31.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20582024-12-21T00:20:31.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35794 req_id = 1215d53d-fda8-4983-b349-15074ae87b5e response_code = 204 uri = /eip-gateways
20592024-12-21T00:20:31.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61987
20602024-12-21T00:20:31.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61987 req_id = b787b775-7b5c-47c9-b06d-943401e19d42 response_code = 200 uri = /v2p
20612024-12-21T00:20:31.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35794 req_id = df714c9d-e28c-462f-8c47-f7ab07d30853 response_code = 204 uri = /vpc-routes
20622024-12-21T00:20:31.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39582
20632024-12-21T00:20:31.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20642024-12-21T00:20:31.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20652024-12-21T00:20:31.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39582 req_id = 76b284ee-d285-4df9-ae3a-71c5d89efb2a response_code = 204 uri = /switch-ports
20662024-12-21T00:20:31.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39582 req_id = d64b39a4-e71b-4eea-8b09-a4defa407a96 response_code = 200 uri = /network-bootstore-config
20672024-12-21T00:20:32.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46176
20682024-12-21T00:20:32.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46176 req_id = 4a911d85-b1bb-48ad-9a1b-7d543c1902c3 response_code = 200 uri = /vpc-routes
20692024-12-21T00:20:32.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55576
20702024-12-21T00:20:32.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55576 req_id = fd9b35a1-5a2f-4a04-9743-b16d63366cef response_code = 200 uri = /vpc-routes
20712024-12-21T00:20:32.253ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20722024-12-21T00:20:32.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55576 req_id = 97b98349-d3dd-42cf-b6ef-c9a19c58f41b response_code = 204 uri = /eip-gateways
20732024-12-21T00:20:32.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55576 req_id = 651ce091-392e-4453-a5d6-3940e2d2882a response_code = 204 uri = /vpc-routes
20742024-12-21T00:20:32.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36271
20752024-12-21T00:20:32.285ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20762024-12-21T00:20:32.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20772024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36271 req_id = f06d6929-b461-47b1-82f2-f6b301803670 response_code = 204 uri = /switch-ports
20782024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43830
20792024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50804
20802024-12-21T00:20:32.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20812024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36271 req_id = f8e5f461-6782-456e-9893-0081b2457209 response_code = 200 uri = /network-bootstore-config
20822024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46176 req_id = 521e6de1-ee95-415f-8b40-1afcedcf1329 response_code = 204 uri = /eip-gateways
20832024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43830 req_id = ddbc5932-65ac-4f70-85f6-ea36ee8f0b2b response_code = 200 uri = /v2p
20842024-12-21T00:20:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50804 req_id = 880ab002-bcdb-4874-956c-f9b5f86562f9 response_code = 200 uri = /v2p
20852024-12-21T00:20:32.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46176 req_id = f53e0771-315a-4591-a093-39d4e856fefe response_code = 204 uri = /vpc-routes
20862024-12-21T00:20:32.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62978
20872024-12-21T00:20:32.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20882024-12-21T00:20:32.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20892024-12-21T00:20:32.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62978 req_id = f0c4dd46-a30e-4d88-97d9-60fb5f5e511f response_code = 204 uri = /switch-ports
20902024-12-21T00:20:32.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62978 req_id = f7430030-e186-4a10-8a78-a1120b88e1b8 response_code = 200 uri = /network-bootstore-config
20912024-12-21T00:20:44.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7877 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 78a70bae-0098-485d-a05c-29437efd74f7 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
20922024-12-21T00:20:49.202ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46155
20932024-12-21T00:20:49.203ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46155 req_id = bb58a443-e0d8-4de0-87f9-cdc42235cc10 response_code = 200 uri = /baseboard
20942024-12-21T00:21:01.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51625
20952024-12-21T00:21:01.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51625 req_id = 792abd33-9761-4e0b-aabb-96f19091f09f response_code = 200 uri = /vpc-routes
20962024-12-21T00:21:01.439ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
20972024-12-21T00:21:01.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51625 req_id = 3e299288-d6ef-4fa1-bac4-3e5ec01d82d6 response_code = 204 uri = /eip-gateways
20982024-12-21T00:21:01.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51625 req_id = 45690297-da41-45c0-bf58-0b09de12aa90 response_code = 204 uri = /vpc-routes
20992024-12-21T00:21:01.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42532
21002024-12-21T00:21:01.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21012024-12-21T00:21:01.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21022024-12-21T00:21:01.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94635 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42532 req_id = 2c3b4401-8fd8-490e-8a6a-24e472f4fc70 response_code = 204 uri = /switch-ports
21032024-12-21T00:21:01.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46023
21042024-12-21T00:21:01.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42532 req_id = 02929953-4147-42f0-9392-abdec80099b6 response_code = 200 uri = /network-bootstore-config
21052024-12-21T00:21:01.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46023 req_id = a2cc6a44-18c7-43c9-9b14-8c71acf26b40 response_code = 200 uri = /v2p
21062024-12-21T00:21:02.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64806
21072024-12-21T00:21:02.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64806 req_id = fa046289-c53d-4eb9-ad5f-eb35df526705 response_code = 200 uri = /vpc-routes
21082024-12-21T00:21:02.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21092024-12-21T00:21:02.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64806 req_id = 27314795-d25b-459b-b243-89c9bd42b865 response_code = 204 uri = /eip-gateways
21102024-12-21T00:21:02.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64806 req_id = b1e0704d-b97a-457f-a823-c5f0c3007d10 response_code = 204 uri = /vpc-routes
21112024-12-21T00:21:02.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59888
21122024-12-21T00:21:02.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59888 req_id = 4c889cdd-b515-413e-baad-5e06897cde7b response_code = 200 uri = /vpc-routes
21132024-12-21T00:21:02.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63905
21142024-12-21T00:21:02.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63905 req_id = f25b4568-86f5-41ab-8904-0962af8d5ad3 response_code = 200 uri = /v2p
21152024-12-21T00:21:02.445ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21162024-12-21T00:21:02.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59888 req_id = de01a516-5112-4c09-bcbc-4aaf50014aa3 response_code = 204 uri = /eip-gateways
21172024-12-21T00:21:02.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59888 req_id = 82778977-d1fb-4bf0-9e2a-7235de81e067 response_code = 204 uri = /vpc-routes
21182024-12-21T00:21:02.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41188
21192024-12-21T00:21:02.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21202024-12-21T00:21:02.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21212024-12-21T00:21:02.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41188 req_id = ba5d3f29-c23e-4fcb-ab97-37f346937f5d response_code = 204 uri = /switch-ports
21222024-12-21T00:21:02.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62990
21232024-12-21T00:21:02.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48035
21242024-12-21T00:21:02.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41188 req_id = 6072e70b-83f3-414a-a1ed-31d2ed98b546 response_code = 200 uri = /network-bootstore-config
21252024-12-21T00:21:02.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62990 req_id = 14a94482-d759-48fd-93ef-cc666a4dae6a response_code = 200 uri = /v2p
21262024-12-21T00:21:02.572ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21272024-12-21T00:21:02.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21282024-12-21T00:21:02.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88826 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48035 req_id = f6a86446-5446-47ca-a3f4-0dd764fc1fae response_code = 204 uri = /switch-ports
21292024-12-21T00:21:02.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48035 req_id = 5e3d0e27-96e1-4461-8917-de65beef8649 response_code = 200 uri = /network-bootstore-config
21302024-12-21T00:21:14.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7655 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 371546e7-257e-4af5-a8f0-cf90534bd276 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
21312024-12-21T00:21:19.237ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46761
21322024-12-21T00:21:19.237ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46761 req_id = eee5bfd4-2fed-4d83-9b10-718fad1ee12f response_code = 200 uri = /baseboard
21332024-12-21T00:21:31.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39910
21342024-12-21T00:21:31.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39910 req_id = eb2c20e7-f12e-4042-9688-7b7a9dd619e5 response_code = 200 uri = /vpc-routes
21352024-12-21T00:21:31.326ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21362024-12-21T00:21:31.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39910 req_id = 137196eb-7974-4edd-bd13-387a29501f52 response_code = 204 uri = /eip-gateways
21372024-12-21T00:21:31.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39910 req_id = 1b55e984-3804-411f-8681-3c12aca65850 response_code = 204 uri = /vpc-routes
21382024-12-21T00:21:31.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41716
21392024-12-21T00:21:31.361ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21402024-12-21T00:21:31.401ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21412024-12-21T00:21:31.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41716 req_id = cb69082e-ebb5-4605-97f3-663bfc51fe87 response_code = 204 uri = /switch-ports
21422024-12-21T00:21:31.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56889
21432024-12-21T00:21:31.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56889 req_id = 7eb94ba9-9671-4775-8a33-0af582d00d70 response_code = 200 uri = /v2p
21442024-12-21T00:21:31.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41716 req_id = 3353fe1b-6086-476c-8026-d6fd18005655 response_code = 200 uri = /network-bootstore-config
21452024-12-21T00:21:32.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33536
21462024-12-21T00:21:32.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33536 req_id = 22a2c9c3-5b76-4bf0-8573-815d4ba647bb response_code = 200 uri = /vpc-routes
21472024-12-21T00:21:32.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21482024-12-21T00:21:32.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33536 req_id = 2e0f0dce-51d7-4fd8-aa0a-1f3cd94ca04d response_code = 204 uri = /eip-gateways
21492024-12-21T00:21:32.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33536 req_id = 327076e2-78a1-45f1-a62c-b54dc9b3e67b response_code = 204 uri = /vpc-routes
21502024-12-21T00:21:32.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32954
21512024-12-21T00:21:32.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32954 req_id = 9e2518ea-9570-4176-b648-e4f42ba099ab response_code = 200 uri = /vpc-routes
21522024-12-21T00:21:32.236ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21532024-12-21T00:21:32.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32954 req_id = 795080d9-e731-40aa-bcdf-29edc5a93c87 response_code = 204 uri = /eip-gateways
21542024-12-21T00:21:32.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53451
21552024-12-21T00:21:32.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53451 req_id = 579779ba-d695-46d5-8209-4b81cda8b01a response_code = 200 uri = /v2p
21562024-12-21T00:21:32.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32954 req_id = 4a0568ef-8290-4c36-a6db-6dac07cae6a6 response_code = 204 uri = /vpc-routes
21572024-12-21T00:21:32.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61209
21582024-12-21T00:21:32.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61209 req_id = 493d8791-5961-44ee-8f5f-fba1afd11af1 response_code = 200 uri = /v2p
21592024-12-21T00:21:32.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59992
21602024-12-21T00:21:32.277ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21612024-12-21T00:21:32.318ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21622024-12-21T00:21:32.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59992 req_id = d811cdda-658a-43d3-a59d-d898f379706d response_code = 204 uri = /switch-ports
21632024-12-21T00:21:32.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65320
21642024-12-21T00:21:32.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59992 req_id = a3803b66-991c-4705-874f-fff3c336b364 response_code = 200 uri = /network-bootstore-config
21652024-12-21T00:21:32.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21662024-12-21T00:21:32.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21672024-12-21T00:21:32.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94226 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65320 req_id = 47a28eaf-3d71-4aa1-b4da-9434e0b54f28 response_code = 204 uri = /switch-ports
21682024-12-21T00:21:32.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65320 req_id = 8990b08d-b658-4ce9-b49e-2b20fdc0c8c7 response_code = 200 uri = /network-bootstore-config
21692024-12-21T00:21:44.861ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7111 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 9189f826-4d97-44a3-93c6-864fed35575d response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
21702024-12-21T00:21:49.271ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35247
21712024-12-21T00:21:49.271ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35247 req_id = 9301d90f-c2be-4483-9278-b88151f02881 response_code = 200 uri = /baseboard
21722024-12-21T00:22:01.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59747
21732024-12-21T00:22:01.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59747 req_id = 14c5e4d6-1320-4775-9d33-7f9a34931116 response_code = 200 uri = /vpc-routes
21742024-12-21T00:22:01.379ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21752024-12-21T00:22:01.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59747 req_id = 4fb041bb-34e6-4628-8da4-76c1d4d0c512 response_code = 204 uri = /eip-gateways
21762024-12-21T00:22:01.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59747 req_id = 568ec4a3-387f-47de-91df-aa7d7e2c8e87 response_code = 204 uri = /vpc-routes
21772024-12-21T00:22:01.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35131
21782024-12-21T00:22:01.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35131 req_id = fdb31eec-49f4-456f-9df9-6cdacdf44661 response_code = 200 uri = /v2p
21792024-12-21T00:22:01.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44739
21802024-12-21T00:22:01.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21812024-12-21T00:22:01.685ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21822024-12-21T00:22:01.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44739 req_id = 94a29788-858c-41aa-ad2d-1f8a43755e09 response_code = 204 uri = /switch-ports
21832024-12-21T00:22:01.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44739 req_id = 2c86e7c3-7937-4f81-a369-930f5b274e7f response_code = 200 uri = /network-bootstore-config
21842024-12-21T00:22:01.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57885
21852024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21862024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21872024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21882024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21892024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21902024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21912024-12-21T00:22:01.921ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21922024-12-21T00:22:01.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57885 req_id = 266bc846-2ac6-4e31-8663-0893709456be response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21932024-12-21T00:22:02.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34609
21942024-12-21T00:22:02.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34609 req_id = 7b24b0a8-16ea-41cf-9449-c44e3396a6fe response_code = 200 uri = /vpc-routes
21952024-12-21T00:22:02.378ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
21962024-12-21T00:22:02.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34609 req_id = ffdb81c2-51f8-4917-9d08-494eaa8c9a20 response_code = 204 uri = /eip-gateways
21972024-12-21T00:22:02.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57757
21982024-12-21T00:22:02.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57757 req_id = 9c2d29c9-f873-44be-a616-d3bb7ac7825d response_code = 200 uri = /vpc-routes
21992024-12-21T00:22:02.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34609 req_id = 16ee193f-56db-4975-851c-ac2e614d4d17 response_code = 204 uri = /vpc-routes
22002024-12-21T00:22:02.433ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22012024-12-21T00:22:02.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57757 req_id = fc46ef9e-6133-49ec-ad98-66cdc6a1788c response_code = 204 uri = /eip-gateways
22022024-12-21T00:22:02.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57757 req_id = 5ad64aed-72b9-4df6-a065-63b7861a6a41 response_code = 204 uri = /vpc-routes
22032024-12-21T00:22:02.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61343
22042024-12-21T00:22:02.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22052024-12-21T00:22:02.520ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22062024-12-21T00:22:02.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61343 req_id = 371991f9-6acd-4185-bf07-2a720c63c872 response_code = 204 uri = /switch-ports
22072024-12-21T00:22:02.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62453
22082024-12-21T00:22:02.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43811
22092024-12-21T00:22:02.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50997
22102024-12-21T00:22:02.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50997 req_id = e273b2d2-caab-4c27-8142-29ce5e5ef3db response_code = 200 uri = /v2p
22112024-12-21T00:22:02.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61343 req_id = a2b4d319-80a0-4840-89f5-bb7127ad9521 response_code = 200 uri = /network-bootstore-config
22122024-12-21T00:22:02.580ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22132024-12-21T00:22:02.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62453 req_id = 7079bd1c-d7f9-4b72-898f-83e327575fb9 response_code = 200 uri = /v2p
22142024-12-21T00:22:02.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22152024-12-21T00:22:02.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60921
22162024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22172024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22182024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22202024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22212024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22222024-12-21T00:22:02.646ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22232024-12-21T00:22:02.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60921 req_id = 93e65d7a-89f6-44ac-9699-98dca854ada3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22242024-12-21T00:22:02.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43811 req_id = f6ee4576-12d9-433c-86ab-ca7aed70a14d response_code = 204 uri = /switch-ports
22252024-12-21T00:22:02.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43811 req_id = 49408166-707c-46e9-8d7c-1f8aa69c4d09 response_code = 200 uri = /network-bootstore-config
22262024-12-21T00:22:02.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64079
22272024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22282024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22292024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22302024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22312024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22322024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22332024-12-21T00:22:02.831ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22342024-12-21T00:22:02.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64079 req_id = 1a223bcd-dfc1-49f3-9f4b-ecb3d67bf254 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22352024-12-21T00:22:14.862ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7545 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 255611c7-b2f1-4432-8de0-a9a28685986d response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
22362024-12-21T00:22:19.303ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60953
22372024-12-21T00:22:19.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60953 req_id = 19085be7-ccfc-4ab4-a22e-964636eeca0a response_code = 200 uri = /baseboard
22382024-12-21T00:22:31.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57929
22392024-12-21T00:22:31.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57929 req_id = eaf3fb11-53c1-48d6-9b81-2a060cc4d622 response_code = 200 uri = /vpc-routes
22402024-12-21T00:22:31.304ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22412024-12-21T00:22:31.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57929 req_id = cc3f3f06-6df4-4d93-985c-f557efd9c76b response_code = 204 uri = /eip-gateways
22422024-12-21T00:22:31.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57929 req_id = aa95764c-baac-4358-8e73-7a940b102a46 response_code = 204 uri = /vpc-routes
22432024-12-21T00:22:31.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47590
22442024-12-21T00:22:31.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47590 req_id = 88604227-e28a-465f-a3cb-e0e238b54f2d response_code = 200 uri = /v2p
22452024-12-21T00:22:31.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50091
22462024-12-21T00:22:31.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22472024-12-21T00:22:31.433ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22482024-12-21T00:22:31.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50091 req_id = 3ba4048a-8217-40f6-915e-14c301e2521f response_code = 204 uri = /switch-ports
22492024-12-21T00:22:31.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50091 req_id = 9c478aea-b94e-4d88-aa2e-895b4a2bba65 response_code = 200 uri = /network-bootstore-config
22502024-12-21T00:22:32.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60203
22512024-12-21T00:22:32.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60203 req_id = 9dcc5008-66e2-4e6c-8cc0-1676157091da response_code = 200 uri = /vpc-routes
22522024-12-21T00:22:32.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22532024-12-21T00:22:32.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60203 req_id = 76702dde-81b4-46bf-801b-ecb95ff7958a response_code = 204 uri = /eip-gateways
22542024-12-21T00:22:32.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61173
22552024-12-21T00:22:32.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61173 req_id = 0d91d5fd-1f0a-4603-bbe3-5e851dfd33d9 response_code = 200 uri = /vpc-routes
22562024-12-21T00:22:32.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60203 req_id = 67237ba8-9173-49cb-aefc-e2b8e062514e response_code = 204 uri = /vpc-routes
22572024-12-21T00:22:32.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56548
22582024-12-21T00:22:32.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22592024-12-21T00:22:32.299ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22602024-12-21T00:22:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56548 req_id = 8bde4777-d5a6-4de9-8bec-ff8752fcceea response_code = 204 uri = /switch-ports
22612024-12-21T00:22:32.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42362
22622024-12-21T00:22:32.359ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22632024-12-21T00:22:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61173 req_id = 90f28b79-16dc-4d41-a560-9ab9866e23a2 response_code = 204 uri = /eip-gateways
22642024-12-21T00:22:32.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63868
22652024-12-21T00:22:32.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51442
22662024-12-21T00:22:32.359ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22672024-12-21T00:22:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56548 req_id = f4c7d96a-1bb9-4144-b7ba-2ec37fa9892d response_code = 200 uri = /network-bootstore-config
22682024-12-21T00:22:32.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51442 req_id = cfea3cc1-731b-41a9-8cbb-5974d0b654d2 response_code = 200 uri = /v2p
22692024-12-21T00:22:32.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3858 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63868 req_id = f55d6cd4-16a8-4ddf-bf11-071917e8ba2b response_code = 200 uri = /v2p
22702024-12-21T00:22:32.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61173 req_id = 84d42311-de27-4b0d-8be4-282233017390 response_code = 204 uri = /vpc-routes
22712024-12-21T00:22:32.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22722024-12-21T00:22:32.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42362 req_id = cdfe2001-3def-4301-a1be-ebf6e92efa97 response_code = 204 uri = /switch-ports
22732024-12-21T00:22:32.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42362 req_id = c5681f71-b776-4118-bc92-ba80f312bba0 response_code = 200 uri = /network-bootstore-config
22742024-12-21T00:22:44.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9130 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 0f6e34cf-240b-46d4-b672-26f86fabfa6c response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
22752024-12-21T00:22:49.335ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63339
22762024-12-21T00:22:49.336ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63339 req_id = c56db3ac-89bc-4d42-bbd8-d33b31e73185 response_code = 200 uri = /baseboard
22772024-12-21T00:23:01.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54432
22782024-12-21T00:23:01.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54432 req_id = 148c2293-10c3-4d48-ab4e-57f2c9b9c394 response_code = 200 uri = /vpc-routes
22792024-12-21T00:23:01.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61119
22802024-12-21T00:23:01.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61119 req_id = 15b0cd7b-73ec-40e2-91bd-9a3bf7198547 response_code = 200 uri = /v2p
22812024-12-21T00:23:01.438ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22822024-12-21T00:23:01.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54432 req_id = a3a7986c-a41b-4f4b-b2d1-5ee2d3daf44f response_code = 204 uri = /eip-gateways
22832024-12-21T00:23:01.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54432 req_id = 33f0cae7-6bc1-4e03-a87c-db1153a86a80 response_code = 204 uri = /vpc-routes
22842024-12-21T00:23:01.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63617
22852024-12-21T00:23:01.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22862024-12-21T00:23:01.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22872024-12-21T00:23:01.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91607 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63617 req_id = 47fd22fc-9432-49b2-a67e-be90d64c1994 response_code = 204 uri = /switch-ports
22882024-12-21T00:23:01.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63617 req_id = 37e2f478-a493-4adb-8584-b7563afa595d response_code = 200 uri = /network-bootstore-config
22892024-12-21T00:23:02.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51187
22902024-12-21T00:23:02.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51187 req_id = 0cff601c-044f-4b1b-a32e-0d1d834a6678 response_code = 200 uri = /vpc-routes
22912024-12-21T00:23:02.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65531
22922024-12-21T00:23:02.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65531 req_id = f0d1c267-bd4b-4004-9246-23f2664617a1 response_code = 200 uri = /vpc-routes
22932024-12-21T00:23:02.338ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22942024-12-21T00:23:02.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51187 req_id = 8b038009-368d-49da-835f-49295baeac81 response_code = 204 uri = /eip-gateways
22952024-12-21T00:23:02.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51187 req_id = 4e382385-5bb6-463f-9d11-9756da649378 response_code = 204 uri = /vpc-routes
22962024-12-21T00:23:02.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
22972024-12-21T00:23:02.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65531 req_id = e8336e04-8378-414d-91df-191a71bb8057 response_code = 204 uri = /eip-gateways
22982024-12-21T00:23:02.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65531 req_id = 91bdd973-bc3e-44da-8f64-78c5b9c06393 response_code = 204 uri = /vpc-routes
22992024-12-21T00:23:02.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41660
23002024-12-21T00:23:02.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41660 req_id = 98a48aa5-0ca8-4b1f-aa18-2b9773fbffd1 response_code = 200 uri = /v2p
23012024-12-21T00:23:02.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39625
23022024-12-21T00:23:02.413ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23032024-12-21T00:23:02.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23042024-12-21T00:23:02.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39625 req_id = 53763393-90a1-4f6a-9fac-d6009a7b55dc response_code = 204 uri = /switch-ports
23052024-12-21T00:23:02.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44681
23062024-12-21T00:23:02.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44681 req_id = b0c83d36-d948-4f0c-8070-aee5d454ea58 response_code = 200 uri = /v2p
23072024-12-21T00:23:02.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39625 req_id = f043bd16-1d23-49e5-a316-f5cb06bce066 response_code = 200 uri = /network-bootstore-config
23082024-12-21T00:23:02.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41617
23092024-12-21T00:23:02.554ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23102024-12-21T00:23:02.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23112024-12-21T00:23:02.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41617 req_id = 652d0256-1f99-4ec0-8c99-1dba97e2dc09 response_code = 204 uri = /switch-ports
23122024-12-21T00:23:02.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41617 req_id = 436c9b49-ab43-415d-80cf-2b9bdb050134 response_code = 200 uri = /network-bootstore-config
23132024-12-21T00:23:14.862ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8380 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 41fbb1f4-c778-42f9-bb79-c5878f798461 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
23142024-12-21T00:23:19.368ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57617
23152024-12-21T00:23:19.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57617 req_id = 253ba897-ce25-4ef2-af37-1865a31613bb response_code = 200 uri = /baseboard
23162024-12-21T00:23:31.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44969
23172024-12-21T00:23:31.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44969 req_id = b4d59e57-318b-4678-9245-f6747569d7bc response_code = 200 uri = /vpc-routes
23182024-12-21T00:23:31.398ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23192024-12-21T00:23:31.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44969 req_id = 5778a8a8-ac40-4869-8cc7-7a7e0d0f9893 response_code = 204 uri = /eip-gateways
23202024-12-21T00:23:31.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35697
23212024-12-21T00:23:31.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23222024-12-21T00:23:31.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23232024-12-21T00:23:31.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35697 req_id = 7f4d32c9-81ae-4355-b484-33147f09d9dd response_code = 204 uri = /switch-ports
23242024-12-21T00:23:31.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34878
23252024-12-21T00:23:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35697 req_id = 7a217b39-edd3-40da-9e8d-f5df8e71ebf7 response_code = 200 uri = /network-bootstore-config
23262024-12-21T00:23:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34878 req_id = c7078bf9-8e1c-44d3-b945-67a8c9a23b12 response_code = 200 uri = /v2p
23272024-12-21T00:23:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44969 req_id = 3450633f-88e7-4f54-9fc4-c68c69f4b7bf response_code = 204 uri = /vpc-routes
23282024-12-21T00:23:32.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42317
23292024-12-21T00:23:32.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42317 req_id = 59f686bd-1cf0-4caf-8b45-5ed1a84d62f0 response_code = 200 uri = /vpc-routes
23302024-12-21T00:23:32.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55906
23312024-12-21T00:23:32.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55906 req_id = a2f33ae7-3c2f-4f1d-8be5-7d35d1bb5a3e response_code = 200 uri = /v2p
23322024-12-21T00:23:32.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35712
23332024-12-21T00:23:32.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35712 req_id = 4fbfff4b-4df0-46ea-872d-266e0eb61d2c response_code = 200 uri = /vpc-routes
23342024-12-21T00:23:32.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23352024-12-21T00:23:32.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42317 req_id = 39ad92d6-cb27-40e5-a7f5-a3c7ca950da2 response_code = 204 uri = /eip-gateways
23362024-12-21T00:23:32.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42317 req_id = fd523cf1-aa56-40a4-89bb-a99b3cbf6298 response_code = 204 uri = /vpc-routes
23372024-12-21T00:23:32.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23382024-12-21T00:23:32.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35712 req_id = 71279b86-94db-4f02-be12-e73d80e7ec6c response_code = 204 uri = /eip-gateways
23392024-12-21T00:23:32.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40117
23402024-12-21T00:23:32.263ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23412024-12-21T00:23:32.303ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23422024-12-21T00:23:32.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40117 req_id = cd5dc06d-b391-45e5-a148-2fce9d0f6b74 response_code = 204 uri = /switch-ports
23432024-12-21T00:23:32.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34797
23442024-12-21T00:23:32.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53949
23452024-12-21T00:23:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35712 req_id = 95329b5f-b2a5-476f-b3a1-4bb332144b37 response_code = 204 uri = /vpc-routes
23462024-12-21T00:23:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40117 req_id = c1ac3794-10b7-488b-94d9-c25d1287346d response_code = 200 uri = /network-bootstore-config
23472024-12-21T00:23:32.359ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23482024-12-21T00:23:32.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34797 req_id = 1db32cda-6256-4c0a-85eb-53a4a7914052 response_code = 200 uri = /v2p
23492024-12-21T00:23:32.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23502024-12-21T00:23:32.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94287 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53949 req_id = 4705d048-d685-4939-9d56-76becf742eaf response_code = 204 uri = /switch-ports
23512024-12-21T00:23:32.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53949 req_id = 787a083c-f64c-4528-9cb7-6cd4238d8417 response_code = 200 uri = /network-bootstore-config
23522024-12-21T00:23:44.864ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10017 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 2c38dced-e453-4943-97c2-ddd8527044ab response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
23532024-12-21T00:23:49.403ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44487
23542024-12-21T00:23:49.403ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44487 req_id = 1c4543ae-12c6-4398-9688-ddf377451754 response_code = 200 uri = /baseboard
23552024-12-21T00:24:01.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55794
23562024-12-21T00:24:01.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55794 req_id = 98d35e21-6bf1-4b5a-a88c-0ce05f4c50f3 response_code = 200 uri = /vpc-routes
23572024-12-21T00:24:01.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40675
23582024-12-21T00:24:01.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40675 req_id = 21ba7ff9-843e-442b-be57-3f2b8fc3682f response_code = 200 uri = /v2p
23592024-12-21T00:24:01.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23602024-12-21T00:24:01.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55794 req_id = 3527f5c1-3855-43bb-bc76-eaa44c6cc034 response_code = 204 uri = /eip-gateways
23612024-12-21T00:24:01.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55794 req_id = 26fb9667-f3c1-44e8-9f43-307fc9df829e response_code = 204 uri = /vpc-routes
23622024-12-21T00:24:01.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44296
23632024-12-21T00:24:01.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23642024-12-21T00:24:01.671ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23652024-12-21T00:24:01.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44296 req_id = c968207b-59b5-4723-a507-9e77fe9d2520 response_code = 204 uri = /switch-ports
23662024-12-21T00:24:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44296 req_id = b415728e-6f47-4e50-9f5c-2b97fc744677 response_code = 200 uri = /network-bootstore-config
23672024-12-21T00:24:02.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48657
23682024-12-21T00:24:02.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48657 req_id = 644ed140-4c91-4adc-b07e-78eff9a58025 response_code = 200 uri = /vpc-routes
23692024-12-21T00:24:02.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61424
23702024-12-21T00:24:02.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61424 req_id = 126f837d-80ff-4d28-9dcf-0ec5918ed72e response_code = 200 uri = /vpc-routes
23712024-12-21T00:24:02.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23722024-12-21T00:24:02.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48657 req_id = 409a0d83-04ce-4863-a7a3-1397365019c6 response_code = 204 uri = /eip-gateways
23732024-12-21T00:24:02.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48657 req_id = 70bb5f68-1ed5-406a-8772-60bfa1e9d4f9 response_code = 204 uri = /vpc-routes
23742024-12-21T00:24:02.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23752024-12-21T00:24:02.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61424 req_id = 7054387b-049d-4d29-92db-0c7bac1e3d4d response_code = 204 uri = /eip-gateways
23762024-12-21T00:24:02.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61424 req_id = ba4e5cd9-fdcf-4735-9d8d-5864d85bc026 response_code = 204 uri = /vpc-routes
23772024-12-21T00:24:02.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64818
23782024-12-21T00:24:02.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64818 req_id = 4e8f5615-bdb3-463d-b70c-174d6dddfcd9 response_code = 200 uri = /v2p
23792024-12-21T00:24:02.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63930
23802024-12-21T00:24:02.450ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23812024-12-21T00:24:02.505ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23822024-12-21T00:24:02.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63930 req_id = a9de4f09-e2f7-432f-8e66-13aa1ca61b7e response_code = 204 uri = /switch-ports
23832024-12-21T00:24:02.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60416
23842024-12-21T00:24:02.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63930 req_id = 93d20ca4-7363-4be9-a229-af6f6df40e20 response_code = 200 uri = /network-bootstore-config
23852024-12-21T00:24:02.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60416 req_id = 7756ce28-3ece-480a-b959-9422d55de8fb response_code = 200 uri = /v2p
23862024-12-21T00:24:02.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64912
23872024-12-21T00:24:02.606ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23882024-12-21T00:24:02.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23892024-12-21T00:24:02.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134713 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64912 req_id = 86425334-55e5-4ad3-a577-a0c859ebb564 response_code = 204 uri = /switch-ports
23902024-12-21T00:24:02.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64912 req_id = bd4ee355-5f68-470e-b31c-0c147fe979a4 response_code = 200 uri = /network-bootstore-config
23912024-12-21T00:24:14.861ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8008 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 53d9722b-f8c0-44ef-ac00-b262d74572b9 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
23922024-12-21T00:24:19.435ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40303
23932024-12-21T00:24:19.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40303 req_id = eb9fb19a-5be1-49f7-af53-53e5c8479a2a response_code = 200 uri = /baseboard
23942024-12-21T00:24:31.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43446
23952024-12-21T00:24:31.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43446 req_id = fee84721-9e7f-4960-89e5-b6361dfbf94b response_code = 200 uri = /vpc-routes
23962024-12-21T00:24:31.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64921
23972024-12-21T00:24:31.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64921 req_id = 84812873-9ab9-43a1-b1d9-7b762949c3b6 response_code = 200 uri = /v2p
23982024-12-21T00:24:31.250ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
23992024-12-21T00:24:31.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43446 req_id = 81c53807-76a1-4a15-8b16-aee96bbc1a0e response_code = 204 uri = /eip-gateways
24002024-12-21T00:24:31.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43446 req_id = 1d7434dd-2820-44a5-84c9-17f159ef280c response_code = 204 uri = /vpc-routes
24012024-12-21T00:24:31.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39948
24022024-12-21T00:24:31.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24032024-12-21T00:24:31.349ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24042024-12-21T00:24:31.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39948 req_id = ab7ccf36-eab8-4ad9-910e-3647cbed3d81 response_code = 204 uri = /switch-ports
24052024-12-21T00:24:31.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39948 req_id = 0b50bd40-6e9d-414a-8818-5ecfa74a7e39 response_code = 200 uri = /network-bootstore-config
24062024-12-21T00:24:32.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61004
24072024-12-21T00:24:32.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61004 req_id = 7f662c77-7993-4263-bd06-06e9122e806f response_code = 200 uri = /vpc-routes
24082024-12-21T00:24:32.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45383
24092024-12-21T00:24:32.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45383 req_id = 377e2943-0311-492d-bcda-83c39c3c01e1 response_code = 200 uri = /vpc-routes
24102024-12-21T00:24:32.184ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24112024-12-21T00:24:32.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61004 req_id = cf86563e-5777-447b-b90c-772f27a567b0 response_code = 204 uri = /eip-gateways
24122024-12-21T00:24:32.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24132024-12-21T00:24:32.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45383 req_id = 98041686-72fa-4c05-b1d1-e9fc990d82be response_code = 204 uri = /eip-gateways
24142024-12-21T00:24:32.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61004 req_id = 25c378f5-adb1-4455-a4d1-9c093c8faac2 response_code = 204 uri = /vpc-routes
24152024-12-21T00:24:32.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45383 req_id = 2f3531fc-8634-48ca-9018-1930a5ae313b response_code = 204 uri = /vpc-routes
24162024-12-21T00:24:32.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60432
24172024-12-21T00:24:32.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60432 req_id = 5ac1f5d3-3c51-4d0c-af84-9126cd4452a2 response_code = 200 uri = /v2p
24182024-12-21T00:24:32.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41297
24192024-12-21T00:24:32.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24202024-12-21T00:24:32.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24212024-12-21T00:24:32.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94293 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41297 req_id = 3b74ea92-ec1b-444c-92be-86a60b7450ad response_code = 204 uri = /switch-ports
24222024-12-21T00:24:32.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45744
24232024-12-21T00:24:32.347ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24242024-12-21T00:24:32.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3631 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41297 req_id = e414bd96-e1d6-4d25-9c47-1cfc4b376959 response_code = 200 uri = /network-bootstore-config
24252024-12-21T00:24:32.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33099
24262024-12-21T00:24:32.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33099 req_id = 065d47f6-e152-4869-8ddd-0fdc6bc9a032 response_code = 200 uri = /v2p
24272024-12-21T00:24:32.380ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24282024-12-21T00:24:32.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45744 req_id = 135424ed-82a6-46ee-8588-78bda3206d8d response_code = 204 uri = /switch-ports
24292024-12-21T00:24:32.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45744 req_id = 6afdf2a1-a3a8-4fa0-b97c-78a2321fa28b response_code = 200 uri = /network-bootstore-config
24302024-12-21T00:24:44.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9724 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 13186363-ab97-45ef-8570-3f13c0474f53 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
24312024-12-21T00:24:49.468ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56033
24322024-12-21T00:24:49.468ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56033 req_id = 8071440c-ff4a-426d-a4ec-981fef4f60da response_code = 200 uri = /baseboard
24332024-12-21T00:24:55.346ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24342024-12-21T00:24:55.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24352024-12-21T00:24:55.379ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1978, tv_nsec: 687692881 } time_to_next_cleanup = 599.9999973s
24362024-12-21T00:25:01.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63686
24372024-12-21T00:25:01.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63686 req_id = a037a26c-eb7f-4b4c-9491-e433bc346054 response_code = 200 uri = /v2p
24382024-12-21T00:25:01.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49217
24392024-12-21T00:25:01.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49217 req_id = dc1a59cf-28e6-4b54-bfdc-a755a1a4413f response_code = 200 uri = /vpc-routes
24402024-12-21T00:25:01.636ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24412024-12-21T00:25:01.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49217 req_id = b9a663d6-f13e-4020-ba51-f29cdaba89c5 response_code = 204 uri = /eip-gateways
24422024-12-21T00:25:01.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49217 req_id = 70401dea-5cec-4295-ac8e-e355a5acd073 response_code = 204 uri = /vpc-routes
24432024-12-21T00:25:01.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39005
24442024-12-21T00:25:01.765ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24452024-12-21T00:25:01.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24462024-12-21T00:25:01.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39005 req_id = cd658451-90d1-4ba9-bd8c-afedaacb54f3 response_code = 204 uri = /switch-ports
24472024-12-21T00:25:01.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39005 req_id = 65b17be8-1480-4b59-93bd-efd2283d071d response_code = 200 uri = /network-bootstore-config
24482024-12-21T00:25:02.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60841
24492024-12-21T00:25:02.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60841 req_id = b8f7230e-192f-4e36-941c-e37c8d182693 response_code = 200 uri = /vpc-routes
24502024-12-21T00:25:02.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60652
24512024-12-21T00:25:02.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60652 req_id = 57663545-c9ac-45ef-bc3b-f4ba67854896 response_code = 200 uri = /vpc-routes
24522024-12-21T00:25:02.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24532024-12-21T00:25:02.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60652 req_id = 69185d51-0e1f-4cc9-a515-93897b0bb913 response_code = 204 uri = /eip-gateways
24542024-12-21T00:25:02.336ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24552024-12-21T00:25:02.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60841 req_id = 9f04fea5-ea94-44fc-94ea-33825131c4c1 response_code = 204 uri = /eip-gateways
24562024-12-21T00:25:02.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60841 req_id = b2d89807-4822-42df-9188-931a1fd8baa8 response_code = 204 uri = /vpc-routes
24572024-12-21T00:25:02.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37897
24582024-12-21T00:25:02.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37897 req_id = 5ebf3293-c22c-4c01-bedb-f4d6129c8652 response_code = 200 uri = /v2p
24592024-12-21T00:25:02.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60652 req_id = 9a5e746e-a582-47a2-8e56-3d2ae66cc26f response_code = 204 uri = /vpc-routes
24602024-12-21T00:25:02.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47654
24612024-12-21T00:25:02.456ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24622024-12-21T00:25:02.494ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24632024-12-21T00:25:02.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91720 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47654 req_id = bb08fa8a-9cee-4fdb-ac93-333f6e7671b9 response_code = 204 uri = /switch-ports
24642024-12-21T00:25:02.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55635
24652024-12-21T00:25:02.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38311
24662024-12-21T00:25:02.548ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24672024-12-21T00:25:02.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47654 req_id = 4fa6b0bc-6e5a-44ea-9a71-cf83eafd6cfa response_code = 200 uri = /network-bootstore-config
24682024-12-21T00:25:02.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3841 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55635 req_id = 36599b5c-b2ac-4cb1-8f9b-d32395405738 response_code = 200 uri = /v2p
24692024-12-21T00:25:02.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24702024-12-21T00:25:02.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38311 req_id = 1c30dc36-189e-47a4-8e7c-53fa0451e18b response_code = 204 uri = /switch-ports
24712024-12-21T00:25:02.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38311 req_id = cac66a85-4762-4782-833f-4561a4427bf5 response_code = 200 uri = /network-bootstore-config
24722024-12-21T00:25:09.230ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24732024-12-21T00:25:14.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7834 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 6a4a5e40-bb16-4653-91a6-8c9aff3daf5e response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
24742024-12-21T00:25:19.501ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61929
24752024-12-21T00:25:19.502ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61929 req_id = 50e50f3d-9583-4878-8d7c-3d3b535ccad9 response_code = 200 uri = /baseboard
24762024-12-21T00:25:31.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47528
24772024-12-21T00:25:31.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47528 req_id = f66d3123-7ffe-427b-bf83-73ea747527c9 response_code = 200 uri = /vpc-routes
24782024-12-21T00:25:31.282ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24792024-12-21T00:25:31.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47528 req_id = 2dee6ced-0778-4f85-9594-cb5ae4dceca5 response_code = 204 uri = /eip-gateways
24802024-12-21T00:25:31.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56250
24812024-12-21T00:25:31.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56250 req_id = 1aea62d7-c481-404b-920b-9bd6d07dca70 response_code = 200 uri = /v2p
24822024-12-21T00:25:31.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47528 req_id = 7eefcfaa-27cf-4bb9-99f0-e03535bf9c0e response_code = 204 uri = /vpc-routes
24832024-12-21T00:25:31.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44862
24842024-12-21T00:25:31.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24852024-12-21T00:25:31.466ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24862024-12-21T00:25:31.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44862 req_id = 16282a09-e3a6-4a5e-864a-f2cf6c04b617 response_code = 204 uri = /switch-ports
24872024-12-21T00:25:31.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44862 req_id = 07633b5c-1204-412b-ac62-b503c7fa5384 response_code = 200 uri = /network-bootstore-config
24882024-12-21T00:25:32.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47433
24892024-12-21T00:25:32.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47433 req_id = 5447c3a7-5938-498c-a9e6-1e02ea6f9419 response_code = 200 uri = /vpc-routes
24902024-12-21T00:25:32.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55024
24912024-12-21T00:25:32.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55024 req_id = 8ea9af30-a606-4d7a-94ef-d54fda105625 response_code = 200 uri = /v2p
24922024-12-21T00:25:32.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54980
24932024-12-21T00:25:32.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54980 req_id = 2960ca6c-ab26-4b5b-82a4-95274e8b9ebd response_code = 200 uri = /vpc-routes
24942024-12-21T00:25:32.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24952024-12-21T00:25:32.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47433 req_id = a10e7945-a294-4aac-ae5d-bcf8aaf436bc response_code = 204 uri = /eip-gateways
24962024-12-21T00:25:32.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47433 req_id = c4d08cd1-58ae-46c0-b519-25f40a759347 response_code = 204 uri = /vpc-routes
24972024-12-21T00:25:32.240ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
24982024-12-21T00:25:32.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54980 req_id = 69757b62-01c2-4c1a-bf21-07d2b68999da response_code = 204 uri = /eip-gateways
24992024-12-21T00:25:32.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54980 req_id = 40f14ecf-dba3-4984-8619-c1ffe7d21887 response_code = 204 uri = /vpc-routes
25002024-12-21T00:25:32.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43189
25012024-12-21T00:25:32.282ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25022024-12-21T00:25:32.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25032024-12-21T00:25:32.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43189 req_id = e08ded08-50be-4d74-a4ac-0344f8324e32 response_code = 204 uri = /switch-ports
25042024-12-21T00:25:32.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51272
25052024-12-21T00:25:32.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58756
25062024-12-21T00:25:32.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58756 req_id = 299ceacb-e6aa-4be8-b9d3-d448aa18f7b0 response_code = 200 uri = /v2p
25072024-12-21T00:25:32.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25082024-12-21T00:25:32.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43189 req_id = 81abb891-fcb3-447e-b19d-51ad9df93266 response_code = 200 uri = /network-bootstore-config
25092024-12-21T00:25:32.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25102024-12-21T00:25:32.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51272 req_id = cd7c272c-01d3-4157-acf6-667f58b47459 response_code = 204 uri = /switch-ports
25112024-12-21T00:25:32.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51272 req_id = 3469e0c6-ba77-4f66-9fa4-44b73b9c229b response_code = 200 uri = /network-bootstore-config
25122024-12-21T00:25:44.861ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7918 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 31145089-3212-4579-b980-5df1101f7bc8 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
25132024-12-21T00:25:49.535ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36161
25142024-12-21T00:25:49.535ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36161 req_id = a1f64269-442c-4777-b57f-95fe0b2cb8f0 response_code = 200 uri = /baseboard
25152024-12-21T00:26:01.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53734
25162024-12-21T00:26:01.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53734 req_id = f97ae45a-a7f9-403a-b1ce-bdfce7d9f1ed response_code = 200 uri = /vpc-routes
25172024-12-21T00:26:01.367ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25182024-12-21T00:26:01.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53734 req_id = 9f6dddf7-7b09-45cd-9b43-e7f10fd4ec7a response_code = 204 uri = /eip-gateways
25192024-12-21T00:26:01.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53734 req_id = 26e77f66-1c7f-49c8-bffc-2d20bafa56ea response_code = 204 uri = /vpc-routes
25202024-12-21T00:26:01.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43193
25212024-12-21T00:26:01.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43193 req_id = fc3988d4-2acc-4fcd-98d3-33fcd8f0e9bb response_code = 200 uri = /v2p
25222024-12-21T00:26:01.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59336
25232024-12-21T00:26:01.636ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25242024-12-21T00:26:01.675ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25252024-12-21T00:26:01.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59336 req_id = 6b8e5632-b152-49d8-8953-cefda807bdbb response_code = 204 uri = /switch-ports
25262024-12-21T00:26:01.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59336 req_id = b11c8bb4-9f64-4530-99a1-24a2a96eff13 response_code = 200 uri = /network-bootstore-config
25272024-12-21T00:26:02.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37489
25282024-12-21T00:26:02.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37489 req_id = 0fbd0e7a-9f62-40f2-8aa9-a8e106bebb72 response_code = 200 uri = /vpc-routes
25292024-12-21T00:26:02.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53650
25302024-12-21T00:26:02.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53650 req_id = 31bc215a-ea28-408b-9cb4-43563c99831f response_code = 200 uri = /vpc-routes
25312024-12-21T00:26:02.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25322024-12-21T00:26:02.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37489 req_id = 334a964b-7508-40ef-9a15-08c58dd5d710 response_code = 204 uri = /eip-gateways
25332024-12-21T00:26:02.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25342024-12-21T00:26:02.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53650 req_id = b30623c4-a9c9-45b0-b8fa-a2fbcb6cfef1 response_code = 204 uri = /eip-gateways
25352024-12-21T00:26:02.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49140
25362024-12-21T00:26:02.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49140 req_id = bcc7d5a5-ffc9-436a-ba54-380610f5f517 response_code = 200 uri = /v2p
25372024-12-21T00:26:02.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53650 req_id = f3a615a9-d3c3-4776-95fb-baa6bb9e595c response_code = 204 uri = /vpc-routes
25382024-12-21T00:26:02.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37489 req_id = 66680777-1a5b-474d-8529-c06f6471a218 response_code = 204 uri = /vpc-routes
25392024-12-21T00:26:02.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40059
25402024-12-21T00:26:02.513ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25412024-12-21T00:26:02.551ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25422024-12-21T00:26:02.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93313 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40059 req_id = a42ca105-dbc1-4ce6-b4bf-f5b12090666b response_code = 204 uri = /switch-ports
25432024-12-21T00:26:02.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64659
25442024-12-21T00:26:02.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57331
25452024-12-21T00:26:02.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57331 req_id = dd354b28-54eb-4b50-8d04-7f5637d963f5 response_code = 200 uri = /v2p
25462024-12-21T00:26:02.607ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25472024-12-21T00:26:02.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40059 req_id = ad46d35c-4aa6-4c17-a3e9-6f2b362c6876 response_code = 200 uri = /network-bootstore-config
25482024-12-21T00:26:02.642ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25492024-12-21T00:26:02.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64659 req_id = e5ab2792-8fcb-40fe-8685-cfe284126dbf response_code = 204 uri = /switch-ports
25502024-12-21T00:26:02.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64659 req_id = 5348ddda-5865-46b1-ae69-b2592a229ea7 response_code = 200 uri = /network-bootstore-config
25512024-12-21T00:26:14.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7280 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 9ff6d135-c390-4182-bf11-41197b54dbfb response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
25522024-12-21T00:26:19.570ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45750
25532024-12-21T00:26:19.570ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45750 req_id = 2ac8fecb-dd64-4b10-b383-07d759ee6556 response_code = 200 uri = /baseboard
25542024-12-21T00:26:31.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52815
25552024-12-21T00:26:31.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52815 req_id = 200e7d1c-da8f-4b08-bf81-622e92b1f432 response_code = 200 uri = /vpc-routes
25562024-12-21T00:26:31.313ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25572024-12-21T00:26:31.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52815 req_id = 9fe734dd-7e2c-46c7-9ee4-1a87452d3f2b response_code = 204 uri = /eip-gateways
25582024-12-21T00:26:31.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52815 req_id = e6a7f854-5acc-451b-931b-595dd2a9f1a0 response_code = 204 uri = /vpc-routes
25592024-12-21T00:26:31.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34703
25602024-12-21T00:26:31.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25612024-12-21T00:26:31.381ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25622024-12-21T00:26:31.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95266 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34703 req_id = ef908a35-01b4-4a9f-ba36-e980c896709c response_code = 204 uri = /switch-ports
25632024-12-21T00:26:31.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34703 req_id = 8e37c799-2559-443f-b9a8-3555bfce7ce3 response_code = 200 uri = /network-bootstore-config
25642024-12-21T00:26:31.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60488
25652024-12-21T00:26:31.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60488 req_id = dc7ce034-5391-4fc6-b80c-6cc8f057e9e0 response_code = 200 uri = /v2p
25662024-12-21T00:26:32.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45694
25672024-12-21T00:26:32.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45694 req_id = 879d0f42-1227-451c-bc1a-10e5ee78d5f0 response_code = 200 uri = /vpc-routes
25682024-12-21T00:26:32.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47856
25692024-12-21T00:26:32.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47856 req_id = 7d49fd04-d0f1-444d-93b6-e0399d374aca response_code = 200 uri = /vpc-routes
25702024-12-21T00:26:32.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64648
25712024-12-21T00:26:32.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64648 req_id = ca5fffab-351b-4213-827c-3f2762417d49 response_code = 200 uri = /v2p
25722024-12-21T00:26:32.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25732024-12-21T00:26:32.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45694 req_id = b68984cd-f75b-43a5-82a4-0cb31b734657 response_code = 204 uri = /eip-gateways
25742024-12-21T00:26:32.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25752024-12-21T00:26:32.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47856 req_id = c8065f08-3801-49ab-b6a7-51afe1536f11 response_code = 204 uri = /eip-gateways
25762024-12-21T00:26:32.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45694 req_id = c37af7f1-367d-432c-9beb-a4f53a49418e response_code = 204 uri = /vpc-routes
25772024-12-21T00:26:32.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47856 req_id = cb2f332a-439c-4c7e-873e-dc437393e80f response_code = 204 uri = /vpc-routes
25782024-12-21T00:26:32.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55092
25792024-12-21T00:26:32.307ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25802024-12-21T00:26:32.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25812024-12-21T00:26:32.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55092 req_id = 9b652a1a-b992-4f3a-9b37-ce2ba4191604 response_code = 204 uri = /switch-ports
25822024-12-21T00:26:32.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50497
25832024-12-21T00:26:32.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35071
25842024-12-21T00:26:32.401ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25852024-12-21T00:26:32.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50497 req_id = b4357590-61d8-4de9-b7ef-01246a97ea5f response_code = 200 uri = /v2p
25862024-12-21T00:26:32.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55092 req_id = 113d915d-4f32-4156-ba34-fdec84ff5ff6 response_code = 200 uri = /network-bootstore-config
25872024-12-21T00:26:32.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25882024-12-21T00:26:32.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35071 req_id = 2420537f-cf63-4f4f-bf64-d019800441f8 response_code = 204 uri = /switch-ports
25892024-12-21T00:26:32.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35071 req_id = e6c5e6c1-0c85-4da3-ae99-d3a3a06382bc response_code = 200 uri = /network-bootstore-config
25902024-12-21T00:26:44.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7791 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = ade3e8c4-f1c0-4ab9-9df6-7fb785878c05 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
25912024-12-21T00:26:49.604ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56262
25922024-12-21T00:26:49.604ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56262 req_id = cf509710-f224-44b0-9344-9160ca51c291 response_code = 200 uri = /baseboard
25932024-12-21T00:27:01.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44473
25942024-12-21T00:27:01.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44473 req_id = 18b8c467-c9c5-4a17-b157-bece944551de response_code = 200 uri = /vpc-routes
25952024-12-21T00:27:01.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
25962024-12-21T00:27:01.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44473 req_id = d894bcea-11c7-4878-8d53-2ec1beb76143 response_code = 204 uri = /eip-gateways
25972024-12-21T00:27:01.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41814
25982024-12-21T00:27:01.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25992024-12-21T00:27:01.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26002024-12-21T00:27:01.626ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
26012024-12-21T00:27:01.626ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
26022024-12-21T00:27:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 418 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44473 req_id = f491a51f-0d9e-4142-b495-c8130998a017 response_code = 204 uri = /vpc-routes
26032024-12-21T00:27:01.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47837
26042024-12-21T00:27:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47837 req_id = cf63541d-f6d8-4bb4-82cb-4169831cc233 response_code = 200 uri = /v2p
26052024-12-21T00:27:01.640ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26062024-12-21T00:27:01.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33
26072024-12-21T00:27:01.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39396
26082024-12-21T00:27:01.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26092024-12-21T00:27:01.666ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26102024-12-21T00:27:01.666ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b
26112024-12-21T00:27:01.691ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26122024-12-21T00:27:01.694ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26132024-12-21T00:27:01.695ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19
26142024-12-21T00:27:01.721ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26152024-12-21T00:27:01.721ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db606984-291b-40d5-964e-14a228d68e45
26162024-12-21T00:27:01.745ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26172024-12-21T00:27:01.745ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4
26182024-12-21T00:27:01.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109651 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39396 req_id = 1984c11e-a1c8-454d-80aa-2333256e7fd0 response_code = 204 uri = /switch-ports
26192024-12-21T00:27:01.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39396 req_id = fe99f967-dca1-4b07-a5aa-244b81b40920 response_code = 200 uri = /network-bootstore-config
26202024-12-21T00:27:01.772ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26212024-12-21T00:27:01.773ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96dd6601-21c1-4f69-a871-ce8980776531
26222024-12-21T00:27:01.798ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26232024-12-21T00:27:01.798ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8504df1b-d5a7-40bd-ad45-c55449857140
26242024-12-21T00:27:01.820ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26252024-12-21T00:27:01.821ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3c5770f-c2a5-4687-9844-df947021ecd9
26262024-12-21T00:27:01.842ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272024-12-21T00:27:01.842ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30f2f8a7-d49b-4582-9153-44098dd8db06
26282024-12-21T00:27:01.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41814 req_id = 9552256a-d667-4936-a60d-682c3e8efb07 response_code = 200 uri = /inventory
26292024-12-21T00:27:01.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40217
26302024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26312024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26322024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26332024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26342024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26352024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26362024-12-21T00:27:01.869ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26372024-12-21T00:27:01.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40217 req_id = 5966f0b5-3736-49f0-97a3-6679c9fb1b79 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26382024-12-21T00:27:02.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47559
26392024-12-21T00:27:02.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47559 req_id = 871830c9-d769-47ff-a644-5c85a4a1edb9 response_code = 200 uri = /vpc-routes
26402024-12-21T00:27:02.249ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
26412024-12-21T00:27:02.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47559 req_id = c1bbae60-74d4-4c45-b925-b911cbab9ff0 response_code = 204 uri = /eip-gateways
26422024-12-21T00:27:02.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47559 req_id = 064fca35-aa1f-410b-b9b2-e5bcf503e63f response_code = 204 uri = /vpc-routes
26432024-12-21T00:27:02.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62598
26442024-12-21T00:27:02.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62598 req_id = fb7ae421-acbb-4e50-ab9d-14fff09bf8c4 response_code = 200 uri = /vpc-routes
26452024-12-21T00:27:02.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
26462024-12-21T00:27:02.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62598 req_id = 208cc66a-9e0b-430e-b7db-d668891fee8b response_code = 204 uri = /eip-gateways
26472024-12-21T00:27:02.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62598 req_id = bc403384-cd51-427a-9a4e-dc1063af33c9 response_code = 204 uri = /vpc-routes
26482024-12-21T00:27:02.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43816
26492024-12-21T00:27:02.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43816 req_id = a4ad7886-3369-4692-b3da-8b20e34ab244 response_code = 200 uri = /v2p
26502024-12-21T00:27:02.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51982
26512024-12-21T00:27:02.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51982 req_id = bfcfb106-ca42-42ac-8d48-c782410c9d4d response_code = 200 uri = /v2p
26522024-12-21T00:27:02.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40559
26532024-12-21T00:27:02.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26542024-12-21T00:27:02.602ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26552024-12-21T00:27:02.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
26562024-12-21T00:27:02.602ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
26572024-12-21T00:27:02.616ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26582024-12-21T00:27:02.616ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33
26592024-12-21T00:27:02.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36786
26602024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26612024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26622024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26632024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26642024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26652024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26662024-12-21T00:27:02.629ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26672024-12-21T00:27:02.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 400 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36786 req_id = 2a2dc9ee-5c8b-4c37-82a4-da416bbd4d69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26682024-12-21T00:27:02.643ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26692024-12-21T00:27:02.643ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b
26702024-12-21T00:27:02.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35521
26712024-12-21T00:27:02.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51138
26722024-12-21T00:27:02.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26732024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5737acf4-123e-4090-a94e-3fc101f94138, kind: Service { id: 5dcc4d7f-195b-48bd-af9a-8171e5938081 }, name: Name("external-dns-5dcc4d7f-195b-48bd-af9a-8171e5938081"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 44])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: baf75dd2-36b9-4dfb-bd3a-84bdce13116f, kind: Service { id: 2455a969-e1b3-4c7e-950a-619db01e265b }, name: Name("external-dns-2455a969-e1b3-4c7e-950a-619db01e265b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67b19966-e423-44b3-a6c3-a054dadfffb7, kind: Service { id: b9d305f8-932f-45eb-802f-6ae1f5c4e9d5 }, name: Name("nexus-b9d305f8-932f-45eb-802f-6ae1f5c4e9d5"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 228, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: badeb7b7-8960-4f27-ac1e-d2003a17fb86, kind: Service { id: c87c1761-8b9f-4711-941e-05b68d81f15d }, name: Name("nexus-c87c1761-8b9f-4711-941e-05b68d81f15d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ed33bf54-9ff3-46a5-82a3-8160bec60c4a, kind: Service { id: daba7770-826f-4668-845b-d5a56b28a4da }, name: Name("nexus-daba7770-826f-4668-845b-d5a56b28a4da"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 250, 40])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26742024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26752024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26762024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26772024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26782024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26792024-12-21T00:27:02.651ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26802024-12-21T00:27:02.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51505
26812024-12-21T00:27:02.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4994 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51138 req_id = 519fb66a-98e1-45f5-9c36-03c528472cd5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26822024-12-21T00:27:02.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26832024-12-21T00:27:02.658ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26842024-12-21T00:27:02.658ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/d42506e4-db68-4701-beb2-382ce82c1175/config/omicron-zones.json file = common/src/ledger.rs:177
26852024-12-21T00:27:02.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35289
26862024-12-21T00:27:02.669ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/config/omicron-zones.json file = common/src/ledger.rs:177
26872024-12-21T00:27:02.672ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26882024-12-21T00:27:02.673ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19
26892024-12-21T00:27:02.690ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 01c0de77-09de-4d5b-bd19-220f8b4fbd33 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26902024-12-21T00:27:02.690ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_01c0de77-09de-4d5b-bd19-220f8b4fbd33
26912024-12-21T00:27:02.693ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26922024-12-21T00:27:02.721ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 81d66e6a-e144-4cc3-bd30-6b2eb46e189b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26932024-12-21T00:27:02.722ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_81d66e6a-e144-4cc3-bd30-6b2eb46e189b
26942024-12-21T00:27:02.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26952024-12-21T00:27:02.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db606984-291b-40d5-964e-14a228d68e45
26962024-12-21T00:27:02.759ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b86cab20-f27c-490c-96fa-4f4929cdcc19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26972024-12-21T00:27:02.759ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b86cab20-f27c-490c-96fa-4f4929cdcc19
26982024-12-21T00:27:02.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26992024-12-21T00:27:02.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120896 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35521 req_id = 32a72472-e40b-4f92-9b86-1ea9b792c842 response_code = 204 uri = /switch-ports
27002024-12-21T00:27:02.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35521 req_id = ce9d787c-ecda-4dbe-9d60-9b8fd32cbcb3 response_code = 200 uri = /network-bootstore-config
27012024-12-21T00:27:02.776ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27022024-12-21T00:27:02.776ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4
27032024-12-21T00:27:02.797ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db606984-291b-40d5-964e-14a228d68e45 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27042024-12-21T00:27:02.797ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db606984-291b-40d5-964e-14a228d68e45
27052024-12-21T00:27:02.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27062024-12-21T00:27:02.819ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27072024-12-21T00:27:02.820ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96dd6601-21c1-4f69-a871-ce8980776531
27082024-12-21T00:27:02.834ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbfac784-9ca5-4ffd-af3e-272d9a87a2f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27092024-12-21T00:27:02.834ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbfac784-9ca5-4ffd-af3e-272d9a87a2f4
27102024-12-21T00:27:02.862ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96dd6601-21c1-4f69-a871-ce8980776531 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27112024-12-21T00:27:02.862ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96dd6601-21c1-4f69-a871-ce8980776531
27122024-12-21T00:27:02.877ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27132024-12-21T00:27:02.877ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8504df1b-d5a7-40bd-ad45-c55449857140
27142024-12-21T00:27:02.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35289 req_id = 5c1e62c2-9f44-4366-b513-01e825378eec response_code = 204 uri = /switch-ports
27152024-12-21T00:27:02.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35289 req_id = 62215853-e82d-44b5-9340-daed7e4a0975 response_code = 200 uri = /network-bootstore-config
27162024-12-21T00:27:02.896ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8504df1b-d5a7-40bd-ad45-c55449857140 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27172024-12-21T00:27:02.896ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8504df1b-d5a7-40bd-ad45-c55449857140
27182024-12-21T00:27:02.910ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27192024-12-21T00:27:02.910ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3c5770f-c2a5-4687-9844-df947021ecd9
27202024-12-21T00:27:02.935ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27212024-12-21T00:27:02.935ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30f2f8a7-d49b-4582-9153-44098dd8db06
27222024-12-21T00:27:02.948ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b3c5770f-c2a5-4687-9844-df947021ecd9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27232024-12-21T00:27:02.948ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b3c5770f-c2a5-4687-9844-df947021ecd9
27242024-12-21T00:27:02.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40559 req_id = 36ac6e5a-2f5c-456d-9a8a-d4d815ff3187 response_code = 200 uri = /inventory
27252024-12-21T00:27:02.972ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 30f2f8a7-d49b-4582-9153-44098dd8db06 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27262024-12-21T00:27:02.973ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_30f2f8a7-d49b-4582-9153-44098dd8db06
27272024-12-21T00:27:02.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51505 req_id = 54ecca01-f4d0-41a8-afe2-aa2577cf8c97 response_code = 200 uri = /inventory
27282024-12-21T00:27:14.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7874 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = f520c013-c35f-4471-b251-9713e012dc9e response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
27292024-12-21T00:27:19.637ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51494
27302024-12-21T00:27:19.637ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51494 req_id = 14b6e012-ee7d-438f-8425-a7b72b0697fd response_code = 200 uri = /baseboard
27312024-12-21T00:27:31.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39115
27322024-12-21T00:27:31.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39115 req_id = 4542a907-9e35-46f3-b9c9-b6dcf81a935f response_code = 200 uri = /vpc-routes
27332024-12-21T00:27:31.284ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
27342024-12-21T00:27:31.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39115 req_id = fb51c269-2e44-4505-b39a-e66d0d05d103 response_code = 204 uri = /eip-gateways
27352024-12-21T00:27:31.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51678
27362024-12-21T00:27:31.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51678 req_id = 368fb163-f113-48df-851c-5e75b26dd04e response_code = 200 uri = /v2p
27372024-12-21T00:27:31.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39115 req_id = 6e1cc06c-39c6-4d2c-86fc-3002f097d176 response_code = 204 uri = /vpc-routes
27382024-12-21T00:27:31.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55850
27392024-12-21T00:27:31.409ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27402024-12-21T00:27:31.446ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27412024-12-21T00:27:31.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90347 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55850 req_id = bb2f5233-8bce-4abd-b68a-a1459043d4e6 response_code = 204 uri = /switch-ports
27422024-12-21T00:27:31.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55850 req_id = 6e5254f0-9142-4d77-bb18-447141f7ddc3 response_code = 200 uri = /network-bootstore-config
27432024-12-21T00:27:32.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50716
27442024-12-21T00:27:32.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50716 req_id = fa30e695-353d-427f-a139-019aaca4f38b response_code = 200 uri = /vpc-routes
27452024-12-21T00:27:32.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45150
27462024-12-21T00:27:32.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45150 req_id = 0794d731-daf0-414d-8864-ad5c741829c5 response_code = 200 uri = /v2p
27472024-12-21T00:27:32.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
27482024-12-21T00:27:32.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50716 req_id = ffbdb2f2-fd61-49e6-8cce-07fc0aed637d response_code = 204 uri = /eip-gateways
27492024-12-21T00:27:32.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50716 req_id = 6b5b3a31-47ef-434f-bc8b-f6295caa9a5e response_code = 204 uri = /vpc-routes
27502024-12-21T00:27:32.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33699
27512024-12-21T00:27:32.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33699 req_id = 9ccb5b98-3201-45dd-a788-d325f0862508 response_code = 200 uri = /vpc-routes
27522024-12-21T00:27:32.244ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
27532024-12-21T00:27:32.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33699 req_id = 71adc480-6775-4e5a-96cf-65a684397d2c response_code = 204 uri = /eip-gateways
27542024-12-21T00:27:32.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33699 req_id = b25a1b68-6082-4423-8ea2-c39367e49898 response_code = 204 uri = /vpc-routes
27552024-12-21T00:27:32.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43419
27562024-12-21T00:27:32.269ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27572024-12-21T00:27:32.311ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27582024-12-21T00:27:32.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43419 req_id = 021f8803-f27d-4fde-b252-335132aedbda response_code = 204 uri = /switch-ports
27592024-12-21T00:27:32.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43419 req_id = 4d8dfe66-9637-4ca0-9290-cb3e535e0b69 response_code = 200 uri = /network-bootstore-config
27602024-12-21T00:27:32.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38962
27612024-12-21T00:27:32.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38962 req_id = 0c3b1139-c7e9-4951-bf2d-f18dff6e04c0 response_code = 200 uri = /v2p
27622024-12-21T00:27:32.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56173
27632024-12-21T00:27:32.397ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27642024-12-21T00:27:32.434ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27652024-12-21T00:27:32.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56173 req_id = 40697929-db4f-48ee-a58e-0b8d6c304d86 response_code = 204 uri = /switch-ports
27662024-12-21T00:27:32.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56173 req_id = 4495e506-df20-4cfe-82fe-0a02ca4ef0d9 response_code = 200 uri = /network-bootstore-config
27672024-12-21T00:27:44.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8234 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 943df0bf-bf1a-4ec0-b52c-737eecc7feef response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
27682024-12-21T00:27:49.670ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49458
27692024-12-21T00:27:49.670ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49458 req_id = b9029046-1047-4b31-81f0-eb77d9fc0415 response_code = 200 uri = /baseboard
27702024-12-21T00:28:01.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54509
27712024-12-21T00:28:01.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54509 req_id = 78148974-9ba9-453f-9ff5-468ba7f1fb24 response_code = 200 uri = /v2p
27722024-12-21T00:28:01.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58545
27732024-12-21T00:28:01.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58545 req_id = 912457d3-1759-4a2d-b497-65834e5b2904 response_code = 200 uri = /vpc-routes
27742024-12-21T00:28:01.522ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
27752024-12-21T00:28:01.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58545 req_id = 880299da-b67c-4fcb-b19c-421450ff16bb response_code = 204 uri = /eip-gateways
27762024-12-21T00:28:01.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58545 req_id = 06f3debf-dc36-40ca-a59a-07b5a84ab67f response_code = 204 uri = /vpc-routes
27772024-12-21T00:28:01.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64439
27782024-12-21T00:28:01.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27792024-12-21T00:28:01.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27802024-12-21T00:28:01.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64439 req_id = d157667f-8856-41ed-9bcc-3d73d0ad50be response_code = 204 uri = /switch-ports
27812024-12-21T00:28:01.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64439 req_id = 9baf5905-f416-4a8b-8504-61e068a946b4 response_code = 200 uri = /network-bootstore-config
27822024-12-21T00:28:02.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49246
27832024-12-21T00:28:02.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49246 req_id = 3be3331d-ae73-4df7-9ab1-d05491feea86 response_code = 200 uri = /vpc-routes
27842024-12-21T00:28:02.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38750
27852024-12-21T00:28:02.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38750 req_id = 702f9bbd-7bf9-46b5-b425-719b7244055c response_code = 200 uri = /vpc-routes
27862024-12-21T00:28:02.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
27872024-12-21T00:28:02.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49246 req_id = 791bf1cb-f305-43a2-a7da-53eb7361dc6a response_code = 204 uri = /eip-gateways
27882024-12-21T00:28:02.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49246 req_id = d7f547bf-dc2a-4e97-b8c6-e2055f939095 response_code = 204 uri = /vpc-routes
27892024-12-21T00:28:02.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34975
27902024-12-21T00:28:02.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34975 req_id = 300ef100-0f85-421d-9bd2-8500db3d2213 response_code = 200 uri = /v2p
27912024-12-21T00:28:02.568ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
27922024-12-21T00:28:02.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38750 req_id = 1de1e4f0-1399-4e13-80f5-b750f5271d8a response_code = 204 uri = /eip-gateways
27932024-12-21T00:28:02.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38750 req_id = 31b92651-3927-4aa5-a183-27671a2bc8f5 response_code = 204 uri = /vpc-routes
27942024-12-21T00:28:02.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47107
27952024-12-21T00:28:02.582ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27962024-12-21T00:28:02.616ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27972024-12-21T00:28:02.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47107 req_id = aa8e9cab-c262-457e-ba63-3b53d3ed68df response_code = 204 uri = /switch-ports
27982024-12-21T00:28:02.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33558
27992024-12-21T00:28:02.667ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28002024-12-21T00:28:02.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3527 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47107 req_id = 32d8586f-ed77-4c59-9c97-9c72f072973f response_code = 200 uri = /network-bootstore-config
28012024-12-21T00:28:02.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62976
28022024-12-21T00:28:02.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62976 req_id = 4dfdeb0d-f943-4c5c-aeb6-8c3f4bb4cc76 response_code = 200 uri = /v2p
28032024-12-21T00:28:02.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28042024-12-21T00:28:02.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33558 req_id = 9aabbe35-8c09-4b50-b33a-25fd849337b7 response_code = 204 uri = /switch-ports
28052024-12-21T00:28:02.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33558 req_id = 619b98c0-75bb-4dad-b92e-27f471773ca2 response_code = 200 uri = /network-bootstore-config
28062024-12-21T00:28:14.860ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8346 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 889073e1-457e-42ff-a43d-3f0e51134d97 response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
28072024-12-21T00:28:19.703ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58524
28082024-12-21T00:28:19.703ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58524 req_id = 405427cd-a534-4892-a5a9-9f04b30e4498 response_code = 200 uri = /baseboard
28092024-12-21T00:28:22.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59375
28102024-12-21T00:28:22.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59375 req_id = b38f9f11-fb6a-441c-90a5-1adde26a6c75 response_code = 200 uri = /v2p
28112024-12-21T00:28:22.692ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(4804707) }
28122024-12-21T00:28:22.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 655 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59375 req_id = dc87a489-ee1a-476c-b74f-b068acfa6302 response_code = 204 uri = /v2p
28132024-12-21T00:28:22.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62789
28142024-12-21T00:28:22.825ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4804707))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-10cb9a3d1e6", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: f40524c0-3b22-4db2-b5a5-d331ae8319be, read_only_parent: Some(Volume { block_size: 512, id: da5257ee-24e5-44a1-9682-916c9fe20a50, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e8ff3776-92a2-4702-bd73-ec2fc211a152, key: Some("gLSipiPyxxFEyD3MHY+KBj+trQrfELmaUJB8aFBLe7I="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: f40524c0-3b22-4db2-b5a5-d331ae8319be, key: Some("4nDLM3qaMYpmlIHuDMOY4aK9oSGaQWuHYebcqS8Dnaw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19003", "[fd00:1122:3344:101::14]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-10cb9a3d1e6" }] }), cloud_init_bytes: Some(..) } instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 metadata = InstanceMetadata { silo_id: 01447292-8c95-4ac6-9207-2706a65ef65c, project_id: c8532e7f-9ea3-49ef-9e2b-b904f6b36d32 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T00:28:22.815504530Z }
28152024-12-21T00:28:22.825ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 migration_id = None propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28162024-12-21T00:28:22.825ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 migration_id = None propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(4804707))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 181954bc-29da-4ab1-8491-184448fbea49, kind: Instance { id: 49722de1-0b66-47c9-8092-f92e297b5165 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(4804707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-10cb9a3d1e6", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: f40524c0-3b22-4db2-b5a5-d331ae8319be, read_only_parent: Some(Volume { block_size: 512, id: da5257ee-24e5-44a1-9682-916c9fe20a50, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e8ff3776-92a2-4702-bd73-ec2fc211a152, key: Some("gLSipiPyxxFEyD3MHY+KBj+trQrfELmaUJB8aFBLe7I="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::15]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: f40524c0-3b22-4db2-b5a5-d331ae8319be, key: Some("4nDLM3qaMYpmlIHuDMOY4aK9oSGaQWuHYebcqS8Dnaw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::17]:19003", "[fd00:1122:3344:101::14]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-10cb9a3d1e6" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T00:28:22.815504530Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28172024-12-21T00:28:22.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62789 req_id = 3319a25c-8c45-448a-a481-9a813e1b3a9f response_code = 200 uri = /vmms/377a76ad-a52d-4952-ace2-823208546e66
28182024-12-21T00:28:22.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51149
28192024-12-21T00:28:22.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1445 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51149 req_id = bef28cbf-c1bf-4302-be90-83efc0edd170 response_code = 200 uri = /vmms/377a76ad-a52d-4952-ace2-823208546e66/state
28202024-12-21T00:28:22.906ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 4804707 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28212024-12-21T00:28:22.906ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28222024-12-21T00:28:22.943ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66 file = illumos-utils/src/zone.rs:325 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28232024-12-21T00:28:22.967ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66 file = illumos-utils/src/zone.rs:363 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28242024-12-21T00:28:22.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38302
28252024-12-21T00:28:22.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38302 req_id = 52462a71-8f2a-4553-89c9-9ed8db7c4098 response_code = 200 uri = /vpc-routes
28262024-12-21T00:28:22.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {181954bc-29da-4ab1-8491-184448fbea49: {10.151.2.176: {48134bf6-a3b4-42be-aa74-28bf15f878db}, 10.151.2.175: {48134bf6-a3b4-42be-aa74-28bf15f878db}}} }
28272024-12-21T00:28:24.502ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28282024-12-21T00:28:24.503ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28292024-12-21T00:28:24.719ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 42.97766ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28302024-12-21T00:28:24.772ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 87.976122ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28312024-12-21T00:28:24.885ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 188.877432ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28322024-12-21T00:28:25.087ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 254.292612ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28332024-12-21T00:28:25.356ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 870.280674ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28342024-12-21T00:28:26.237ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 899.264465ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28352024-12-21T00:28:27.146ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 1.347095437s file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28362024-12-21T00:28:28.505ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 944.530752ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 zone = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
28372024-12-21T00:28:29.479ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66 file = sled-agent/src/instance.rs:1786 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28382024-12-21T00:28:29.489ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 29.942329ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28392024-12-21T00:28:29.528ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 115.128404ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28402024-12-21T00:28:29.653ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 170.606243ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28412024-12-21T00:28:29.835ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66") failed: Property not found. retry in 456.197803ms file = illumos-utils/src/svc.rs:36 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28422024-12-21T00:28:30.303ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28432024-12-21T00:28:30.343ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28442024-12-21T00:28:30.490ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28452024-12-21T00:28:30.491ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
28462024-12-21T00:28:30.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7493018 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38302 req_id = f31b795b-c609-40b9-bce3-fbe951e16fa7 response_code = 204 uri = /eip-gateways
28472024-12-21T00:28:30.492ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T00:28:30.492442896Z } file = sled-agent/src/instance.rs:780 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28482024-12-21T00:28:30.492ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T00:28:30.492442896Z } propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28492024-12-21T00:28:30.493ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T00:28:30.492442896Z }, migration_in: None, migration_out: None }
28502024-12-21T00:28:30.504ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T00:28:30.504882896Z } file = sled-agent/src/instance.rs:780 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28512024-12-21T00:28:30.504ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T00:28:30.504882896Z } propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28522024-12-21T00:28:30.504ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T00:28:30.504882896Z }, migration_in: None, migration_out: None }
28532024-12-21T00:28:30.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38302 req_id = 3c30e0a5-57dd-45de-ba0c-cf590bbe2f20 response_code = 204 uri = /vpc-routes
28542024-12-21T00:28:31.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50342
28552024-12-21T00:28:31.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 817 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50342 req_id = f5a54c9e-cb93-4b49-a482-440eca78d9f0 response_code = 200 uri = /vmms/377a76ad-a52d-4952-ace2-823208546e66/state
28562024-12-21T00:28:31.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52470
28572024-12-21T00:28:31.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52470 req_id = 39ab4696-d3c0-4686-a380-1f3ad8596647 response_code = 200 uri = /vpc-routes
28582024-12-21T00:28:31.280ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {181954bc-29da-4ab1-8491-184448fbea49: {10.151.2.176: {48134bf6-a3b4-42be-aa74-28bf15f878db}, 10.151.2.175: {48134bf6-a3b4-42be-aa74-28bf15f878db}}} }
28592024-12-21T00:28:31.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52470 req_id = cac4e5e8-3cb8-4ffb-8694-d8ff172731eb response_code = 204 uri = /eip-gateways
28602024-12-21T00:28:31.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63152
28612024-12-21T00:28:31.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63152 req_id = a0b68b29-2a13-4fc6-93d1-e7b62b262b5d response_code = 200 uri = /v2p
28622024-12-21T00:28:31.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52470 req_id = 15e221c1-c2a6-4b2b-b908-74650217c987 response_code = 204 uri = /vpc-routes
28632024-12-21T00:28:31.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35402
28642024-12-21T00:28:31.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28652024-12-21T00:28:31.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28662024-12-21T00:28:31.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35402 req_id = e647d484-105b-4c84-b154-1a44d3ca91e2 response_code = 204 uri = /switch-ports
28672024-12-21T00:28:31.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35402 req_id = f17e1069-71d3-4b8b-9c95-42514d13a328 response_code = 200 uri = /network-bootstore-config
28682024-12-21T00:28:32.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52846
28692024-12-21T00:28:32.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52846 req_id = b7a77b21-86cf-4e55-a2a2-a3229eb222cb response_code = 200 uri = /vpc-routes
28702024-12-21T00:28:32.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35948
28712024-12-21T00:28:32.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35948 req_id = 5821a261-26fa-438f-b78a-16085d2de7f2 response_code = 200 uri = /vmms/377a76ad-a52d-4952-ace2-823208546e66/state
28722024-12-21T00:28:32.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50177
28732024-12-21T00:28:32.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50177 req_id = f39192c4-5c30-4262-b2d7-b1984e3410db response_code = 200 uri = /vmms/377a76ad-a52d-4952-ace2-823208546e66/state
28742024-12-21T00:28:32.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64212
28752024-12-21T00:28:32.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64212 req_id = 22270751-7ccc-4d57-8eb7-5eed3adec7cb response_code = 200 uri = /vpc-routes
28762024-12-21T00:28:32.208ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {181954bc-29da-4ab1-8491-184448fbea49: {10.151.2.175: {48134bf6-a3b4-42be-aa74-28bf15f878db}, 10.151.2.176: {48134bf6-a3b4-42be-aa74-28bf15f878db}}} }
28772024-12-21T00:28:32.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52846 req_id = 611146f1-0c3a-4608-a051-ff9cf3b4c555 response_code = 204 uri = /eip-gateways
28782024-12-21T00:28:32.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52846 req_id = 0fb6d3fa-5812-4815-9e66-9a28c6399c6a response_code = 204 uri = /vpc-routes
28792024-12-21T00:28:32.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {181954bc-29da-4ab1-8491-184448fbea49: {10.151.2.176: {48134bf6-a3b4-42be-aa74-28bf15f878db}, 10.151.2.175: {48134bf6-a3b4-42be-aa74-28bf15f878db}}} }
28802024-12-21T00:28:32.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64212 req_id = f2090de3-f60a-479b-b7fe-3a8936743654 response_code = 204 uri = /eip-gateways
28812024-12-21T00:28:32.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64212 req_id = 63a79752-7712-46c6-9a17-9edfc0c3d3df response_code = 204 uri = /vpc-routes
28822024-12-21T00:28:32.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47479
28832024-12-21T00:28:32.325ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28842024-12-21T00:28:32.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28852024-12-21T00:28:32.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47479 req_id = 86d36e9d-b0c8-4861-aece-a958e1451b8f response_code = 204 uri = /switch-ports
28862024-12-21T00:28:32.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56330
28872024-12-21T00:28:32.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45125
28882024-12-21T00:28:32.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50850
28892024-12-21T00:28:32.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50850 req_id = efc6473e-caaf-47b6-a490-863d699ef254 response_code = 200 uri = /v2p
28902024-12-21T00:28:32.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47479 req_id = d591bfec-75ad-4a67-b0e3-30781a8b12f1 response_code = 200 uri = /network-bootstore-config
28912024-12-21T00:28:32.421ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28922024-12-21T00:28:32.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56330 req_id = afb84549-60b4-4539-a1ae-d0137e811bb3 response_code = 200 uri = /v2p
28932024-12-21T00:28:32.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28942024-12-21T00:28:32.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91093 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45125 req_id = 1032d8a1-bfd8-46c5-85f5-0ec7814ad707 response_code = 204 uri = /switch-ports
28952024-12-21T00:28:32.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45125 req_id = ed668d0b-5beb-4c0b-827e-f100c5878ea0 response_code = 200 uri = /network-bootstore-config
28962024-12-21T00:28:40.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58287
28972024-12-21T00:28:40.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58287 req_id = 7d45126d-371a-499d-86b2-4e4bf20e3b41 response_code = 200 uri = /vmms/377a76ad-a52d-4952-ace2-823208546e66/state
28982024-12-21T00:28:40.459ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T00:28:40.459780045Z } file = sled-agent/src/instance.rs:780 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
28992024-12-21T00:28:40.459ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T00:28:40.459780045Z } propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29002024-12-21T00:28:40.459ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T00:28:40.459780045Z }, migration_in: None, migration_out: None }
29012024-12-21T00:28:40.501ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T00:28:40.501068249Z } file = sled-agent/src/instance.rs:780 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29022024-12-21T00:28:40.501ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T00:28:40.501068249Z } propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29032024-12-21T00:28:40.501ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29042024-12-21T00:28:40.501ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29052024-12-21T00:28:40.501ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 4503037845406637125 n_samples = 6 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
29062024-12-21T00:28:40.501ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 12465106718194515204 n_samples = 6 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
29072024-12-21T00:28:40.501ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29082024-12-21T00:28:40.501ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/50e0102e-a0cf-4808-8b40-f7f22995d1e2/debug/bundle/zone", "/pool/int/d42506e4-db68-4701-beb2-382ce82c1175/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/01c0de77-09de-4d5b-bd19-220f8b4fbd33/crypt/debug", "/pool/ext/81d66e6a-e144-4cc3-bd30-6b2eb46e189b/crypt/debug", "/pool/ext/b86cab20-f27c-490c-96fa-4f4929cdcc19/crypt/debug", "/pool/ext/db606984-291b-40d5-964e-14a228d68e45/crypt/debug", "/pool/ext/bbfac784-9ca5-4ffd-af3e-272d9a87a2f4/crypt/debug", "/pool/ext/96dd6601-21c1-4f69-a871-ce8980776531/crypt/debug", "/pool/ext/8504df1b-d5a7-40bd-ad45-c55449857140/crypt/debug", "/pool/ext/b3c5770f-c2a5-4687-9844-df947021ecd9/crypt/debug", "/pool/ext/30f2f8a7-d49b-4582-9153-44098dd8db06/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66
29092024-12-21T00:28:41.140ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66", bundle_id: 219f9281-8c9a-4629-8fd9-e5449aa21bf3 }, time_created: 2024-12-21T00:28:40.502474016Z, version: 0, cause: TerminatedInstance }
29102024-12-21T00:28:41.140ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_377a76ad-a52d-4952-ace2-823208546e66 file = sled-agent/src/instance.rs:1032 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29112024-12-21T00:28:42.922ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29122024-12-21T00:28:42.939ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4804707), kind: System }
29132024-12-21T00:28:42.939ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(4804707), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
29142024-12-21T00:28:42.939ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T00:28:42.939479533Z }, migration_in: None, migration_out: None }
29152024-12-21T00:28:42.962ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T00:28:42.939479533Z }, migration_in: None, migration_out: None }
29162024-12-21T00:28:42.967ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 49722de1-0b66-47c9-8092-f92e297b5165 propolis_id = 377a76ad-a52d-4952-ace2-823208546e66
29172024-12-21T00:28:43.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33859
29182024-12-21T00:28:43.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33859 req_id = 2de3c74f-fc46-43a8-acbc-514b8e74b0a8 response_code = 200 uri = /vpc-routes
29192024-12-21T00:28:43.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
29202024-12-21T00:28:43.493ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3
29212024-12-21T00:28:43.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33859 req_id = 100942a5-4362-4bfc-8cde-e6f5af9ef106 response_code = 204 uri = /eip-gateways
29222024-12-21T00:28:43.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58475
29232024-12-21T00:28:43.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58475 req_id = bf9184d6-6a13-4437-87a1-f007e8f3a769 response_code = 200 uri = /v2p
29242024-12-21T00:28:43.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33859 req_id = 85949e2f-2c15-49e2-9a00-7d68abeef86c response_code = 204 uri = /vpc-routes
29252024-12-21T00:28:43.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49824
29262024-12-21T00:28:43.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49824 req_id = e7db2d1f-d1fa-4561-b831-0c0696018155 response_code = 200 uri = /v2p
29272024-12-21T00:28:43.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42187
29282024-12-21T00:28:43.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42187 req_id = 14323870-aa65-48a7-bc11-eeeb068b7b6b response_code = 200 uri = /vpc-routes
29292024-12-21T00:28:43.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
29302024-12-21T00:28:43.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42187 req_id = 13f25e57-a643-4cd4-9ceb-36d5a9327d18 response_code = 204 uri = /eip-gateways
29312024-12-21T00:28:43.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42187 req_id = 11911d3f-6e2f-4a98-975a-9e682e2bda8d response_code = 204 uri = /vpc-routes
29322024-12-21T00:28:44.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33796
29332024-12-21T00:28:44.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33796 req_id = 2da2f03b-1855-4d43-bcd4-10f3e984f702 response_code = 200 uri = /vpc-routes
29342024-12-21T00:28:44.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 values = ExternalIpGatewayMap { mappings: {} }
29352024-12-21T00:28:44.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33796 req_id = 90faf54f-4fa4-4e22-856a-0f19e7e19456 response_code = 204 uri = /eip-gateways
29362024-12-21T00:28:44.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33796 req_id = 382da8ea-0a82-431b-8d1e-97e2d15f91cc response_code = 204 uri = /vpc-routes
29372024-12-21T00:28:44.858ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7223 local_addr = [fd00:1122:3344:101::1]:36671 method = GET remote_addr = [fd00:1122:3344:101::d]:63436 req_id = 46bf5a98-c479-4666-a25d-a147d54868fc response_code = 200 sled_id = ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3 uri = /ca7c4cec-a9b7-4345-98ca-d3ebf3fd64c3