Max level shown:
1 [ Dec 14 03:29:32 Enabled. ]
2 [ Dec 14 03:29:32 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 14 03:29:32 Method "start" exited with status 0. ]
4 [ Dec 14 03:29:32 Rereading configuration. ]
5 [ Dec 14 03:29:32 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-14T03:29:32.514ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-14T03:29:32.514ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-14T03:29:32.567ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-14T03:29:32.567ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-14T03:29:32.683ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-14T03:29:32.692ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-14T03:29:32.700ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-14T03:29:33.301ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-14T03:29:33.443ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-14T03:29:33.443ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-14T03:29:33.443ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-14T03:29:33.443ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-14T03:29:33.443ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-14T03:29:33.443ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-14T03:29:33.446ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-14T03:29:33.447ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-14T03:29:33.447ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-14T03:29:33.447ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-14T03:29:33.447ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-14T03:29:33.447ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-14T03:29:33.447ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-14T03:29:33.447ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-14T03:29:33.447ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-14T03:29:33.458ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-14T03:29:33.458ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool)
322024-12-14T03:29:33.557ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal }
332024-12-14T03:29:34.037ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-14T03:29:34.037ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-14T03:29:34.037ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-14T03:29:34.037ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-14T03:29:34.037ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-14T03:29:34.037ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-14T03:29:34.037ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-14T03:29:34.045ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-14T03:29:34.045ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool)
422024-12-14T03:29:34.134ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal }
432024-12-14T03:29:34.612ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
472024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
842024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
862024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-14T03:29:34.613ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
912024-12-14T03:29:34.613ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-12-14T03:29:34.613ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982024-12-14T03:29:34.613ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-14T03:29:34.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-12-14T03:29:34.613ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-14T03:29:34.613ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-12-14T03:29:34.613ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-14T03:29:34.613ZINFOSledAgent (bootstore): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-14T03:29:34.613ZINFOSledAgent (bootstore): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-14T03:29:34.613ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-14T03:29:34.613ZINFOSledAgent (bootstore): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-14T03:29:34.613ZINFOSledAgent (bootstore): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-14T03:29:34.613ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-14T03:29:34.613ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-14T03:29:34.613ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-14T03:29:34.624ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-14T03:29:34.624ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1381, tv_nsec: 399177890 } time_to_next_cleanup = 599.999941629s
1142024-12-14T03:29:34.624ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-14T03:29:34.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-14T03:29:34.624ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-14T03:29:34.627ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-14T03:29:34.627ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-14T03:29:34.629ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-14T03:29:34.629ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-14T03:29:34.629ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-14T03:29:34.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-14T03:29:34.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-14T03:29:34.629ZINFOSledAgent (RSS): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-14T03:29:34.629ZINFOSledAgent (RSS): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-14T03:29:34.629ZINFOSledAgent (RSS): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-14T03:29:34.629ZINFOSledAgent (RSS): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-14T03:29:34.630ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-14T03:29:34.630ZINFOSledAgent (RSS): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-14T03:29:34.630ZINFOSledAgent (RSS): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-14T03:29:34.630ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-14T03:29:34.630ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-14T03:29:34.630ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-14T03:29:34.630ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-14T03:29:34.630ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-14T03:29:34.630ZINFOSledAgent (bootstore): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-14T03:29:34.630ZINFOSledAgent (bootstore): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-14T03:29:34.630ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-14T03:29:34.630ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8d70e61c-94ed-41ce-b36c-cb904f92c534 (sled), rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-14T03:29:34.631ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-14T03:29:34.631ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-14T03:29:34.635ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-14T03:29:34.641ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-14T03:29:34.641ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-14T03:29:34.646ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-14T03:29:34.646ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-14T03:29:34.646ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:42031
1482024-12-14T03:29:34.646ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8d70e61c-94ed-41ce-b36c-cb904f92c534 (sled), rack_id: a121ca05-bbee-41bf-b9db-9e03ff035200, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-14T03:29:34.646ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-14T03:29:34.646ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-14T03:29:34.646ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-14T03:29:34.646ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-14T03:29:34.646ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-14T03:29:34.646ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-14T03:29:34.663ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-14T03:29:34.683ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-14T03:29:34.701ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-14T03:29:34.710ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1662024-12-14T03:29:34.710ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672024-12-14T03:29:34.710ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1682024-12-14T03:29:34.710ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-14T03:29:34.713ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 91.023711ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e138441b-7b2b-4c65-9fc8-bf4e5791b0c6", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e138441b-7b2b-4c65-9fc8-bf4e5791b0c6" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-14T03:29:34.723ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-14T03:29:34.747ZINFOSledAgent: successfully created encrypted zvol: name="oxi_bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-14T03:29:34.747ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-14T03:29:34.752ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1742024-12-14T03:29:34.752ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-14T03:29:34.752ZINFOSledAgent (BackingFs): Ensuring dataset oxi_bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-14T03:29:34.805ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-14T03:29:34.806ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.004625ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "df933d00-4c4d-423a-8122-89b5f7a3ff63", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "df933d00-4c4d-423a-8122-89b5f7a3ff63" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-14T03:29:34.845ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-12-14T03:29:34.888ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-14T03:29:34.889ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 176.767353ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "363f58ca-7d30-40a4-8389-7ce6289bdd26", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "363f58ca-7d30-40a4-8389-7ce6289bdd26" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-14T03:29:35.064ZINFOSledAgent (BackingFs): Mounting oxi_bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1822024-12-14T03:29:35.067ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-12-14T03:29:35.068ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 106.46583ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "69eda6db-2dc2-46ff-a23b-b2c5708e8098", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "69eda6db-2dc2-46ff-a23b-b2c5708e8098" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-12-14T03:29:35.077ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-12-14T03:29:35.077ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-12-14T03:29:35.077ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-12-14T03:29:35.077ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-12-14T03:29:35.176ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-14T03:29:35.177ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 245.301116ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0bc642f3-afd2-4891-ab82-dc7fbc5a6414", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0bc642f3-afd2-4891-ab82-dc7fbc5a6414" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-14T03:29:35.422ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-14T03:29:35.423ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 311.02136ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1f46fbb1-1261-41fe-92e0-4d855b77abef", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1f46fbb1-1261-41fe-92e0-4d855b77abef" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-14T03:29:35.735ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-14T03:29:35.735ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 312.204401ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8fb8ec2d-6535-4bc8-9ca4-f69a692ecf85", "content-length": "124", "date": "Sat, 14 Dec 2024 03:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8fb8ec2d-6535-4bc8-9ca4-f69a692ecf85" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-14T03:29:35.811ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1952024-12-14T03:29:35.816ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:40070 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1962024-12-14T03:29:35.816ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1972024-12-14T03:29:35.817ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:40070 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1982024-12-14T03:29:35.818ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 224.510655ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
1992024-12-14T03:29:35.819ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2002024-12-14T03:29:35.819ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2012024-12-14T03:29:35.819ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2022024-12-14T03:29:35.819ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-14T03:29:36.043ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 362.148351ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2042024-12-14T03:29:36.048ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052024-12-14T03:29:36.406ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 780.625496ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2062024-12-14T03:29:37.190ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.354149434s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2072024-12-14T03:29:38.397ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-12-14T03:29:38.397ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-12-14T03:29:38.397ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-12-14T03:29:38.397ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-12-14T03:29:38.397ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-12-14T03:29:38.397ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-12-14T03:29:38.398ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-12-14T03:29:38.400ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-12-14T03:29:38.400ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='b4254c81-0366-4d7b-a36b-86b73748c2f7'/> <propval type="astring" name="rack_id" value='a121ca05-bbee-41bf-b9db-9e03ff035200'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe8d:7364'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='a121ca05-bbee-41bf-b9db-9e03ff035200'/> <propval type="astring" name="sled_id" value='8d70e61c-94ed-41ce-b36c-cb904f92c534'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='8d70e61c-94ed-41ce-b36c-cb904f92c534'/> <propval type="astring" name="rack_uuid" value='a121ca05-bbee-41bf-b9db-9e03ff035200'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='8d70e61c-94ed-41ce-b36c-cb904f92c534'/> <propval type="astring" name="rack_uuid" value='a121ca05-bbee-41bf-b9db-9e03ff035200'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-14T03:29:38.400ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-14T03:29:38.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 31.287631ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-14T03:29:39.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 136.360649ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-14T03:29:39.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 239.894116ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-14T03:29:39.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 298.216466ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-14T03:29:39.594ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.688571681s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2222024-12-14T03:29:40.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 697.62905ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-14T03:29:40.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 995.607062ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-14T03:29:41.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.039182448s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-14T03:29:42.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.473782732s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-14T03:29:43.285ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.261447287s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2272024-12-14T03:29:44.752ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/nexus.rs:527 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2282024-12-14T03:29:44.782ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292024-12-14T03:29:44.783ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2302024-12-14T03:29:44.784ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-14T03:29:44.784ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-14T03:29:44.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2332024-12-14T03:29:44.784ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-14T03:29:44.784ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-14T03:29:44.784ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-14T03:29:44.784ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-14T03:29:44.784ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2382024-12-14T03:29:44.784ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:42031
2392024-12-14T03:29:44.982ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-12-14T03:29:44.982ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-12-14T03:29:44.987ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-14T03:29:44.987ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2432024-12-14T03:29:44.987ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-14T03:29:45.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43908
2452024-12-14T03:29:45.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-12-14T03:29:45.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472024-12-14T03:29:45.278ZINFOSledAgent (ServiceManager): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-14T03:29:45.278ZINFOSledAgent (ServiceManager): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:188
2492024-12-14T03:29:45.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43908 req_id = 41324040-be39-495d-8dec-f9f99189e3a6 response_code = 200 uri = /inventory
2502024-12-14T03:29:45.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35840
2512024-12-14T03:29:45.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35840 req_id = c44a00de-89b0-4fb3-838d-434804f57e58 response_code = 200 uri = /sled-role
2522024-12-14T03:29:45.338ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), pool_id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f83e9603-e3a8-47da-9504-66a4bf4099ca (physical_disk), pool_id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cd382e0d-1a14-4b5e-af68-9b0f91136cdd (physical_disk), pool_id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 886cad8d-5ef0-4fe6-8a6e-ad6ec9f45ac2 (physical_disk), pool_id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f81a2509-d51f-44fb-a2b7-97691d2615b9 (physical_disk), pool_id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 898c34fb-d713-4e9e-b455-a2586f2fe214 (physical_disk), pool_id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2b6bea95-f700-492c-a5c6-767c15932ae4 (physical_disk), pool_id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e8b2158c-1495-41ac-9d9c-7411ad62587c (physical_disk), pool_id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3be7b2b6-00f9-4c64-88a0-59eefb81e64b (physical_disk), pool_id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532024-12-14T03:29:45.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47078
2542024-12-14T03:29:45.339ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2552024-12-14T03:29:45.339ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b81997dc-4390-4d6b-b937-ec142d15ce9e (physical_disk), pool_id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: f83e9603-e3a8-47da-9504-66a4bf4099ca (physical_disk), pool_id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: cd382e0d-1a14-4b5e-af68-9b0f91136cdd (physical_disk), pool_id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 886cad8d-5ef0-4fe6-8a6e-ad6ec9f45ac2 (physical_disk), pool_id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f81a2509-d51f-44fb-a2b7-97691d2615b9 (physical_disk), pool_id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 898c34fb-d713-4e9e-b455-a2586f2fe214 (physical_disk), pool_id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2b6bea95-f700-492c-a5c6-767c15932ae4 (physical_disk), pool_id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e8b2158c-1495-41ac-9d9c-7411ad62587c (physical_disk), pool_id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 3be7b2b6-00f9-4c64-88a0-59eefb81e64b (physical_disk), pool_id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2562024-12-14T03:29:45.339ZINFOSledAgent (StorageManager): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-14T03:29:45.339ZINFOSledAgent (StorageManager): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582024-12-14T03:29:45.339ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2592024-12-14T03:29:45.339ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602024-12-14T03:29:45.339ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612024-12-14T03:29:45.339ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622024-12-14T03:29:45.339ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632024-12-14T03:29:45.481ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642024-12-14T03:29:45.481ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool)
2652024-12-14T03:29:45.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2662024-12-14T03:29:45.941ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2672024-12-14T03:29:45.941ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2682024-12-14T03:29:46.142ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
2692024-12-14T03:29:46.189ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }
2702024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2712024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2722024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2732024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2742024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-12-14T03:29:46.198ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2772024-12-14T03:29:46.233ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-12-14T03:29:46.241ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone file = sled-storage/src/dataset.rs:303
2792024-12-14T03:29:46.417ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99 file = sled-storage/src/dataset.rs:389
2802024-12-14T03:29:46.425ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812024-12-14T03:29:46.425ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822024-12-14T03:29:46.425ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832024-12-14T03:29:46.425ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-12-14T03:29:46.425ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852024-12-14T03:29:46.434ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2862024-12-14T03:29:46.434ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool)
2872024-12-14T03:29:46.524ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }
2882024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2892024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2902024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2912024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2922024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-12-14T03:29:46.533ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2952024-12-14T03:29:46.568ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-12-14T03:29:46.575ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone file = sled-storage/src/dataset.rs:303
2972024-12-14T03:29:46.748ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_128dcb8a-56c9-451c-a438-d3ea94a82725 file = sled-storage/src/dataset.rs:389
2982024-12-14T03:29:46.756ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-12-14T03:29:46.756ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-12-14T03:29:46.756ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-12-14T03:29:46.756ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-12-14T03:29:46.756ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-12-14T03:29:46.766ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042024-12-14T03:29:46.766ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool)
3052024-12-14T03:29:46.861ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }
3062024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3072024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3082024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3092024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3102024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-14T03:29:46.868ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3132024-12-14T03:29:46.905ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-12-14T03:29:46.914ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone file = sled-storage/src/dataset.rs:303
3152024-12-14T03:29:46.943ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
3162024-12-14T03:29:47.087ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9 file = sled-storage/src/dataset.rs:389
3172024-12-14T03:29:47.094ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182024-12-14T03:29:47.094ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192024-12-14T03:29:47.095ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202024-12-14T03:29:47.095ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-12-14T03:29:47.095ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-12-14T03:29:47.104ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232024-12-14T03:29:47.104ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool)
3242024-12-14T03:29:47.194ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }
3252024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3262024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3272024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3282024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3292024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-12-14T03:29:47.202ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3322024-12-14T03:29:47.237ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-12-14T03:29:47.245ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone file = sled-storage/src/dataset.rs:303
3342024-12-14T03:29:47.413ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4a91d090-6980-43b2-8cca-44eb6dd10741 file = sled-storage/src/dataset.rs:389
3352024-12-14T03:29:47.421ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362024-12-14T03:29:47.421ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372024-12-14T03:29:47.421ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382024-12-14T03:29:47.421ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392024-12-14T03:29:47.421ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-12-14T03:29:47.430ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3412024-12-14T03:29:47.430ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 73bc07b3-a806-455e-a40b-a99deea605ef (zpool)
3422024-12-14T03:29:47.524ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }
3432024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3442024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3452024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3462024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3472024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-12-14T03:29:47.533ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3502024-12-14T03:29:47.548ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 23.6679915s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
3512024-12-14T03:29:47.568ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-12-14T03:29:47.576ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone file = sled-storage/src/dataset.rs:303
3532024-12-14T03:29:47.749ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_73bc07b3-a806-455e-a40b-a99deea605ef file = sled-storage/src/dataset.rs:389
3542024-12-14T03:29:47.757ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552024-12-14T03:29:47.757ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562024-12-14T03:29:47.757ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572024-12-14T03:29:47.757ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582024-12-14T03:29:47.757ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592024-12-14T03:29:47.767ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602024-12-14T03:29:47.767ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool)
3612024-12-14T03:29:47.863ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }
3622024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3632024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3642024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3652024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3662024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-12-14T03:29:47.871ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3692024-12-14T03:29:47.906ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-12-14T03:29:47.914ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/zone file = sled-storage/src/dataset.rs:303
3712024-12-14T03:29:47.945ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
3722024-12-14T03:29:48.087ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb file = sled-storage/src/dataset.rs:389
3732024-12-14T03:29:48.095ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3742024-12-14T03:29:48.095ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3752024-12-14T03:29:48.095ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3762024-12-14T03:29:48.095ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772024-12-14T03:29:48.095ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782024-12-14T03:29:48.105ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3792024-12-14T03:29:48.105ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool)
3802024-12-14T03:29:48.199ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }
3812024-12-14T03:29:48.206ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3822024-12-14T03:29:48.206ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3832024-12-14T03:29:48.206ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3842024-12-14T03:29:48.206ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3852024-12-14T03:29:48.206ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-12-14T03:29:48.207ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-12-14T03:29:48.207ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3882024-12-14T03:29:48.240ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-12-14T03:29:48.247ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/zone file = sled-storage/src/dataset.rs:303
3902024-12-14T03:29:48.422ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb file = sled-storage/src/dataset.rs:389
3912024-12-14T03:29:48.430ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922024-12-14T03:29:48.430ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932024-12-14T03:29:48.430ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942024-12-14T03:29:48.430ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-12-14T03:29:48.430ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-12-14T03:29:48.439ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972024-12-14T03:29:48.440ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool)
3982024-12-14T03:29:48.548ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }
3992024-12-14T03:29:48.555ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4002024-12-14T03:29:48.555ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4012024-12-14T03:29:48.555ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4022024-12-14T03:29:48.556ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4032024-12-14T03:29:48.556ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-12-14T03:29:48.556ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-12-14T03:29:48.556ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4062024-12-14T03:29:48.591ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-12-14T03:29:48.599ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone file = sled-storage/src/dataset.rs:303
4082024-12-14T03:29:48.772ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2 file = sled-storage/src/dataset.rs:389
4092024-12-14T03:29:48.781ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102024-12-14T03:29:48.781ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112024-12-14T03:29:48.781ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122024-12-14T03:29:48.781ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132024-12-14T03:29:48.781ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-12-14T03:29:48.790ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4152024-12-14T03:29:48.790ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fb57e12e-6889-4ba5-8f94-102093287f39 (zpool)
4162024-12-14T03:29:48.886ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }
4172024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4182024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4192024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4202024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4212024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-12-14T03:29:48.894ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4242024-12-14T03:29:48.929ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-12-14T03:29:48.937ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fb57e12e-6889-4ba5-8f94-102093287f39/crypt/zone file = sled-storage/src/dataset.rs:303
4262024-12-14T03:29:48.948ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4272024-12-14T03:29:49.116ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fb57e12e-6889-4ba5-8f94-102093287f39 file = sled-storage/src/dataset.rs:389
4282024-12-14T03:29:49.125ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292024-12-14T03:29:49.125ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302024-12-14T03:29:49.125ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-14T03:29:49.125ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322024-12-14T03:29:49.125ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332024-12-14T03:29:49.125ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342024-12-14T03:29:49.125ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352024-12-14T03:29:49.125ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4362024-12-14T03:29:49.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4372024-12-14T03:29:49.126ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4382024-12-14T03:29:49.126ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4392024-12-14T03:29:49.126ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4402024-12-14T03:29:49.126ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4412024-12-14T03:29:49.126ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4422024-12-14T03:29:49.126ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432024-12-14T03:29:49.126ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4442024-12-14T03:29:49.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3787002 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47078 req_id = d0e5eb84-6f9e-487b-a32d-d01812b2a5ac response_code = 200 uri = /omicron-physical-disks
4452024-12-14T03:29:49.157ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03ea283d-7e02-43f5-98f0-9f641a9327ec (dataset): DatasetConfig { id: 03ea283d-7e02-43f5-98f0-9f641a9327ec (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 068daaf4-77bc-4452-8610-33f161246c05 (dataset): DatasetConfig { id: 068daaf4-77bc-4452-8610-33f161246c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08221e13-352e-4f5d-a9f0-f16b9ad073de (dataset): DatasetConfig { id: 08221e13-352e-4f5d-a9f0-f16b9ad073de (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a3a3424-5a3f-4f18-92ef-67928572d117 (dataset): DatasetConfig { id: 0a3a3424-5a3f-4f18-92ef-67928572d117 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 121d422a-b686-4104-94c9-5fd7c76c65b6 (dataset): DatasetConfig { id: 121d422a-b686-4104-94c9-5fd7c76c65b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12771733-9db0-403f-9eac-494b56720e17 (dataset): DatasetConfig { id: 12771733-9db0-403f-9eac-494b56720e17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17397fad-e318-4df5-902f-45818869e5a7 (dataset): DatasetConfig { id: 17397fad-e318-4df5-902f-45818869e5a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18c33c9a-4f18-46b5-b2d3-6f94cb34b9d5 (dataset): DatasetConfig { id: 18c33c9a-4f18-46b5-b2d3-6f94cb34b9d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c2485a0-10bf-42df-83c3-b7014a0f6f08 (dataset): DatasetConfig { id: 1c2485a0-10bf-42df-83c3-b7014a0f6f08 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25b6e77f-f2b8-4fec-9e03-bc2b7e6f8009 (dataset): DatasetConfig { id: 25b6e77f-f2b8-4fec-9e03-bc2b7e6f8009 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26d6f3a9-09c7-415f-925b-85d7c859ea88 (dataset): DatasetConfig { id: 26d6f3a9-09c7-415f-925b-85d7c859ea88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2898bb67-44c1-42fa-8c26-803d475ff810 (dataset): DatasetConfig { id: 2898bb67-44c1-42fa-8c26-803d475ff810 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ab3dbca-09df-4d88-8ee9-02eea6e1795b (dataset): DatasetConfig { id: 2ab3dbca-09df-4d88-8ee9-02eea6e1795b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2af5202f-a3cc-4efe-a306-27a705bc81a8 (dataset): DatasetConfig { id: 2af5202f-a3cc-4efe-a306-27a705bc81a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 322e0b18-ccf6-45fe-ab3c-4992f81174a2 (dataset): DatasetConfig { id: 322e0b18-ccf6-45fe-ab3c-4992f81174a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33a6f11f-d2e1-45da-a6d7-e2d688b4c8dd (dataset): DatasetConfig { id: 33a6f11f-d2e1-45da-a6d7-e2d688b4c8dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a4482b6-2b79-4001-a716-af51721277bc (dataset): DatasetConfig { id: 3a4482b6-2b79-4001-a716-af51721277bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d2295c4-e270-4f95-bc5e-9ac927719e02 (dataset): DatasetConfig { id: 3d2295c4-e270-4f95-bc5e-9ac927719e02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40f1ffd7-4254-4020-a2d3-1d3736b6dd13 (dataset): DatasetConfig { id: 40f1ffd7-4254-4020-a2d3-1d3736b6dd13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41ff7081-1b47-498e-821e-887b9e69d3d4 (dataset): DatasetConfig { id: 41ff7081-1b47-498e-821e-887b9e69d3d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4614506b-85ee-4831-bb11-0e39ab581992 (dataset): DatasetConfig { id: 4614506b-85ee-4831-bb11-0e39ab581992 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 472394e1-07ae-48f6-957f-9a07fb2bdcc9 (dataset): DatasetConfig { id: 472394e1-07ae-48f6-957f-9a07fb2bdcc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48a7494b-d971-4d1e-9dee-c040efaaffff (dataset): DatasetConfig { id: 48a7494b-d971-4d1e-9dee-c040efaaffff (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ae9d2ec-185b-4ce6-b7f5-45146bca8cd9 (dataset): DatasetConfig { id: 4ae9d2ec-185b-4ce6-b7f5-45146bca8cd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fc0a4f2-75db-4232-a332-a4b1def7e08b (dataset): DatasetConfig { id: 4fc0a4f2-75db-4232-a332-a4b1def7e08b (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d (dataset): DatasetConfig { id: 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64dbb32a-e1ce-4291-83ab-833d495ef951 (dataset): DatasetConfig { id: 64dbb32a-e1ce-4291-83ab-833d495ef951 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68a2a05f-d23a-456c-aa95-e98f27d00d78 (dataset): DatasetConfig { id: 68a2a05f-d23a-456c-aa95-e98f27d00d78 (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b59431e-c63d-49eb-8d2c-b01b025630ed (dataset): DatasetConfig { id: 6b59431e-c63d-49eb-8d2c-b01b025630ed (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c38c7ee-1900-419d-b272-c83d255f3449 (dataset): DatasetConfig { id: 6c38c7ee-1900-419d-b272-c83d255f3449 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ec83b1a-afdb-4be7-8c52-7fd670957ddd (dataset): DatasetConfig { id: 6ec83b1a-afdb-4be7-8c52-7fd670957ddd (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78f47afd-812f-4f8e-992b-acf36951e434 (dataset): DatasetConfig { id: 78f47afd-812f-4f8e-992b-acf36951e434 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7aa6c257-511b-4930-8d8f-bd800c353707 (dataset): DatasetConfig { id: 7aa6c257-511b-4930-8d8f-bd800c353707 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ad07e6f-bfc0-4c2c-a3dc-5fd0b53642e4 (dataset): DatasetConfig { id: 7ad07e6f-bfc0-4c2c-a3dc-5fd0b53642e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7e5f5825-c687-4c41-9ea3-4f5f1935ef96 (dataset): DatasetConfig { id: 7e5f5825-c687-4c41-9ea3-4f5f1935ef96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e8890f3-8f93-41af-b88f-145ff15b1d6f (dataset): DatasetConfig { id: 7e8890f3-8f93-41af-b88f-145ff15b1d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ef95c26-126d-4872-a36e-21f8c612775b (dataset): DatasetConfig { id: 7ef95c26-126d-4872-a36e-21f8c612775b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 859dc898-7219-4ad4-8996-2300a5a08848 (dataset): DatasetConfig { id: 859dc898-7219-4ad4-8996-2300a5a08848 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8d2428ce-7180-4d5a-8d30-d2b71b837425 (dataset): DatasetConfig { id: 8d2428ce-7180-4d5a-8d30-d2b71b837425 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e9d7ec7-d699-417e-90ea-17b6e67dd8db (dataset): DatasetConfig { id: 8e9d7ec7-d699-417e-90ea-17b6e67dd8db (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 99accab4-f374-4618-bbba-81480ecefe2d (dataset): DatasetConfig { id: 99accab4-f374-4618-bbba-81480ecefe2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e78116b-a792-4249-ab98-530d589b9369 (dataset): DatasetConfig { id: 9e78116b-a792-4249-ab98-530d589b9369 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fd9b991-82c6-4a11-99c0-4dcc54713803 (dataset): DatasetConfig { id: 9fd9b991-82c6-4a11-99c0-4dcc54713803 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2ec8c31-9499-4148-8318-a0fa913eed66 (dataset): DatasetConfig { id: a2ec8c31-9499-4148-8318-a0fa913eed66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6198be4-2dde-4eee-afa5-791647de286f (dataset): DatasetConfig { id: a6198be4-2dde-4eee-afa5-791647de286f (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a92de8df-d688-4586-abab-8093d1af341a (dataset): DatasetConfig { id: a92de8df-d688-4586-abab-8093d1af341a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac923d99-4673-4dfb-8047-1584a30f1111 (dataset): DatasetConfig { id: ac923d99-4673-4dfb-8047-1584a30f1111 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae37d66e-be6f-4d48-adbc-9e938e6e0889 (dataset): DatasetConfig { id: ae37d66e-be6f-4d48-adbc-9e938e6e0889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b41609d1-4688-455f-a94b-fd76a493ae21 (dataset): DatasetConfig { id: b41609d1-4688-455f-a94b-fd76a493ae21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4fce58f-224b-44ef-a25b-76b07b0a747c (dataset): DatasetConfig { id: b4fce58f-224b-44ef-a25b-76b07b0a747c (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdf8f1a0-579a-4300-831b-a2e2f63d6654 (dataset): DatasetConfig { id: bdf8f1a0-579a-4300-831b-a2e2f63d6654 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfae7416-6d56-4da9-956d-cfdaef8e9e9d (dataset): DatasetConfig { id: bfae7416-6d56-4da9-956d-cfdaef8e9e9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0dea2ea-a1c2-43fd-ad1c-c68dba164a03 (dataset): DatasetConfig { id: c0dea2ea-a1c2-43fd-ad1c-c68dba164a03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c74f153f-fc49-4f73-9639-fb87b173c687 (dataset): DatasetConfig { id: c74f153f-fc49-4f73-9639-fb87b173c687 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cc54e961-20b0-40b1-a4d7-9cf10baba000 (dataset): DatasetConfig { id: cc54e961-20b0-40b1-a4d7-9cf10baba000 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc9165c1-698e-4d81-a5d6-715fc9180da9 (dataset): DatasetConfig { id: cc9165c1-698e-4d81-a5d6-715fc9180da9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d323dee5-65f2-43ea-868d-384d829422b7 (dataset): DatasetConfig { id: d323dee5-65f2-43ea-868d-384d829422b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d479d243-8080-48fe-bfaf-66ac2f6661b1 (dataset): DatasetConfig { id: d479d243-8080-48fe-bfaf-66ac2f6661b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7b91810-d795-4040-9468-e4b9467e89b9 (dataset): DatasetConfig { id: d7b91810-d795-4040-9468-e4b9467e89b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d8467fb2-e38b-425a-ac8c-70a6c37e4a77 (dataset): DatasetConfig { id: d8467fb2-e38b-425a-ac8c-70a6c37e4a77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8caf884-e2bc-4429-9dc8-be2fdeb12189 (dataset): DatasetConfig { id: d8caf884-e2bc-4429-9dc8-be2fdeb12189 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de2ba3c9-dddf-4d28-bbd8-7b7c9d9cd855 (dataset): DatasetConfig { id: de2ba3c9-dddf-4d28-bbd8-7b7c9d9cd855 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e32cd874-ee8b-42c9-a55f-b4dd83d499e3 (dataset): DatasetConfig { id: e32cd874-ee8b-42c9-a55f-b4dd83d499e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4fe8efe-4a0c-4c71-91c4-4f8ffe4c7eb8 (dataset): DatasetConfig { id: e4fe8efe-4a0c-4c71-91c4-4f8ffe4c7eb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f08b13fb-4622-478e-9841-22600e3dc266 (dataset): DatasetConfig { id: f08b13fb-4622-478e-9841-22600e3dc266 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3ac6332-d7f7-4d91-aaa8-7c18fc8c8c17 (dataset): DatasetConfig { id: f3ac6332-d7f7-4d91-aaa8-7c18fc8c8c17 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462024-12-14T03:29:49.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49333
4472024-12-14T03:29:49.158ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4482024-12-14T03:29:49.161ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03ea283d-7e02-43f5-98f0-9f641a9327ec (dataset): DatasetConfig { id: 03ea283d-7e02-43f5-98f0-9f641a9327ec (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 068daaf4-77bc-4452-8610-33f161246c05 (dataset): DatasetConfig { id: 068daaf4-77bc-4452-8610-33f161246c05 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08221e13-352e-4f5d-a9f0-f16b9ad073de (dataset): DatasetConfig { id: 08221e13-352e-4f5d-a9f0-f16b9ad073de (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a3a3424-5a3f-4f18-92ef-67928572d117 (dataset): DatasetConfig { id: 0a3a3424-5a3f-4f18-92ef-67928572d117 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 121d422a-b686-4104-94c9-5fd7c76c65b6 (dataset): DatasetConfig { id: 121d422a-b686-4104-94c9-5fd7c76c65b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12771733-9db0-403f-9eac-494b56720e17 (dataset): DatasetConfig { id: 12771733-9db0-403f-9eac-494b56720e17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17397fad-e318-4df5-902f-45818869e5a7 (dataset): DatasetConfig { id: 17397fad-e318-4df5-902f-45818869e5a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18c33c9a-4f18-46b5-b2d3-6f94cb34b9d5 (dataset): DatasetConfig { id: 18c33c9a-4f18-46b5-b2d3-6f94cb34b9d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c2485a0-10bf-42df-83c3-b7014a0f6f08 (dataset): DatasetConfig { id: 1c2485a0-10bf-42df-83c3-b7014a0f6f08 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25b6e77f-f2b8-4fec-9e03-bc2b7e6f8009 (dataset): DatasetConfig { id: 25b6e77f-f2b8-4fec-9e03-bc2b7e6f8009 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 26d6f3a9-09c7-415f-925b-85d7c859ea88 (dataset): DatasetConfig { id: 26d6f3a9-09c7-415f-925b-85d7c859ea88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2898bb67-44c1-42fa-8c26-803d475ff810 (dataset): DatasetConfig { id: 2898bb67-44c1-42fa-8c26-803d475ff810 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ab3dbca-09df-4d88-8ee9-02eea6e1795b (dataset): DatasetConfig { id: 2ab3dbca-09df-4d88-8ee9-02eea6e1795b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2af5202f-a3cc-4efe-a306-27a705bc81a8 (dataset): DatasetConfig { id: 2af5202f-a3cc-4efe-a306-27a705bc81a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 322e0b18-ccf6-45fe-ab3c-4992f81174a2 (dataset): DatasetConfig { id: 322e0b18-ccf6-45fe-ab3c-4992f81174a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33a6f11f-d2e1-45da-a6d7-e2d688b4c8dd (dataset): DatasetConfig { id: 33a6f11f-d2e1-45da-a6d7-e2d688b4c8dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3a4482b6-2b79-4001-a716-af51721277bc (dataset): DatasetConfig { id: 3a4482b6-2b79-4001-a716-af51721277bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3d2295c4-e270-4f95-bc5e-9ac927719e02 (dataset): DatasetConfig { id: 3d2295c4-e270-4f95-bc5e-9ac927719e02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40f1ffd7-4254-4020-a2d3-1d3736b6dd13 (dataset): DatasetConfig { id: 40f1ffd7-4254-4020-a2d3-1d3736b6dd13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 41ff7081-1b47-498e-821e-887b9e69d3d4 (dataset): DatasetConfig { id: 41ff7081-1b47-498e-821e-887b9e69d3d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4614506b-85ee-4831-bb11-0e39ab581992 (dataset): DatasetConfig { id: 4614506b-85ee-4831-bb11-0e39ab581992 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 472394e1-07ae-48f6-957f-9a07fb2bdcc9 (dataset): DatasetConfig { id: 472394e1-07ae-48f6-957f-9a07fb2bdcc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48a7494b-d971-4d1e-9dee-c040efaaffff (dataset): DatasetConfig { id: 48a7494b-d971-4d1e-9dee-c040efaaffff (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ae9d2ec-185b-4ce6-b7f5-45146bca8cd9 (dataset): DatasetConfig { id: 4ae9d2ec-185b-4ce6-b7f5-45146bca8cd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fc0a4f2-75db-4232-a332-a4b1def7e08b (dataset): DatasetConfig { id: 4fc0a4f2-75db-4232-a332-a4b1def7e08b (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d (dataset): DatasetConfig { id: 54cf7cf4-70f0-4b69-9a7c-f396dbefa17d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64dbb32a-e1ce-4291-83ab-833d495ef951 (dataset): DatasetConfig { id: 64dbb32a-e1ce-4291-83ab-833d495ef951 (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 68a2a05f-d23a-456c-aa95-e98f27d00d78 (dataset): DatasetConfig { id: 68a2a05f-d23a-456c-aa95-e98f27d00d78 (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b59431e-c63d-49eb-8d2c-b01b025630ed (dataset): DatasetConfig { id: 6b59431e-c63d-49eb-8d2c-b01b025630ed (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c38c7ee-1900-419d-b272-c83d255f3449 (dataset): DatasetConfig { id: 6c38c7ee-1900-419d-b272-c83d255f3449 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ec83b1a-afdb-4be7-8c52-7fd670957ddd (dataset): DatasetConfig { id: 6ec83b1a-afdb-4be7-8c52-7fd670957ddd (dataset), name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78f47afd-812f-4f8e-992b-acf36951e434 (dataset): DatasetConfig { id: 78f47afd-812f-4f8e-992b-acf36951e434 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7aa6c257-511b-4930-8d8f-bd800c353707 (dataset): DatasetConfig { id: 7aa6c257-511b-4930-8d8f-bd800c353707 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ad07e6f-bfc0-4c2c-a3dc-5fd0b53642e4 (dataset): DatasetConfig { id: 7ad07e6f-bfc0-4c2c-a3dc-5fd0b53642e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7e5f5825-c687-4c41-9ea3-4f5f1935ef96 (dataset): DatasetConfig { id: 7e5f5825-c687-4c41-9ea3-4f5f1935ef96 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e8890f3-8f93-41af-b88f-145ff15b1d6f (dataset): DatasetConfig { id: 7e8890f3-8f93-41af-b88f-145ff15b1d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ef95c26-126d-4872-a36e-21f8c612775b (dataset): DatasetConfig { id: 7ef95c26-126d-4872-a36e-21f8c612775b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 859dc898-7219-4ad4-8996-2300a5a08848 (dataset): DatasetConfig { id: 859dc898-7219-4ad4-8996-2300a5a08848 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8d2428ce-7180-4d5a-8d30-d2b71b837425 (dataset): DatasetConfig { id: 8d2428ce-7180-4d5a-8d30-d2b71b837425 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e9d7ec7-d699-417e-90ea-17b6e67dd8db (dataset): DatasetConfig { id: 8e9d7ec7-d699-417e-90ea-17b6e67dd8db (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 99accab4-f374-4618-bbba-81480ecefe2d (dataset): DatasetConfig { id: 99accab4-f374-4618-bbba-81480ecefe2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e78116b-a792-4249-ab98-530d589b9369 (dataset): DatasetConfig { id: 9e78116b-a792-4249-ab98-530d589b9369 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fd9b991-82c6-4a11-99c0-4dcc54713803 (dataset): DatasetConfig { id: 9fd9b991-82c6-4a11-99c0-4dcc54713803 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a2ec8c31-9499-4148-8318-a0fa913eed66 (dataset): DatasetConfig { id: a2ec8c31-9499-4148-8318-a0fa913eed66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6198be4-2dde-4eee-afa5-791647de286f (dataset): DatasetConfig { id: a6198be4-2dde-4eee-afa5-791647de286f (dataset), name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a92de8df-d688-4586-abab-8093d1af341a (dataset): DatasetConfig { id: a92de8df-d688-4586-abab-8093d1af341a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac923d99-4673-4dfb-8047-1584a30f1111 (dataset): DatasetConfig { id: ac923d99-4673-4dfb-8047-1584a30f1111 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae37d66e-be6f-4d48-adbc-9e938e6e0889 (dataset): DatasetConfig { id: ae37d66e-be6f-4d48-adbc-9e938e6e0889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b41609d1-4688-455f-a94b-fd76a493ae21 (dataset): DatasetConfig { id: b41609d1-4688-455f-a94b-fd76a493ae21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b4fce58f-224b-44ef-a25b-76b07b0a747c (dataset): DatasetConfig { id: b4fce58f-224b-44ef-a25b-76b07b0a747c (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdf8f1a0-579a-4300-831b-a2e2f63d6654 (dataset): DatasetConfig { id: bdf8f1a0-579a-4300-831b-a2e2f63d6654 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfae7416-6d56-4da9-956d-cfdaef8e9e9d (dataset): DatasetConfig { id: bfae7416-6d56-4da9-956d-cfdaef8e9e9d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0dea2ea-a1c2-43fd-ad1c-c68dba164a03 (dataset): DatasetConfig { id: c0dea2ea-a1c2-43fd-ad1c-c68dba164a03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c74f153f-fc49-4f73-9639-fb87b173c687 (dataset): DatasetConfig { id: c74f153f-fc49-4f73-9639-fb87b173c687 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cc54e961-20b0-40b1-a4d7-9cf10baba000 (dataset): DatasetConfig { id: cc54e961-20b0-40b1-a4d7-9cf10baba000 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc9165c1-698e-4d81-a5d6-715fc9180da9 (dataset): DatasetConfig { id: cc9165c1-698e-4d81-a5d6-715fc9180da9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d323dee5-65f2-43ea-868d-384d829422b7 (dataset): DatasetConfig { id: d323dee5-65f2-43ea-868d-384d829422b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d479d243-8080-48fe-bfaf-66ac2f6661b1 (dataset): DatasetConfig { id: d479d243-8080-48fe-bfaf-66ac2f6661b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7b91810-d795-4040-9468-e4b9467e89b9 (dataset): DatasetConfig { id: d7b91810-d795-4040-9468-e4b9467e89b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d8467fb2-e38b-425a-ac8c-70a6c37e4a77 (dataset): DatasetConfig { id: d8467fb2-e38b-425a-ac8c-70a6c37e4a77 (dataset), name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8caf884-e2bc-4429-9dc8-be2fdeb12189 (dataset): DatasetConfig { id: d8caf884-e2bc-4429-9dc8-be2fdeb12189 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de2ba3c9-dddf-4d28-bbd8-7b7c9d9cd855 (dataset): DatasetConfig { id: de2ba3c9-dddf-4d28-bbd8-7b7c9d9cd855 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e32cd874-ee8b-42c9-a55f-b4dd83d499e3 (dataset): DatasetConfig { id: e32cd874-ee8b-42c9-a55f-b4dd83d499e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4fe8efe-4a0c-4c71-91c4-4f8ffe4c7eb8 (dataset): DatasetConfig { id: e4fe8efe-4a0c-4c71-91c4-4f8ffe4c7eb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f08b13fb-4622-478e-9841-22600e3dc266 (dataset): DatasetConfig { id: f08b13fb-4622-478e-9841-22600e3dc266 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f3ac6332-d7f7-4d91-aaa8-7c18fc8c8c17 (dataset): DatasetConfig { id: f3ac6332-d7f7-4d91-aaa8-7c18fc8c8c17 (dataset), name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4492024-12-14T03:29:49.161ZINFOSledAgent (StorageManager): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502024-12-14T03:29:49.161ZINFOSledAgent (StorageManager): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512024-12-14T03:29:49.161ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4522024-12-14T03:29:49.161ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4532024-12-14T03:29:49.162ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/zone/oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775"), full_name: "oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/zone/oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775" } file = sled-storage/src/manager.rs:1331
4542024-12-14T03:29:49.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4552024-12-14T03:29:49.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone"), full_name: "oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone" } file = sled-storage/src/manager.rs:1331
4562024-12-14T03:29:49.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4572024-12-14T03:29:49.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb57e12e-6889-4ba5-8f94-102093287f39/crypt/zone"), full_name: "oxp_fb57e12e-6889-4ba5-8f94-102093287f39/crypt/zone" } file = sled-storage/src/manager.rs:1331
4582024-12-14T03:29:49.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4592024-12-14T03:29:49.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb" } file = sled-storage/src/manager.rs:1331
4602024-12-14T03:29:49.496ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4612024-12-14T03:29:49.496ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crucible" } file = sled-storage/src/manager.rs:1331
4622024-12-14T03:29:49.583ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-12-14T03:29:49.583ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crucible" } file = sled-storage/src/manager.rs:1331
4642024-12-14T03:29:49.670ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-12-14T03:29:49.670ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409" } file = sled-storage/src/manager.rs:1331
4662024-12-14T03:29:49.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-12-14T03:29:49.771ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/zone"), full_name: "oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/zone" } file = sled-storage/src/manager.rs:1331
4682024-12-14T03:29:49.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-12-14T03:29:49.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb57e12e-6889-4ba5-8f94-102093287f39/crypt/zone/oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e"), full_name: "oxp_fb57e12e-6889-4ba5-8f94-102093287f39/crypt/zone/oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e" } file = sled-storage/src/manager.rs:1331
4702024-12-14T03:29:49.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-12-14T03:29:49.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040" } file = sled-storage/src/manager.rs:1331
4722024-12-14T03:29:49.950ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4732024-12-14T03:29:50.039ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-12-14T03:29:50.039ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4752024-12-14T03:29:50.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-12-14T03:29:50.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3" } file = sled-storage/src/manager.rs:1331
4772024-12-14T03:29:50.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-12-14T03:29:50.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4792024-12-14T03:29:50.315ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-12-14T03:29:50.315ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/zone/oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf"), full_name: "oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/zone/oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf" } file = sled-storage/src/manager.rs:1331
4812024-12-14T03:29:50.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-12-14T03:29:50.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230" } file = sled-storage/src/manager.rs:1331
4832024-12-14T03:29:50.512ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-12-14T03:29:50.512ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone/oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc"), full_name: "oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone/oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc" } file = sled-storage/src/manager.rs:1331
4852024-12-14T03:29:50.606ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-12-14T03:29:50.606ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08" } file = sled-storage/src/manager.rs:1331
4872024-12-14T03:29:50.702ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-12-14T03:29:50.702ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4892024-12-14T03:29:50.788ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-12-14T03:29:50.788ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936" } file = sled-storage/src/manager.rs:1331
4912024-12-14T03:29:50.888ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-12-14T03:29:50.888ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crucible" } file = sled-storage/src/manager.rs:1331
4932024-12-14T03:29:50.952ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
4942024-12-14T03:29:50.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-12-14T03:29:50.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crucible" } file = sled-storage/src/manager.rs:1331
4962024-12-14T03:29:51.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-12-14T03:29:51.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4982024-12-14T03:29:51.151ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-12-14T03:29:51.151ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone" } file = sled-storage/src/manager.rs:1331
5002024-12-14T03:29:51.218ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-12-14T03:29:51.218ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone"), full_name: "oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone" } file = sled-storage/src/manager.rs:1331
5022024-12-14T03:29:51.286ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-14T03:29:51.286ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone" } file = sled-storage/src/manager.rs:1331
5042024-12-14T03:29:51.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-14T03:29:51.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crucible" } file = sled-storage/src/manager.rs:1331
5062024-12-14T03:29:51.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-14T03:29:51.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crucible" } file = sled-storage/src/manager.rs:1331
5082024-12-14T03:29:51.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-14T03:29:51.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/debug"), full_name: "oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/debug" } file = sled-storage/src/manager.rs:1331
5102024-12-14T03:29:51.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-12-14T03:29:51.596ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone/oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35"), full_name: "oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone/oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35" } file = sled-storage/src/manager.rs:1331
5122024-12-14T03:29:51.693ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-12-14T03:29:51.693ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296" } file = sled-storage/src/manager.rs:1331
5142024-12-14T03:29:51.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-12-14T03:29:51.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb/crucible" } file = sled-storage/src/manager.rs:1331
5162024-12-14T03:29:51.879ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-12-14T03:29:51.879ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb57e12e-6889-4ba5-8f94-102093287f39/crypt/debug"), full_name: "oxp_fb57e12e-6889-4ba5-8f94-102093287f39/crypt/debug" } file = sled-storage/src/manager.rs:1331
5182024-12-14T03:29:51.948ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-12-14T03:29:51.948ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb57e12e-6889-4ba5-8f94-102093287f39/crucible" } file = sled-storage/src/manager.rs:1331
5202024-12-14T03:29:51.954ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
5212024-12-14T03:29:52.036ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-12-14T03:29:52.037ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/debug"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/debug" } file = sled-storage/src/manager.rs:1331
5232024-12-14T03:29:52.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-12-14T03:29:52.105ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166" } file = sled-storage/src/manager.rs:1331
5252024-12-14T03:29:52.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-12-14T03:29:52.204ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone/oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39"), full_name: "oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crypt/zone/oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39" } file = sled-storage/src/manager.rs:1331
5272024-12-14T03:29:52.304ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-12-14T03:29:52.304ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5292024-12-14T03:29:52.399ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-12-14T03:29:52.399ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/debug"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5312024-12-14T03:29:52.466ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-12-14T03:29:52.466ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79" } file = sled-storage/src/manager.rs:1331
5332024-12-14T03:29:52.565ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-12-14T03:29:52.565ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/debug"), full_name: "oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/debug" } file = sled-storage/src/manager.rs:1331
5352024-12-14T03:29:52.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-12-14T03:29:52.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4" } file = sled-storage/src/manager.rs:1331
5372024-12-14T03:29:52.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-12-14T03:29:52.729ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5392024-12-14T03:29:52.819ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-12-14T03:29:52.819ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5412024-12-14T03:29:52.911ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-12-14T03:29:52.911ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/zone"), full_name: "oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/zone" } file = sled-storage/src/manager.rs:1331
5432024-12-14T03:29:52.956ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
5442024-12-14T03:29:52.980ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5452024-12-14T03:29:52.980ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/73bc07b3-a806-455e-a40b-a99deea605ef/crypt/debug"), full_name: "oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crypt/debug" } file = sled-storage/src/manager.rs:1331
5462024-12-14T03:29:53.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-12-14T03:29:53.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crucible" } file = sled-storage/src/manager.rs:1331
5482024-12-14T03:29:53.136ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-12-14T03:29:53.136ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481" } file = sled-storage/src/manager.rs:1331
5502024-12-14T03:29:53.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-12-14T03:29:53.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d" } file = sled-storage/src/manager.rs:1331
5522024-12-14T03:29:53.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-12-14T03:29:53.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3" } file = sled-storage/src/manager.rs:1331
5542024-12-14T03:29:53.436ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-12-14T03:29:53.436ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5562024-12-14T03:29:53.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-12-14T03:29:53.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6" } file = sled-storage/src/manager.rs:1331
5582024-12-14T03:29:53.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-12-14T03:29:53.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5602024-12-14T03:29:53.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-14T03:29:53.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5622024-12-14T03:29:53.831ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-12-14T03:29:53.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/debug"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/debug" } file = sled-storage/src/manager.rs:1331
5642024-12-14T03:29:53.898ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-12-14T03:29:53.898ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone/oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf"), full_name: "oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone/oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf" } file = sled-storage/src/manager.rs:1331
5662024-12-14T03:29:53.958ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
5672024-12-14T03:29:53.997ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-12-14T03:29:53.997ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1"), full_name: "oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/zone/oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1" } file = sled-storage/src/manager.rs:1331
5692024-12-14T03:29:54.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-12-14T03:29:54.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621" } file = sled-storage/src/manager.rs:1331
5712024-12-14T03:29:54.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-12-14T03:29:54.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone/oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c" } file = sled-storage/src/manager.rs:1331
5732024-12-14T03:29:54.296ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-12-14T03:29:54.296ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/debug"), full_name: "oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/debug" } file = sled-storage/src/manager.rs:1331
5752024-12-14T03:29:54.367ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-12-14T03:29:54.367ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8"), full_name: "oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/zone/oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8" } file = sled-storage/src/manager.rs:1331
5772024-12-14T03:29:54.473ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-12-14T03:29:54.473ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5792024-12-14T03:29:54.566ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-12-14T03:29:54.566ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone" } file = sled-storage/src/manager.rs:1331
5812024-12-14T03:29:54.635ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-12-14T03:29:54.635ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83"), full_name: "oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/zone/oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83" } file = sled-storage/src/manager.rs:1331
5832024-12-14T03:29:54.740ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-12-14T03:29:54.740ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/debug"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/debug" } file = sled-storage/src/manager.rs:1331
5852024-12-14T03:29:54.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194863876967631275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
5862024-12-14T03:29:54.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6555642316865038272 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
5872024-12-14T03:29:54.810ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5882024-12-14T03:29:54.810ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone"), full_name: "oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/zone" } file = sled-storage/src/manager.rs:1331
5892024-12-14T03:29:54.839ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5902024-12-14T03:29:54.839ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5912024-12-14T03:29:54.846ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5922024-12-14T03:29:54.846ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5932024-12-14T03:29:54.892ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-12-14T03:29:54.892ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone/oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c"), full_name: "oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/zone/oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c" } file = sled-storage/src/manager.rs:1331
5952024-12-14T03:29:54.961ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
5962024-12-14T03:29:55.006ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5972024-12-14T03:29:55.007ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5982024-12-14T03:29:55.008ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5992024-12-14T03:29:55.010ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6002024-12-14T03:29:55.010ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
6012024-12-14T03:29:55.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5852683 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49333 req_id = b32b9cae-a1e2-446d-a5cf-d9287330645f response_code = 200 uri = /datasets
6022024-12-14T03:29:55.052ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6032024-12-14T03:29:55.052ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6042024-12-14T03:29:55.058ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 3db8556d-0ae0-4824-8953-f38d8eef7409 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db39fe07-65c4-451a-a2bd-78fcdfc10040 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7b672843-049d-4d9c-b0a2-21d7b6323621 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6052024-12-14T03:29:55.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54153
6062024-12-14T03:29:55.058ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6072024-12-14T03:29:55.058ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6082024-12-14T03:29:55.097ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6092024-12-14T03:29:55.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6102024-12-14T03:29:55.106ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6112024-12-14T03:29:55.106ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6122024-12-14T03:29:55.128ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6132024-12-14T03:29:55.128ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6142024-12-14T03:29:55.135ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6152024-12-14T03:29:55.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6162024-12-14T03:29:55.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6172024-12-14T03:29:55.172ZINFOSledAgent (ServiceManager): No ledger in /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:188
6182024-12-14T03:29:55.172ZINFOSledAgent (ServiceManager): No ledger in /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:188
6192024-12-14T03:29:55.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6202024-12-14T03:29:55.202ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6212024-12-14T03:29:55.202ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6222024-12-14T03:29:55.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6232024-12-14T03:29:55.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6242024-12-14T03:29:55.225ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6252024-12-14T03:29:55.287ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621 file = illumos-utils/src/zone.rs:325
6262024-12-14T03:29:55.292ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409 file = illumos-utils/src/zone.rs:325
6272024-12-14T03:29:55.296ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040 file = illumos-utils/src/zone.rs:325
6282024-12-14T03:29:55.306ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6292024-12-14T03:29:55.307ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6302024-12-14T03:29:55.308ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621 file = illumos-utils/src/zone.rs:363
6312024-12-14T03:29:55.313ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409 file = illumos-utils/src/zone.rs:363
6322024-12-14T03:29:55.318ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040 file = illumos-utils/src/zone.rs:363
6332024-12-14T03:29:55.349ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6342024-12-14T03:29:55.349ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/nexus.rs:527 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
6352024-12-14T03:29:55.384ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6362024-12-14T03:29:55.384ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6372024-12-14T03:29:55.385ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6382024-12-14T03:29:55.385ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6392024-12-14T03:29:55.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6402024-12-14T03:29:55.510ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6412024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6422024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6432024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6442024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6452024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6462024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6472024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6482024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6492024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6502024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6512024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6522024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6532024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6542024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6552024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6562024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6572024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6582024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6592024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6602024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6612024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6622024-12-14T03:29:55.510ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6632024-12-14T03:29:55.944ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
6642024-12-14T03:29:55.944ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
6652024-12-14T03:29:55.963ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8d70e61c-94ed-41ce-b36c-cb904f92c534) file = sled-agent/src/probe_manager.rs:231 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
6662024-12-14T03:29:56.855ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6672024-12-14T03:29:57.334ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6682024-12-14T03:29:57.334ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6692024-12-14T03:29:57.334ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6702024-12-14T03:29:57.813ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6712024-12-14T03:29:57.813ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6722024-12-14T03:29:57.817ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6732024-12-14T03:29:57.821ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6742024-12-14T03:29:57.821ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6752024-12-14T03:29:57.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 59.370795ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6762024-12-14T03:29:57.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 65.531839ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6772024-12-14T03:29:57.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 33.838067ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6782024-12-14T03:29:58.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 142.937325ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6792024-12-14T03:29:58.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 60.310109ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6802024-12-14T03:29:58.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 128.267899ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6812024-12-14T03:29:58.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 218.237303ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6822024-12-14T03:29:58.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 219.890697ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6832024-12-14T03:29:58.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 283.777559ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6842024-12-14T03:29:58.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 548.628543ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6852024-12-14T03:29:58.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 536.721118ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6862024-12-14T03:29:58.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 523.106493ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6872024-12-14T03:29:59.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 1.174882684s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6882024-12-14T03:29:59.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 809.690479ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6892024-12-14T03:29:59.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 547.27937ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6902024-12-14T03:29:59.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 851.061614ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6912024-12-14T03:30:00.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 1.25390183s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6922024-12-14T03:30:00.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 661.203916ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6932024-12-14T03:30:00.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 1.096780544s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6942024-12-14T03:30:01.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 635.554066ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6952024-12-14T03:30:01.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 1.059444971s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6962024-12-14T03:30:01.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 745.445919ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
6972024-12-14T03:30:01.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 1.357526993s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
6982024-12-14T03:30:02.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 570.148255ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
6992024-12-14T03:30:02.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 834.779726ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
7002024-12-14T03:30:02.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621") failed: Property not found. retry in 631.347261ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
7012024-12-14T03:30:03.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409") failed: Property not found. retry in 559.577349ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
7022024-12-14T03:30:03.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040") failed: Property not found. retry in 1.339262153s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
7032024-12-14T03:30:04.612ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_7b672843-049d-4d9c-b0a2-21d7b6323621
7042024-12-14T03:30:04.612ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_3db8556d-0ae0-4824-8953-f38d8eef7409
7052024-12-14T03:30:04.612ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_db39fe07-65c4-451a-a2bd-78fcdfc10040
7062024-12-14T03:30:04.612ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7072024-12-14T03:30:04.612ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7082024-12-14T03:30:04.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9554401 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54153 req_id = 92ebc571-8ada-447a-a9dc-baaab2d7deec response_code = 204 uri = /omicron-zones
7092024-12-14T03:30:04.615ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7102024-12-14T03:30:04.664ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7112024-12-14T03:30:04.713ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7122024-12-14T03:30:04.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194863876967631275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7132024-12-14T03:30:04.754ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6555642316865038272 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7142024-12-14T03:30:04.761ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7152024-12-14T03:30:04.761ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7162024-12-14T03:30:04.794ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7172024-12-14T03:30:04.795ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7182024-12-14T03:30:04.795ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7192024-12-14T03:30:04.824ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 3db8556d-0ae0-4824-8953-f38d8eef7409 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db39fe07-65c4-451a-a2bd-78fcdfc10040 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7b672843-049d-4d9c-b0a2-21d7b6323621 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f91a04b5-83ce-4ca1-88d3-c38788e84e35 (service), filesystem_pool: Some(ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bb9c2736-3fb6-473d-8835-439953139e25, kind: Service { id: f91a04b5-83ce-4ca1-88d3-c38788e84e35 }, name: Name("ntp-f91a04b5-83ce-4ca1-88d3-c38788e84e35"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 21])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7202024-12-14T03:30:04.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63330
7212024-12-14T03:30:04.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7222024-12-14T03:30:04.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7232024-12-14T03:30:04.863ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7242024-12-14T03:30:04.863ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7252024-12-14T03:30:04.900ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7262024-12-14T03:30:04.900ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7272024-12-14T03:30:04.934ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7282024-12-14T03:30:04.934ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
7292024-12-14T03:30:04.934ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
7302024-12-14T03:30:04.934ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7312024-12-14T03:30:04.945ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7322024-12-14T03:30:04.977ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7332024-12-14T03:30:04.979ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7342024-12-14T03:30:04.979ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7352024-12-14T03:30:05.009ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 196, 21]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7362024-12-14T03:30:05.009ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7372024-12-14T03:30:05.009ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7382024-12-14T03:30:05.009ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7392024-12-14T03:30:05.010ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7402024-12-14T03:30:05.010ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7412024-12-14T03:30:05.035ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35 file = illumos-utils/src/zone.rs:325
7422024-12-14T03:30:05.054ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35 file = illumos-utils/src/zone.rs:363
7432024-12-14T03:30:05.674ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7442024-12-14T03:30:05.674ZINFOSledAgent (ServiceManager): Booting oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7452024-12-14T03:30:05.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 56.524752ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7462024-12-14T03:30:05.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 80.778617ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7472024-12-14T03:30:05.947ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7482024-12-14T03:30:05.947ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7492024-12-14T03:30:05.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 117.918271ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7502024-12-14T03:30:06.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 229.247806ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7512024-12-14T03:30:06.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 1.045559221s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7522024-12-14T03:30:07.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 1.384203202s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7532024-12-14T03:30:08.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 526.658488ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7542024-12-14T03:30:09.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 1.131138348s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7552024-12-14T03:30:10.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35") failed: Property not found. retry in 1.321012817s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7562024-12-14T03:30:11.800ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35
7572024-12-14T03:30:11.800ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7582024-12-14T03:30:11.801ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7592024-12-14T03:30:11.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6976773 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63330 req_id = a1db36b3-d4ba-4f3e-8e8d-2ef57a03a6aa response_code = 204 uri = /omicron-zones
7602024-12-14T03:30:11.803ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7612024-12-14T03:30:11.833ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7622024-12-14T03:30:11.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54017
7632024-12-14T03:30:11.842ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7642024-12-14T03:30:11.842ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8886 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54017 req_id = cdacc009-f468-4aaf-b5a9-9c4278a52cc8 response_code = 500 uri = /timesync
7652024-12-14T03:30:11.844ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7662024-12-14T03:30:11.975ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7672024-12-14T03:30:11.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43259
7682024-12-14T03:30:13.636ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11401469229093759208 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7692024-12-14T03:30:13.785ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12682720977169218032 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7702024-12-14T03:30:14.615ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5153004696194435353 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7712024-12-14T03:30:14.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194863876967631275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7722024-12-14T03:30:14.755ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6555642316865038272 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7732024-12-14T03:30:15.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7742024-12-14T03:30:15.949ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
7752024-12-14T03:30:15.983ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7762024-12-14T03:30:15.983ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4007934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43259 req_id = d89f9299-73cb-4f75-8844-95dcd1b669ee response_code = 500 uri = /timesync
7772024-12-14T03:30:15.985ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7782024-12-14T03:30:16.167ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7792024-12-14T03:30:16.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49059
7802024-12-14T03:30:16.176ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7812024-12-14T03:30:16.176ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49059 req_id = 14972731-1c27-427b-9a1a-ff43978481de response_code = 500 uri = /timesync
7822024-12-14T03:30:16.178ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7832024-12-14T03:30:16.308ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7842024-12-14T03:30:16.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41831
7852024-12-14T03:30:21.249ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_f91a04b5-83ce-4ca1-88d3-c38788e84e35': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7862024-12-14T03:30:21.249ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009557 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41831 req_id = e74ed246-cc94-4597-a40d-b8a99915f119 response_code = 500 uri = /timesync
7872024-12-14T03:30:21.252ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7882024-12-14T03:30:21.474ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7892024-12-14T03:30:21.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38716
7902024-12-14T03:30:21.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8972 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38716 req_id = 8b4cdb9c-3c3c-453b-881a-23e6c58282a2 response_code = 200 uri = /timesync
7912024-12-14T03:30:21.484ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.480942547 } file = sled-agent/src/rack_setup/service.rs:743
7922024-12-14T03:30:21.484ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7932024-12-14T03:30:21.694ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7942024-12-14T03:30:21.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62611
7952024-12-14T03:30:21.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62611 req_id = 9540d564-18e0-4f72-add7-6a833beaeed9 response_code = 200 uri = /timesync
7962024-12-14T03:30:21.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.480344534 } file = sled-agent/src/rack_setup/service.rs:743
7972024-12-14T03:30:21.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7982024-12-14T03:30:21.975ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7992024-12-14T03:30:21.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44032
8002024-12-14T03:30:21.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44032 req_id = 8756f171-d0ca-491f-8280-a6c093a43595 response_code = 200 uri = /timesync
8012024-12-14T03:30:21.985ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.479581982 } file = sled-agent/src/rack_setup/service.rs:743
8022024-12-14T03:30:21.985ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8032024-12-14T03:30:22.283ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8042024-12-14T03:30:22.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49319
8052024-12-14T03:30:22.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49319 req_id = ec125f20-6e06-45b3-a1d6-a6ec207640e4 response_code = 200 uri = /timesync
8062024-12-14T03:30:22.294ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.477879167 } file = sled-agent/src/rack_setup/service.rs:743
8072024-12-14T03:30:22.294ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8082024-12-14T03:30:22.722ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8092024-12-14T03:30:22.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56247
8102024-12-14T03:30:22.730ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14196284788045832048 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8112024-12-14T03:30:22.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56247 req_id = 19c1fba1-0141-4aa7-a792-08564a1f9c7a response_code = 200 uri = /timesync
8122024-12-14T03:30:22.731ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3085336735118733411 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8132024-12-14T03:30:22.733ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.47668764 } file = sled-agent/src/rack_setup/service.rs:743
8142024-12-14T03:30:22.733ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8152024-12-14T03:30:23.218ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8162024-12-14T03:30:23.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63217
8172024-12-14T03:30:23.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8944 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63217 req_id = 8c18e706-5cdb-4841-ac1d-611d0d034869 response_code = 200 uri = /timesync
8182024-12-14T03:30:23.229ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734147021.5527613, correction: -0.477316827 } file = sled-agent/src/rack_setup/service.rs:743
8192024-12-14T03:30:23.229ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8202024-12-14T03:30:23.618ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212024-12-14T03:30:23.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62971
8222024-12-14T03:30:23.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7706 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62971 req_id = 17d85812-b707-4428-9129-9f7bad324098 response_code = 200 uri = /timesync
8232024-12-14T03:30:23.628ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734147021.5527613, correction: -0.476235807 } file = sled-agent/src/rack_setup/service.rs:743
8242024-12-14T03:30:23.628ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252024-12-14T03:30:24.095ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262024-12-14T03:30:24.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51484
8272024-12-14T03:30:24.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9091 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51484 req_id = e71a3762-c562-4aa3-bbfb-ffedb6730836 response_code = 200 uri = /timesync
8282024-12-14T03:30:24.108ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734147021.5527613, correction: -0.474973381 } file = sled-agent/src/rack_setup/service.rs:743
8292024-12-14T03:30:24.108ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8302024-12-14T03:30:24.561ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11401469229093759208 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8312024-12-14T03:30:24.709ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12682720977169218032 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8322024-12-14T03:30:25.133ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332024-12-14T03:30:25.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62281
8342024-12-14T03:30:25.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62281 req_id = a5f19bde-1fcd-4bdd-a03c-cc969efd9d95 response_code = 200 uri = /timesync
8352024-12-14T03:30:25.145ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147023.631834, correction: -0.469955206 } file = sled-agent/src/rack_setup/service.rs:743
8362024-12-14T03:30:25.145ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372024-12-14T03:30:25.536ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5153004696194435353 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8382024-12-14T03:30:25.676ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194863876967631275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8392024-12-14T03:30:25.677ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6555642316865038272 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8402024-12-14T03:30:25.878ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412024-12-14T03:30:25.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36905
8422024-12-14T03:30:25.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36905 req_id = 5145e555-429e-4723-b665-72ba74d5084a response_code = 200 uri = /timesync
8432024-12-14T03:30:25.891ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147023.631834, correction: -0.467934042 } file = sled-agent/src/rack_setup/service.rs:743
8442024-12-14T03:30:25.891ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452024-12-14T03:30:25.951ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42606
8462024-12-14T03:30:25.951ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42606 req_id = 36fe232c-5ed1-419c-a701-b5e978ac53ce response_code = 200 uri = /baseboard
8472024-12-14T03:30:26.867ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8482024-12-14T03:30:26.867ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8492024-12-14T03:30:27.169ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 274.318007ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8502024-12-14T03:30:27.256ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8512024-12-14T03:30:27.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58988
8522024-12-14T03:30:27.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8831 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58988 req_id = c9c26414-d84f-4be9-b53a-de62a44a802d response_code = 200 uri = /timesync
8532024-12-14T03:30:27.267ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147026.382023, correction: -0.463349998 } file = sled-agent/src/rack_setup/service.rs:743
8542024-12-14T03:30:27.267ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552024-12-14T03:30:28.084ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562024-12-14T03:30:28.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55965
8572024-12-14T03:30:28.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8420 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55965 req_id = c4252e30-021c-4a4b-a639-46750aa178e2 response_code = 200 uri = /timesync
8582024-12-14T03:30:28.096ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147026.382023, correction: -0.461103857 } file = sled-agent/src/rack_setup/service.rs:743
8592024-12-14T03:30:28.096ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602024-12-14T03:30:30.101ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612024-12-14T03:30:30.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54408
8622024-12-14T03:30:30.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8490 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54408 req_id = 7fa6a9f7-9cb6-464f-8dff-03dc4ce7011e response_code = 200 uri = /timesync
8632024-12-14T03:30:30.112ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147028.8686342, correction: -0.455659211 } file = sled-agent/src/rack_setup/service.rs:743
8642024-12-14T03:30:30.112ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652024-12-14T03:30:32.236ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662024-12-14T03:30:32.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41855
8672024-12-14T03:30:32.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41855 req_id = e2910117-b7c9-44dc-b40a-8f84314eb260 response_code = 200 uri = /timesync
8682024-12-14T03:30:32.247ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147031.4228928, correction: -0.449668825 } file = sled-agent/src/rack_setup/service.rs:743
8692024-12-14T03:30:32.247ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702024-12-14T03:30:32.706ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14196284788045832048 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8712024-12-14T03:30:32.706ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3085336735118733411 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8722024-12-14T03:30:33.954ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8732024-12-14T03:30:33.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39905
8742024-12-14T03:30:33.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39905 req_id = 547601ad-cde3-4dc9-b9ae-72410b056004 response_code = 200 uri = /timesync
8752024-12-14T03:30:33.966ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147031.9730997, correction: -0.445522428 } file = sled-agent/src/rack_setup/service.rs:743
8762024-12-14T03:30:33.966ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8772024-12-14T03:30:34.536ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11401469229093759208 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8782024-12-14T03:30:34.683ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12682720977169218032 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8792024-12-14T03:30:35.510ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5153004696194435353 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8802024-12-14T03:30:35.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13194863876967631275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8812024-12-14T03:30:35.651ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6555642316865038272 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8822024-12-14T03:30:36.736ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8832024-12-14T03:30:36.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49940
8842024-12-14T03:30:36.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8867 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49940 req_id = cb1a99b7-fd32-4aab-81a8-2450d50ee04c response_code = 200 uri = /timesync
8852024-12-14T03:30:36.748ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147035.122716, correction: -0.437557578 } file = sled-agent/src/rack_setup/service.rs:743
8862024-12-14T03:30:36.748ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872024-12-14T03:30:36.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8882024-12-14T03:30:36.843ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
8892024-12-14T03:30:39.740ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902024-12-14T03:30:39.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42438
8912024-12-14T03:30:39.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8770 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42438 req_id = 329d6712-ade5-4720-8020-b49c58d011e9 response_code = 200 uri = /timesync
8922024-12-14T03:30:39.751ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147037.828999, correction: -0.429316908 } file = sled-agent/src/rack_setup/service.rs:743
8932024-12-14T03:30:39.751ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8942024-12-14T03:30:42.180ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8952024-12-14T03:30:42.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61626
8962024-12-14T03:30:42.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61626 req_id = e0d73411-f8f5-4f42-b219-de83423681a0 response_code = 200 uri = /timesync
8972024-12-14T03:30:42.192ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147040.3093896, correction: -0.422729462 } file = sled-agent/src/rack_setup/service.rs:743
8982024-12-14T03:30:42.192ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8992024-12-14T03:30:42.436ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 550.256395ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9002024-12-14T03:30:42.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14196284788045832048 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9012024-12-14T03:30:42.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3085336735118733411 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9022024-12-14T03:30:44.511ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11401469229093759208 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9032024-12-14T03:30:44.659ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12682720977169218032 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9042024-12-14T03:30:45.485ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5153004696194435353 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9052024-12-14T03:30:45.625ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13194863876967631275 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9062024-12-14T03:30:45.625ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6555642316865038272 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9072024-12-14T03:30:46.818ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9082024-12-14T03:30:46.818ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9092024-12-14T03:30:48.633ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9102024-12-14T03:30:48.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53148
9112024-12-14T03:30:48.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53148 req_id = a074c040-cdda-4077-8b87-17f262cf3423 response_code = 200 uri = /timesync
9122024-12-14T03:30:48.644ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147046.8356116, correction: -0.405573875 } file = sled-agent/src/rack_setup/service.rs:743
9132024-12-14T03:30:48.644ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9142024-12-14T03:30:52.655ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14196284788045832048 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9152024-12-14T03:30:52.655ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3085336735118733411 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9162024-12-14T03:30:52.925ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9172024-12-14T03:30:52.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53560
9182024-12-14T03:30:52.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53560 req_id = d14c77bc-f1c9-40ed-b577-68812e916fd2 response_code = 200 uri = /timesync
9192024-12-14T03:30:52.937ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147050.4795375, correction: -0.394080341 } file = sled-agent/src/rack_setup/service.rs:743
9202024-12-14T03:30:52.937ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9212024-12-14T03:30:54.486ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11401469229093759208 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9222024-12-14T03:30:54.633ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12682720977169218032 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9232024-12-14T03:30:55.459ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5153004696194435353 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9242024-12-14T03:30:55.902ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40469
9252024-12-14T03:30:55.902ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40469 req_id = 25632836-7bc6-40c6-8d79-298f122247e2 response_code = 200 uri = /baseboard
9262024-12-14T03:30:56.792ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9272024-12-14T03:30:56.793ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9282024-12-14T03:30:57.979ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.273463493s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9292024-12-14T03:30:58.299ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9302024-12-14T03:30:58.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41077
9312024-12-14T03:30:58.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41077 req_id = 63147157-e659-44e5-b3b8-4f3844dae9c0 response_code = 200 uri = /timesync
9322024-12-14T03:30:58.310ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147054.4236932, correction: -0.379313648 } file = sled-agent/src/rack_setup/service.rs:743
9332024-12-14T03:30:58.310ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9342024-12-14T03:31:02.631ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14196284788045832048 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9352024-12-14T03:31:02.631ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3085336735118733411 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9362024-12-14T03:31:04.461ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 11401469229093759208 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9372024-12-14T03:31:04.607ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12682720977169218032 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9382024-12-14T03:31:05.174ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9392024-12-14T03:31:05.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60447
9402024-12-14T03:31:05.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60447 req_id = 5f8b03e5-f385-4d15-b4ac-4ae25c1a69d1 response_code = 200 uri = /timesync
9412024-12-14T03:31:05.185ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147062.685558, correction: -0.360373199 } file = sled-agent/src/rack_setup/service.rs:743
9422024-12-14T03:31:05.185ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9432024-12-14T03:31:05.435ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5153004696194435353 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9442024-12-14T03:31:06.767ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9452024-12-14T03:31:06.767ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9462024-12-14T03:31:12.607ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14196284788045832048 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9472024-12-14T03:31:12.607ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3085336735118733411 reason = Duration(60s) sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9482024-12-14T03:31:14.245ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.312007782s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9492024-12-14T03:31:15.703ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502024-12-14T03:31:15.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55172
9512024-12-14T03:31:15.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9079 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55172 req_id = f74a017d-80aa-4081-a48a-20cf65312083 response_code = 200 uri = /timesync
9522024-12-14T03:31:15.715ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147070.3516994, correction: -0.331669718 } file = sled-agent/src/rack_setup/service.rs:743
9532024-12-14T03:31:15.715ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9542024-12-14T03:31:16.742ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9552024-12-14T03:31:16.742ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9562024-12-14T03:31:25.854ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61425
9572024-12-14T03:31:25.854ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61425 req_id = e028a4f5-cbef-4963-b611-dcc2989a6943 response_code = 200 uri = /baseboard
9582024-12-14T03:31:26.717ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9592024-12-14T03:31:26.717ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9602024-12-14T03:31:30.162ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9612024-12-14T03:31:30.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41506
9622024-12-14T03:31:30.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41506 req_id = 871a1ef7-b34e-429e-a6a4-8f9bfe555802 response_code = 200 uri = /timesync
9632024-12-14T03:31:30.174ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147087.2843678, correction: -0.292592376 } file = sled-agent/src/rack_setup/service.rs:743
9642024-12-14T03:31:30.174ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9652024-12-14T03:31:30.549ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.350200306s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9662024-12-14T03:31:36.692ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9672024-12-14T03:31:36.692ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9682024-12-14T03:31:46.667ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9692024-12-14T03:31:46.667ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9702024-12-14T03:31:48.883ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.444608202s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9712024-12-14T03:31:48.924ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9722024-12-14T03:31:48.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43606
9732024-12-14T03:31:48.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8703 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43606 req_id = af2b6141-16b8-41e9-a53f-25558fbc4c86 response_code = 200 uri = /timesync
9742024-12-14T03:31:48.937ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147102.8458643, correction: -0.24162367 } file = sled-agent/src/rack_setup/service.rs:743
9752024-12-14T03:31:48.937ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9762024-12-14T03:31:55.808ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61627
9772024-12-14T03:31:55.808ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61627 req_id = ef44ee19-3691-441e-977c-24f964539d59 response_code = 200 uri = /baseboard
9782024-12-14T03:31:56.642ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9792024-12-14T03:31:56.642ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9802024-12-14T03:32:05.459ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9812024-12-14T03:32:05.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42172
9822024-12-14T03:32:05.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9060 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42172 req_id = 2fe6052e-ae66-4c88-ab72-86a95fb3095c response_code = 200 uri = /timesync
9832024-12-14T03:32:05.471ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147119.9321954, correction: -0.196684211 } file = sled-agent/src/rack_setup/service.rs:743
9842024-12-14T03:32:05.471ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9852024-12-14T03:32:06.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9862024-12-14T03:32:06.618ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9872024-12-14T03:32:12.300ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.247160386s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9882024-12-14T03:32:16.593ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9892024-12-14T03:32:16.593ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9902024-12-14T03:32:25.759ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34650
9912024-12-14T03:32:25.759ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34650 req_id = c152d9a3-6bda-47c6-86cf-9858870fcdcd response_code = 200 uri = /baseboard
9922024-12-14T03:32:26.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9932024-12-14T03:32:26.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
9942024-12-14T03:32:28.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9952024-12-14T03:32:28.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45022
9962024-12-14T03:32:29.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45022 req_id = d4a0f6ca-84f1-4791-b9cf-5207c6c3a7ee response_code = 200 uri = /timesync
9972024-12-14T03:32:29.007ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147144.3109963, correction: -0.132768854 } file = sled-agent/src/rack_setup/service.rs:743
9982024-12-14T03:32:29.007ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9992024-12-14T03:32:36.543ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10002024-12-14T03:32:36.543ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10012024-12-14T03:32:42.500ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 40.809523949s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10022024-12-14T03:32:46.519ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10032024-12-14T03:32:46.519ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10042024-12-14T03:32:48.101ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10052024-12-14T03:32:48.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60398
10062024-12-14T03:32:48.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60398 req_id = d935263a-cd7c-446e-b477-fcaee9e0be56 response_code = 200 uri = /timesync
10072024-12-14T03:32:48.111ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147159.7867827, correction: -0.080902331 } file = sled-agent/src/rack_setup/service.rs:743
10082024-12-14T03:32:48.111ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10092024-12-14T03:32:55.711ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50409
10102024-12-14T03:32:55.711ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50409 req_id = 6e52fefd-afc0-46ac-9397-8f934d441844 response_code = 200 uri = /baseboard
10112024-12-14T03:32:56.493ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10122024-12-14T03:32:56.493ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10132024-12-14T03:33:06.468ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4902101634864656646 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10142024-12-14T03:33:06.468ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7772697490249257691 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10152024-12-14T03:33:16.076ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10162024-12-14T03:33:16.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40301
10172024-12-14T03:33:16.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40301 req_id = 28c985b8-f503-426d-b090-a776040ad195 response_code = 200 uri = /timesync
10182024-12-14T03:33:16.096ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:31:04.607908646Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12682720977169218032 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10192024-12-14T03:33:16.098ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:31:12.607059847Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14196284788045832048 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10202024-12-14T03:33:16.099ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:31:05.435018021Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5153004696194435353 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10212024-12-14T03:33:16.099ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:31:04.461567696Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 11401469229093759208 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10222024-12-14T03:33:16.099ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:30:45.625519488Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6555642316865038272 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10232024-12-14T03:33:16.099ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:30:45.625016428Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13194863876967631275 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10242024-12-14T03:33:16.100ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-14T03:31:12.607343283Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3085336735118733411 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
10252024-12-14T03:33:16.102ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1734147192.0607195, correction: -0.004872889 } file = sled-agent/src/rack_setup/service.rs:743
10262024-12-14T03:33:16.102ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10272024-12-14T03:33:16.132ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 3db8556d-0ae0-4824-8953-f38d8eef7409 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db39fe07-65c4-451a-a2bd-78fcdfc10040 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7b672843-049d-4d9c-b0a2-21d7b6323621 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f91a04b5-83ce-4ca1-88d3-c38788e84e35 (service), filesystem_pool: Some(ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bb9c2736-3fb6-473d-8835-439953139e25, kind: Service { id: f91a04b5-83ce-4ca1-88d3-c38788e84e35 }, name: Name("ntp-f91a04b5-83ce-4ca1-88d3-c38788e84e35"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 21])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 09aeaeff-e081-4b5d-ae0d-d67defe30e08 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } } } }, OmicronZoneConfig { id: f1bb5f01-3564-4971-8c50-040cd83812d6 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } } } }, OmicronZoneConfig { id: f4cff62b-3e34-4126-9934-ba49cffb77bb (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } } } }, OmicronZoneConfig { id: ced8d75b-22e1-4b69-962b-09a1d2b1fe79 (service), filesystem_pool: Some(ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6b13a320-ee2a-4762-8f49-48d414043e39 (service), filesystem_pool: Some(ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10282024-12-14T03:33:16.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36031
10292024-12-14T03:33:16.133ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-12-14T03:33:16.133ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10312024-12-14T03:33:16.172ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-12-14T03:33:16.172ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10332024-12-14T03:33:16.206ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10342024-12-14T03:33:16.206ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10352024-12-14T03:33:16.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 09aeaeff-e081-4b5d-ae0d-d67defe30e08, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-12-14T03:33:16.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 09aeaeff-e081-4b5d-ae0d-d67defe30e08, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10372024-12-14T03:33:16.271ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f1bb5f01-3564-4971-8c50-040cd83812d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10382024-12-14T03:33:16.271ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f1bb5f01-3564-4971-8c50-040cd83812d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10392024-12-14T03:33:16.303ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f4cff62b-3e34-4126-9934-ba49cffb77bb, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10402024-12-14T03:33:16.303ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f4cff62b-3e34-4126-9934-ba49cffb77bb, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10412024-12-14T03:33:16.336ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ced8d75b-22e1-4b69-962b-09a1d2b1fe79, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10422024-12-14T03:33:16.336ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ced8d75b-22e1-4b69-962b-09a1d2b1fe79, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432024-12-14T03:33:16.370ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6b13a320-ee2a-4762-8f49-48d414043e39, dataset_name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10442024-12-14T03:33:16.370ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6b13a320-ee2a-4762-8f49-48d414043e39, dataset_name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452024-12-14T03:33:16.401ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10462024-12-14T03:33:16.401ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
10472024-12-14T03:33:16.402ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
10482024-12-14T03:33:16.402ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-12-14T03:33:16.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-12-14T03:33:16.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10512024-12-14T03:33:16.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10522024-12-14T03:33:16.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-12-14T03:33:16.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10542024-12-14T03:33:16.578ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6 file = illumos-utils/src/zone.rs:325
10552024-12-14T03:33:16.582ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 file = illumos-utils/src/zone.rs:325
10562024-12-14T03:33:16.586ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb file = illumos-utils/src/zone.rs:325
10572024-12-14T03:33:16.590ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79 file = illumos-utils/src/zone.rs:325
10582024-12-14T03:33:16.595ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39 file = illumos-utils/src/zone.rs:325
10592024-12-14T03:33:16.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6 file = illumos-utils/src/zone.rs:363
10602024-12-14T03:33:16.606ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 file = illumos-utils/src/zone.rs:363
10612024-12-14T03:33:16.611ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb file = illumos-utils/src/zone.rs:363
10622024-12-14T03:33:16.615ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79 file = illumos-utils/src/zone.rs:363
10632024-12-14T03:33:16.619ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39 file = illumos-utils/src/zone.rs:363
10642024-12-14T03:33:19.453ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f1bb5f01-3564-4971-8c50-040cd83812d6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-12-14T03:33:19.453ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6b13a320-ee2a-4762-8f49-48d414043e39'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10662024-12-14T03:33:19.453ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
10672024-12-14T03:33:19.459ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ced8d75b-22e1-4b69-962b-09a1d2b1fe79'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10682024-12-14T03:33:19.459ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
10692024-12-14T03:33:19.464ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
10702024-12-14T03:33:19.476ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='09aeaeff-e081-4b5d-ae0d-d67defe30e08'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10712024-12-14T03:33:19.476ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f4cff62b-3e34-4126-9934-ba49cffb77bb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-12-14T03:33:19.476ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
10732024-12-14T03:33:19.481ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
10742024-12-14T03:33:19.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 34.400993ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
10752024-12-14T03:33:19.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 43.341662ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
10762024-12-14T03:33:19.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 54.709983ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
10772024-12-14T03:33:19.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 48.039489ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
10782024-12-14T03:33:19.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 62.400349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
10792024-12-14T03:33:19.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 99.779829ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
10802024-12-14T03:33:19.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 129.108727ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
10812024-12-14T03:33:19.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 115.428398ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
10822024-12-14T03:33:20.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 195.683125ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
10832024-12-14T03:33:20.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 95.04692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
10842024-12-14T03:33:20.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 98.116749ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
10852024-12-14T03:33:21.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 136.287191ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
10862024-12-14T03:33:22.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 299.996633ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
10872024-12-14T03:33:22.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 103.869109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
10882024-12-14T03:33:22.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 270.536751ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
10892024-12-14T03:33:22.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 155.767082ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
10902024-12-14T03:33:22.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 537.918603ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
10912024-12-14T03:33:22.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 242.905767ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
10922024-12-14T03:33:22.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 227.835082ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
10932024-12-14T03:33:22.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 329.774288ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
10942024-12-14T03:33:22.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 819.816959ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
10952024-12-14T03:33:22.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.134908602s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
10962024-12-14T03:33:23.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.168958782s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
10972024-12-14T03:33:23.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 1.120519911s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
10982024-12-14T03:33:23.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 834.574299ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
10992024-12-14T03:33:23.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 577.282682ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11002024-12-14T03:33:24.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 1.368696229s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11012024-12-14T03:33:24.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.166316151s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11022024-12-14T03:33:24.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.366717452s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11032024-12-14T03:33:24.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 1.225929976s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11042024-12-14T03:33:24.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 681.061285ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11052024-12-14T03:33:24.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 521.579789ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11062024-12-14T03:33:25.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.401756032s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11072024-12-14T03:33:25.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 747.419448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11082024-12-14T03:33:25.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 574.979478ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11092024-12-14T03:33:25.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 1.061283479s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11102024-12-14T03:33:25.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 630.445773ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11112024-12-14T03:33:25.687ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51515
11122024-12-14T03:33:25.687ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51515 req_id = 9c1c9dc1-7bb8-42db-ad1b-2503b886fb0e response_code = 200 uri = /baseboard
11132024-12-14T03:33:26.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 1.269878191s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11142024-12-14T03:33:26.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 1.033123637s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11152024-12-14T03:33:26.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.120095407s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11162024-12-14T03:33:26.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 1.060349668s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11172024-12-14T03:33:26.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.24841206s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11182024-12-14T03:33:27.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 1.261197899s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11192024-12-14T03:33:27.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.045561596s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11202024-12-14T03:33:27.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 665.451029ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11212024-12-14T03:33:27.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 1.276082716s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11222024-12-14T03:33:27.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.242645927s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11232024-12-14T03:33:28.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 847.457355ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11242024-12-14T03:33:28.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.297007707s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11252024-12-14T03:33:28.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 957.39759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11262024-12-14T03:33:28.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 1.054784893s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11272024-12-14T03:33:28.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 906.73616ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11282024-12-14T03:33:29.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.165824898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11292024-12-14T03:33:29.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 1.376420457s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11302024-12-14T03:33:29.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.386696743s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11312024-12-14T03:33:29.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 801.122783ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11322024-12-14T03:33:29.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 1.233866991s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11332024-12-14T03:33:30.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 899.017815ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11342024-12-14T03:33:30.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 814.571956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11352024-12-14T03:33:30.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb") failed: Property not found. retry in 1.392103877s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11362024-12-14T03:33:31.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79") failed: Property not found. retry in 1.069746726s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11372024-12-14T03:33:31.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6") failed: Property not found. retry in 669.894412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11382024-12-14T03:33:31.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08") failed: Property not found. retry in 1.288333113s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11392024-12-14T03:33:31.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39") failed: Property not found. retry in 575.603112ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11402024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f1bb5f01-3564-4971-8c50-040cd83812d6
11412024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08
11422024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f4cff62b-3e34-4126-9934-ba49cffb77bb
11432024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ced8d75b-22e1-4b69-962b-09a1d2b1fe79
11442024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_6b13a320-ee2a-4762-8f49-48d414043e39
11452024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11462024-12-14T03:33:32.600ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11472024-12-14T03:33:32.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16472934 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36031 req_id = 8935ce39-c476-4392-98c9-e83e62f354ee response_code = 204 uri = /omicron-zones
11482024-12-14T03:33:32.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57107
11492024-12-14T03:33:32.662ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 503e4144-2f6c-4bd1-9745-10a9827c1a1f response_code = 500 uri = /cockroachdb
11502024-12-14T03:33:32.663ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "503e4144-2f6c-4bd1-9745-10a9827c1a1f", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "503e4144-2f6c-4bd1-9745-10a9827c1a1f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 115.220249ms
11512024-12-14T03:33:32.806ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = dceeb891-7370-4a1d-abac-c8c6c8b9d28f response_code = 500 uri = /cockroachdb
11522024-12-14T03:33:32.806ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dceeb891-7370-4a1d-abac-c8c6c8b9d28f", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dceeb891-7370-4a1d-abac-c8c6c8b9d28f" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 62.704687ms
11532024-12-14T03:33:32.898ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 1e6c6939-ea87-4971-8fba-6b101917e3ba response_code = 500 uri = /cockroachdb
11542024-12-14T03:33:32.898ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1e6c6939-ea87-4971-8fba-6b101917e3ba", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1e6c6939-ea87-4971-8fba-6b101917e3ba" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 154.763898ms
11552024-12-14T03:33:33.081ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 8084de44-4951-4e22-b538-d885188dd6f5 response_code = 500 uri = /cockroachdb
11562024-12-14T03:33:33.082ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8084de44-4951-4e22-b538-d885188dd6f5", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8084de44-4951-4e22-b538-d885188dd6f5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 119.798768ms
11572024-12-14T03:33:33.231ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 36c2eaa8-2a4a-4113-aa9f-637cdf118303 response_code = 500 uri = /cockroachdb
11582024-12-14T03:33:33.231ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "36c2eaa8-2a4a-4113-aa9f-637cdf118303", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "36c2eaa8-2a4a-4113-aa9f-637cdf118303" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 308.446346ms
11592024-12-14T03:33:33.568ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = e86fab78-f781-4933-9840-efe171ddc853 response_code = 500 uri = /cockroachdb
11602024-12-14T03:33:33.569ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e86fab78-f781-4933-9840-efe171ddc853", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e86fab78-f781-4933-9840-efe171ddc853" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 333.873267ms
11612024-12-14T03:33:33.930ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = fa7cfbb4-1c5d-4097-b351-bd3940f60abf response_code = 500 uri = /cockroachdb
11622024-12-14T03:33:33.931ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fa7cfbb4-1c5d-4097-b351-bd3940f60abf", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fa7cfbb4-1c5d-4097-b351-bd3940f60abf" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 208.784157ms
11632024-12-14T03:33:34.168ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27311 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 5a8bbc18-01d4-4c1e-9ddf-f9ee0c3c684e response_code = 500 uri = /cockroachdb
11642024-12-14T03:33:34.168ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5a8bbc18-01d4-4c1e-9ddf-f9ee0c3c684e", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5a8bbc18-01d4-4c1e-9ddf-f9ee0c3c684e" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 462.059418ms
11652024-12-14T03:33:34.659ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 01a064e5-dd70-4fba-acc6-50ed92f49a89 response_code = 500 uri = /cockroachdb
11662024-12-14T03:33:34.659ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "01a064e5-dd70-4fba-acc6-50ed92f49a89", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "01a064e5-dd70-4fba-acc6-50ed92f49a89" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 281.841245ms
11672024-12-14T03:33:34.967ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = 06708a0d-5a87-4994-aa6f-d3b00ac026ce response_code = 500 uri = /cockroachdb
11682024-12-14T03:33:34.967ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "06708a0d-5a87-4994-aa6f-d3b00ac026ce", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "06708a0d-5a87-4994-aa6f-d3b00ac026ce" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 436.207791ms
11692024-12-14T03:33:35.431ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26310 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = a4fc91fc-a36c-4ef7-9dc5-5f4eaa78fb2b response_code = 500 uri = /cockroachdb
11702024-12-14T03:33:35.431ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a4fc91fc-a36c-4ef7-9dc5-5f4eaa78fb2b", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:34 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a4fc91fc-a36c-4ef7-9dc5-5f4eaa78fb2b" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 394.554046ms
11712024-12-14T03:33:35.855ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_09aeaeff-e081-4b5d-ae0d-d67defe30e08 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = fb3db961-1784-4543-a0c7-4d78208f632b response_code = 500 uri = /cockroachdb
11722024-12-14T03:33:35.856ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fb3db961-1784-4543-a0c7-4d78208f632b", "content-length": "124", "date": "Sat, 14 Dec 2024 03:33:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fb3db961-1784-4543-a0c7-4d78208f632b" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 676.196467ms
11732024-12-14T03:33:36.573ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3743
11742024-12-14T03:33:53.550ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11752024-12-14T03:34:09.144ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11762024-12-14T03:34:09.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32611082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57107 req_id = ff2a1123-a68a-4150-90fc-72077a3e1d00 response_code = 204 uri = /cockroachdb
11772024-12-14T03:34:09.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62879
11782024-12-14T03:34:09.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62879 req_id = dfa277f8-8f44-4234-a2e9-8284772a004f response_code = 200 uri = /baseboard
11792024-12-14T03:34:09.151ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 89.339518941s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
11802024-12-14T03:34:09.183ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 3db8556d-0ae0-4824-8953-f38d8eef7409 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: db39fe07-65c4-451a-a2bd-78fcdfc10040 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7b672843-049d-4d9c-b0a2-21d7b6323621 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: f91a04b5-83ce-4ca1-88d3-c38788e84e35 (service), filesystem_pool: Some(ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: bb9c2736-3fb6-473d-8835-439953139e25, kind: Service { id: f91a04b5-83ce-4ca1-88d3-c38788e84e35 }, name: Name("ntp-f91a04b5-83ce-4ca1-88d3-c38788e84e35"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 196, 21])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 09aeaeff-e081-4b5d-ae0d-d67defe30e08 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } } } }, OmicronZoneConfig { id: f1bb5f01-3564-4971-8c50-040cd83812d6 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } } } }, OmicronZoneConfig { id: f4cff62b-3e34-4126-9934-ba49cffb77bb (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } } } }, OmicronZoneConfig { id: ced8d75b-22e1-4b69-962b-09a1d2b1fe79 (service), filesystem_pool: Some(ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6b13a320-ee2a-4762-8f49-48d414043e39 (service), filesystem_pool: Some(ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External } } } }, OmicronZoneConfig { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: dc6862c8-90dd-40bf-a461-5b36c4239936 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 (service), filesystem_pool: Some(ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 (service), filesystem_pool: Some(ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a321e00a-3126-4ea4-b26d-c0e3eea69166 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } } } }, OmicronZoneConfig { id: b974dc5d-1c9c-40f2-82f3-2fdc6cce6481 (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: f2a02677-b9b6-40cb-9b43-47c372653abf (service), filesystem_pool: Some(ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: da486e84-c3c4-4913-896c-480797d4253c (service), filesystem_pool: Some(ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9f85acd0-be93-4a8b-93d2-87d65b9f6296 (service), filesystem_pool: Some(ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0212236d-21e5-41c5-97f7-16fc6c7f46c3 (service), filesystem_pool: Some(ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 57290f0a-26c5-4c0b-8349-591dffa4c9c4 (service), filesystem_pool: Some(ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External } } } }, OmicronZoneConfig { id: 21b7c7af-9796-44cc-a548-8d8e7731e1dc (service), filesystem_pool: Some(ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External } } } }, OmicronZoneConfig { id: f10ebc72-1785-47bb-8cf0-9fdb414404bf (service), filesystem_pool: Some(ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External } } } }, OmicronZoneConfig { id: 96c38cba-8876-4643-8f76-c848a3309775 (service), filesystem_pool: Some(ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External } } } }, OmicronZoneConfig { id: 1e12c85d-7ae8-4529-9fe3-6e42d4d6087c (service), filesystem_pool: Some(ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e (service), filesystem_pool: Some(ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11812024-12-14T03:34:09.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58820
11822024-12-14T03:34:09.183ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11832024-12-14T03:34:09.183ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3db8556d-0ae0-4824-8953-f38d8eef7409, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11842024-12-14T03:34:09.267ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11852024-12-14T03:34:09.267ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: db39fe07-65c4-451a-a2bd-78fcdfc10040, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11862024-12-14T03:34:09.338ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11872024-12-14T03:34:09.338ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7b672843-049d-4d9c-b0a2-21d7b6323621, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11882024-12-14T03:34:09.402ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 09aeaeff-e081-4b5d-ae0d-d67defe30e08, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11892024-12-14T03:34:09.402ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 09aeaeff-e081-4b5d-ae0d-d67defe30e08, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11902024-12-14T03:34:09.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f1bb5f01-3564-4971-8c50-040cd83812d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11912024-12-14T03:34:09.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f1bb5f01-3564-4971-8c50-040cd83812d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11922024-12-14T03:34:09.531ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f4cff62b-3e34-4126-9934-ba49cffb77bb, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11932024-12-14T03:34:09.531ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f4cff62b-3e34-4126-9934-ba49cffb77bb, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11942024-12-14T03:34:09.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ced8d75b-22e1-4b69-962b-09a1d2b1fe79, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11952024-12-14T03:34:09.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ced8d75b-22e1-4b69-962b-09a1d2b1fe79, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11962024-12-14T03:34:09.650ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6b13a320-ee2a-4762-8f49-48d414043e39, dataset_name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11972024-12-14T03:34:09.650ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6b13a320-ee2a-4762-8f49-48d414043e39, dataset_name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Cockroach }, responder: ... }
11982024-12-14T03:34:09.701ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11992024-12-14T03:34:09.701ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12002024-12-14T03:34:09.757ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12012024-12-14T03:34:09.757ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12022024-12-14T03:34:09.811ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12032024-12-14T03:34:09.811ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12042024-12-14T03:34:09.881ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: da486e84-c3c4-4913-896c-480797d4253c, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12052024-12-14T03:34:09.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: da486e84-c3c4-4913-896c-480797d4253c, dataset_name: DatasetName { pool_name: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, kind: Crucible }, responder: ... }
12062024-12-14T03:34:09.938ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9f85acd0-be93-4a8b-93d2-87d65b9f6296, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12072024-12-14T03:34:09.938ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9f85acd0-be93-4a8b-93d2-87d65b9f6296, dataset_name: DatasetName { pool_name: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, kind: Crucible }, responder: ... }
12082024-12-14T03:34:09.997ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0212236d-21e5-41c5-97f7-16fc6c7f46c3, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12092024-12-14T03:34:09.997ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0212236d-21e5-41c5-97f7-16fc6c7f46c3, dataset_name: DatasetName { pool_name: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, kind: Crucible }, responder: ... }
12102024-12-14T03:34:10.063ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 57290f0a-26c5-4c0b-8349-591dffa4c9c4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12112024-12-14T03:34:10.063ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 57290f0a-26c5-4c0b-8349-591dffa4c9c4, dataset_name: DatasetName { pool_name: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, kind: Crucible }, responder: ... }
12122024-12-14T03:34:10.112ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 21b7c7af-9796-44cc-a548-8d8e7731e1dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12132024-12-14T03:34:10.112ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 21b7c7af-9796-44cc-a548-8d8e7731e1dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, kind: Crucible }, responder: ... }
12142024-12-14T03:34:10.162ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f10ebc72-1785-47bb-8cf0-9fdb414404bf, dataset_name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12152024-12-14T03:34:10.162ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f10ebc72-1785-47bb-8cf0-9fdb414404bf, dataset_name: DatasetName { pool_name: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, kind: Crucible }, responder: ... }
12162024-12-14T03:34:10.245ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 96c38cba-8876-4643-8f76-c848a3309775, dataset_name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12172024-12-14T03:34:10.245ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 96c38cba-8876-4643-8f76-c848a3309775, dataset_name: DatasetName { pool_name: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, kind: Crucible }, responder: ... }
12182024-12-14T03:34:10.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e12c85d-7ae8-4529-9fe3-6e42d4d6087c, dataset_name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12192024-12-14T03:34:10.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e12c85d-7ae8-4529-9fe3-6e42d4d6087c, dataset_name: DatasetName { pool_name: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, kind: Crucible }, responder: ... }
12202024-12-14T03:34:10.361ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e, dataset_name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12212024-12-14T03:34:10.362ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e, dataset_name: DatasetName { pool_name: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, kind: Crucible }, responder: ... }
12222024-12-14T03:34:10.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12232024-12-14T03:34:10.431ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
12242024-12-14T03:34:10.431ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
12252024-12-14T03:34:10.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12262024-12-14T03:34:10.590ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12272024-12-14T03:34:10.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12282024-12-14T03:34:10.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12292024-12-14T03:34:10.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12302024-12-14T03:34:10.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12312024-12-14T03:34:10.626ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12322024-12-14T03:34:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12332024-12-14T03:34:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12342024-12-14T03:34:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12352024-12-14T03:34:10.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12362024-12-14T03:34:10.784ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12372024-12-14T03:34:10.854ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12382024-12-14T03:34:10.854ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12392024-12-14T03:34:10.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12402024-12-14T03:34:10.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412024-12-14T03:34:10.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12422024-12-14T03:34:10.855ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12432024-12-14T03:34:10.856ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12442024-12-14T03:34:10.867ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12452024-12-14T03:34:10.867ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83 file = illumos-utils/src/zone.rs:325
12462024-12-14T03:34:10.872ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481 file = illumos-utils/src/zone.rs:325
12472024-12-14T03:34:10.877ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c file = illumos-utils/src/zone.rs:325
12482024-12-14T03:34:10.883ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf file = illumos-utils/src/zone.rs:325
12492024-12-14T03:34:10.888ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166 file = illumos-utils/src/zone.rs:325
12502024-12-14T03:34:10.893ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf file = illumos-utils/src/zone.rs:325
12512024-12-14T03:34:10.898ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c file = illumos-utils/src/zone.rs:325
12522024-12-14T03:34:10.902ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e file = illumos-utils/src/zone.rs:325
12532024-12-14T03:34:11.025ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83 file = illumos-utils/src/zone.rs:363
12542024-12-14T03:34:11.030ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481 file = illumos-utils/src/zone.rs:363
12552024-12-14T03:34:11.035ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c file = illumos-utils/src/zone.rs:363
12562024-12-14T03:34:11.039ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf file = illumos-utils/src/zone.rs:363
12572024-12-14T03:34:11.044ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166 file = illumos-utils/src/zone.rs:363
12582024-12-14T03:34:11.048ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf file = illumos-utils/src/zone.rs:363
12592024-12-14T03:34:11.053ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c file = illumos-utils/src/zone.rs:363
12602024-12-14T03:34:11.058ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e file = illumos-utils/src/zone.rs:363
12612024-12-14T03:34:11.063ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3 file = illumos-utils/src/zone.rs:325
12622024-12-14T03:34:11.068ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4 file = illumos-utils/src/zone.rs:325
12632024-12-14T03:34:11.073ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775 file = illumos-utils/src/zone.rs:325
12642024-12-14T03:34:11.078ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296 file = illumos-utils/src/zone.rs:325
12652024-12-14T03:34:11.083ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc file = illumos-utils/src/zone.rs:325
12662024-12-14T03:34:11.089ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d file = illumos-utils/src/zone.rs:325
12672024-12-14T03:34:11.154ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12682024-12-14T03:34:11.220ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12692024-12-14T03:34:11.221ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3 file = illumos-utils/src/zone.rs:363
12702024-12-14T03:34:11.294ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4 file = illumos-utils/src/zone.rs:363
12712024-12-14T03:34:11.315ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775 file = illumos-utils/src/zone.rs:363
12722024-12-14T03:34:11.343ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296 file = illumos-utils/src/zone.rs:363
12732024-12-14T03:34:11.365ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc file = illumos-utils/src/zone.rs:363
12742024-12-14T03:34:11.380ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d file = illumos-utils/src/zone.rs:363
12752024-12-14T03:34:11.455ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12762024-12-14T03:34:11.513ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12772024-12-14T03:34:11.573ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12782024-12-14T03:34:11.576ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12792024-12-14T03:34:11.576ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12802024-12-14T03:34:11.632ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 170, 226]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12812024-12-14T03:34:11.632ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12822024-12-14T03:34:11.635ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12832024-12-14T03:34:11.635ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12842024-12-14T03:34:11.686ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 190, 158]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12852024-12-14T03:34:11.686ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12862024-12-14T03:34:11.693ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12872024-12-14T03:34:11.693ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12882024-12-14T03:34:11.753ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 140, 181]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12892024-12-14T03:34:11.753ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12902024-12-14T03:34:11.754ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12912024-12-14T03:34:11.754ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12922024-12-14T03:34:11.808ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 143, 224]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12932024-12-14T03:34:11.808ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12942024-12-14T03:34:11.808ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12952024-12-14T03:34:11.808ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12962024-12-14T03:34:11.808ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12972024-12-14T03:34:11.808ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12982024-12-14T03:34:11.809ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12992024-12-14T03:34:11.809ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13002024-12-14T03:34:11.866ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 182, 203]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13012024-12-14T03:34:11.866ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
13022024-12-14T03:34:11.867ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13032024-12-14T03:34:11.869ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13042024-12-14T03:34:11.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13052024-12-14T03:34:11.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13062024-12-14T03:34:11.946ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13072024-12-14T03:34:11.946ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13082024-12-14T03:34:11.947ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13092024-12-14T03:34:11.947ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13102024-12-14T03:34:11.947ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13112024-12-14T03:34:11.947ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13122024-12-14T03:34:11.947ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3 file = illumos-utils/src/zone.rs:325
13132024-12-14T03:34:11.957ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13142024-12-14T03:34:11.960ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13152024-12-14T03:34:11.963ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13162024-12-14T03:34:11.963ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13172024-12-14T03:34:11.963ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13182024-12-14T03:34:11.965ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13192024-12-14T03:34:11.966ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230 file = illumos-utils/src/zone.rs:325
13202024-12-14T03:34:12.075ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3 file = illumos-utils/src/zone.rs:363
13212024-12-14T03:34:12.091ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230 file = illumos-utils/src/zone.rs:363
13222024-12-14T03:34:12.095ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936 file = illumos-utils/src/zone.rs:325
13232024-12-14T03:34:12.106ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8 file = illumos-utils/src/zone.rs:325
13242024-12-14T03:34:12.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1 file = illumos-utils/src/zone.rs:325
13252024-12-14T03:34:12.129ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936 file = illumos-utils/src/zone.rs:363
13262024-12-14T03:34:12.141ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8 file = illumos-utils/src/zone.rs:363
13272024-12-14T03:34:12.150ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1 file = illumos-utils/src/zone.rs:363
13282024-12-14T03:34:14.294ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13292024-12-14T03:34:14.294ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13302024-12-14T03:34:14.357ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c1f8d1d4-0004-4bcd-a625-967da78605b5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13312024-12-14T03:34:14.357ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13322024-12-14T03:34:14.395ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='234d4c15-6bb2-4f28-bead-73ac0526c549'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13332024-12-14T03:34:14.395ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13342024-12-14T03:34:14.453ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fb57e12e-6889-4ba5-8f94-102093287f39/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='49927be4-436e-4f54-acb9-f3dc500d8d1f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352024-12-14T03:34:14.454ZINFOSledAgent (ServiceManager): Booting oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13362024-12-14T03:34:14.608ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_128dcb8a-56c9-451c-a438-d3ea94a82725/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b693391c-37f1-46e8-9d68-f42ac9f6e590'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372024-12-14T03:34:14.608ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13382024-12-14T03:34:14.617ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7ec437ed-eff5-46bb-bb04-cdd5ba18bd8d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13392024-12-14T03:34:14.617ZINFOSledAgent (ServiceManager): Booting oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13402024-12-14T03:34:14.625ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_73bc07b3-a806-455e-a40b-a99deea605ef/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e149770e-bf73-4a39-886a-f4e011415673'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412024-12-14T03:34:14.626ZINFOSledAgent (ServiceManager): Booting oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13422024-12-14T03:34:14.808ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432024-12-14T03:34:14.809ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13442024-12-14T03:34:14.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 65.269042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13452024-12-14T03:34:14.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 50.047723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13462024-12-14T03:34:14.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 69.879685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13472024-12-14T03:34:14.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 30.630995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13482024-12-14T03:34:14.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 54.134647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13492024-12-14T03:34:14.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 50.17477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13502024-12-14T03:34:14.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 40.290343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13512024-12-14T03:34:14.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 83.80562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13522024-12-14T03:34:14.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 55.303769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13532024-12-14T03:34:15.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 82.161419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13542024-12-14T03:34:15.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 57.177583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13552024-12-14T03:34:15.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 134.695603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13562024-12-14T03:34:15.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 95.569885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13572024-12-14T03:34:15.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 96.288355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13582024-12-14T03:34:19.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 136.23189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13592024-12-14T03:34:19.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 201.998091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13602024-12-14T03:34:20.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 242.913576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13612024-12-14T03:34:20.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 148.585741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13622024-12-14T03:34:20.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 141.574642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13632024-12-14T03:34:20.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 294.219394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13642024-12-14T03:34:20.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 293.305517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13652024-12-14T03:34:20.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 59.457035ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13662024-12-14T03:34:20.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 413.657145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13672024-12-14T03:34:20.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 448.211328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13682024-12-14T03:34:20.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 272.107389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13692024-12-14T03:34:20.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 573.451765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13702024-12-14T03:34:20.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 557.979982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13712024-12-14T03:34:20.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 112.537916ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13722024-12-14T03:34:20.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 284.369269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13732024-12-14T03:34:20.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 459.054924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13742024-12-14T03:34:20.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 258.344099ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13752024-12-14T03:34:20.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.068277627s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13762024-12-14T03:34:20.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 644.593473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13772024-12-14T03:34:20.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 504.849141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13782024-12-14T03:34:20.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 575.929822ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13792024-12-14T03:34:20.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 642.269964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13802024-12-14T03:34:20.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 919.869932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13812024-12-14T03:34:20.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 547.779171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13822024-12-14T03:34:20.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 855.48469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13832024-12-14T03:34:21.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.283617079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13842024-12-14T03:34:21.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.471393357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13852024-12-14T03:34:21.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.05430866s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13862024-12-14T03:34:21.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.379458763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13872024-12-14T03:34:21.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 999.601043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13882024-12-14T03:34:21.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 826.740718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13892024-12-14T03:34:21.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 718.076715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13902024-12-14T03:34:21.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 849.939696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13912024-12-14T03:34:22.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 628.545762ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
13922024-12-14T03:34:22.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.412034064s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
13932024-12-14T03:34:22.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 993.330653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
13942024-12-14T03:34:22.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.247709271s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
13952024-12-14T03:34:22.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 558.232664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
13962024-12-14T03:34:22.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 574.783254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
13972024-12-14T03:34:22.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 956.802089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
13982024-12-14T03:34:22.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.450066451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
13992024-12-14T03:34:23.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 852.061831ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14002024-12-14T03:34:23.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.10658097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14012024-12-14T03:34:23.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 601.830242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14022024-12-14T03:34:23.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.30974957s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14032024-12-14T03:34:23.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.080948076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
14042024-12-14T03:34:23.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.412642244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14052024-12-14T03:34:23.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 659.811436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14062024-12-14T03:34:23.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 637.205436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14072024-12-14T03:34:23.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.312196954s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14082024-12-14T03:34:24.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.223105171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14092024-12-14T03:34:24.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.407836671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
14102024-12-14T03:34:24.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 927.65727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14112024-12-14T03:34:24.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 858.033286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14122024-12-14T03:34:24.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.113119577s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14132024-12-14T03:34:24.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 976.515173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
14142024-12-14T03:34:25.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.470651227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14152024-12-14T03:34:25.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.020835266s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14162024-12-14T03:34:25.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 773.8359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14172024-12-14T03:34:25.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.127509084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14182024-12-14T03:34:25.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 749.495226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14192024-12-14T03:34:25.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.217830851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
14202024-12-14T03:34:25.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 991.222109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
14212024-12-14T03:34:26.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 619.254621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14222024-12-14T03:34:26.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.492228327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14232024-12-14T03:34:26.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.30473925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14242024-12-14T03:34:26.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 818.592482ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14252024-12-14T03:34:26.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 852.27225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14262024-12-14T03:34:26.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.091945557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14272024-12-14T03:34:26.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 812.099346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14282024-12-14T03:34:26.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.324835909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
14292024-12-14T03:34:26.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 703.518276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
14302024-12-14T03:34:27.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.147878499s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14312024-12-14T03:34:27.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.361840601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14322024-12-14T03:34:27.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.037126871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14332024-12-14T03:34:27.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 676.41313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14342024-12-14T03:34:27.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.345231801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
14352024-12-14T03:34:27.737ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4a91d090-6980-43b2-8cca-44eb6dd10741/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f835d868-e721-4c40-8fd2-4498fd65cbc0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14362024-12-14T03:34:27.737ZINFOSledAgent (ServiceManager): Booting oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14372024-12-14T03:34:27.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 813.409538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14382024-12-14T03:34:27.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 585.317456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14392024-12-14T03:34:27.786ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402024-12-14T03:34:27.787ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14412024-12-14T03:34:27.947ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='edcd2834-a41b-494b-adfb-54df7a55923d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14422024-12-14T03:34:27.947ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14432024-12-14T03:34:28.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 56.054125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14442024-12-14T03:34:28.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 31.620255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14452024-12-14T03:34:28.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 55.43896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14462024-12-14T03:34:28.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 114.547894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14472024-12-14T03:34:28.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 218.624603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14482024-12-14T03:34:28.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.471153873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14492024-12-14T03:34:28.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 885.594179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
14502024-12-14T03:34:28.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 295.039401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14512024-12-14T03:34:28.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 50.94083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14522024-12-14T03:34:28.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 763.564052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14532024-12-14T03:34:28.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 839.971867ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14542024-12-14T03:34:28.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 524.940597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14552024-12-14T03:34:28.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 103.769011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14562024-12-14T03:34:28.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.212282473s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14572024-12-14T03:34:28.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.12103926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14582024-12-14T03:34:28.622ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='a321e00a-3126-4ea4-b26d-c0e3eea69166'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14592024-12-14T03:34:28.623ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
14602024-12-14T03:34:28.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 104.810955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14612024-12-14T03:34:28.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 590.164243ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14622024-12-14T03:34:28.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 410.612913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14632024-12-14T03:34:28.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 685.833378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14642024-12-14T03:34:28.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 41.786853ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
14652024-12-14T03:34:28.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 146.391202ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
14662024-12-14T03:34:29.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 878.246812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
14672024-12-14T03:34:29.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 868.117108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14682024-12-14T03:34:29.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 161.362142ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
14692024-12-14T03:34:29.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.193000292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14702024-12-14T03:34:29.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 976.922133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14712024-12-14T03:34:29.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 532.046907ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
14722024-12-14T03:34:29.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.187182088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
14732024-12-14T03:34:29.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.199027322s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
14742024-12-14T03:34:29.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.112560529s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14752024-12-14T03:34:29.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 535.584088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14762024-12-14T03:34:29.668ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14772024-12-14T03:34:29.668ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14782024-12-14T03:34:29.725ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
14792024-12-14T03:34:29.731ZINFOSledAgent (ServiceManager): Booting oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
14802024-12-14T03:34:29.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 587.811204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14812024-12-14T03:34:29.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.423156247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
14822024-12-14T03:34:29.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.064018732s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
14832024-12-14T03:34:29.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.365910504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
14842024-12-14T03:34:29.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.443866142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
14852024-12-14T03:34:29.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.437324906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
14862024-12-14T03:34:29.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 70.753717ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
14872024-12-14T03:34:29.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 52.961409ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
14882024-12-14T03:34:30.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 72.190705ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
14892024-12-14T03:34:30.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 76.180758ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
14902024-12-14T03:34:30.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 243.693124ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
14912024-12-14T03:34:30.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 165.209335ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
14922024-12-14T03:34:30.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.041379251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
14932024-12-14T03:34:30.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 568.919172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
14942024-12-14T03:34:30.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 330.791846ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
14952024-12-14T03:34:30.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 878.89507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
14962024-12-14T03:34:30.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 304.517463ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
14972024-12-14T03:34:30.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 886.054036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
14982024-12-14T03:34:30.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 773.472236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
14992024-12-14T03:34:30.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.115976623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15002024-12-14T03:34:30.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.163580586s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15012024-12-14T03:34:30.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.060045727s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15022024-12-14T03:34:30.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 993.412977ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15032024-12-14T03:34:30.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 553.241275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15042024-12-14T03:34:30.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 598.111853ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15052024-12-14T03:34:31.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 653.584862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15062024-12-14T03:34:31.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.159843883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
15072024-12-14T03:34:31.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 553.239472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15082024-12-14T03:34:31.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 787.719435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
15092024-12-14T03:34:31.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.274402283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15102024-12-14T03:34:31.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.476370459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
15112024-12-14T03:34:31.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 992.871362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15122024-12-14T03:34:31.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 794.739571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
15132024-12-14T03:34:31.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 674.900316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
15142024-12-14T03:34:31.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 635.226935ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15152024-12-14T03:34:31.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 887.478522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15162024-12-14T03:34:31.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.354856604s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15172024-12-14T03:34:31.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.438794623s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15182024-12-14T03:34:31.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 794.351992ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15192024-12-14T03:34:31.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 769.048619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15202024-12-14T03:34:31.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.489308424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15212024-12-14T03:34:32.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 949.855923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
15222024-12-14T03:34:32.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.427102698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
15232024-12-14T03:34:32.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.212992078s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15242024-12-14T03:34:32.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 578.100602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
15252024-12-14T03:34:32.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.127231614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15262024-12-14T03:34:32.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 948.327379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
15272024-12-14T03:34:32.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.251946512s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15282024-12-14T03:34:32.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.068788586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15292024-12-14T03:34:32.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 630.838359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15302024-12-14T03:34:32.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.159600019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15312024-12-14T03:34:32.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.084380352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
15322024-12-14T03:34:32.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.256300022s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
15332024-12-14T03:34:33.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.071735367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
15342024-12-14T03:34:33.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.170704331s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15352024-12-14T03:34:33.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 576.178822ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15362024-12-14T03:34:33.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.134303112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15372024-12-14T03:34:33.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 519.495201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
15382024-12-14T03:34:33.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.211857413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15392024-12-14T03:34:33.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.07111673s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15402024-12-14T03:34:33.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 568.431923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15412024-12-14T03:34:33.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 900.004898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
15422024-12-14T03:34:33.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 802.058618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15432024-12-14T03:34:33.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 573.284763ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15442024-12-14T03:34:33.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.062207488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15452024-12-14T03:34:33.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.058095447s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15462024-12-14T03:34:33.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 949.813249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
15472024-12-14T03:34:33.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.174268973s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
15482024-12-14T03:34:34.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 898.339125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
15492024-12-14T03:34:34.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 855.050244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
15502024-12-14T03:34:34.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.378591172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15512024-12-14T03:34:34.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 768.940163ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15522024-12-14T03:34:34.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 902.553059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15532024-12-14T03:34:34.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 764.614609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15542024-12-14T03:34:34.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 627.707969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
15552024-12-14T03:34:34.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.20738893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15562024-12-14T03:34:34.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 749.974638ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15572024-12-14T03:34:34.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 806.551684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15582024-12-14T03:34:34.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 554.623399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15592024-12-14T03:34:34.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 940.150659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
15602024-12-14T03:34:34.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 587.435659ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15612024-12-14T03:34:34.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.32820531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
15622024-12-14T03:34:34.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.265641066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
15632024-12-14T03:34:35.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 826.483742ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15642024-12-14T03:34:35.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.081788971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
15652024-12-14T03:34:35.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.427152722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
15662024-12-14T03:34:35.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 999.969861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15672024-12-14T03:34:35.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 611.838291ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15682024-12-14T03:34:35.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 632.954369ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15692024-12-14T03:34:35.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 936.19206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15702024-12-14T03:34:35.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.282082838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15712024-12-14T03:34:35.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 814.798284ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15722024-12-14T03:34:35.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.063103965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15732024-12-14T03:34:35.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 638.745491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15742024-12-14T03:34:35.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 718.464176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
15752024-12-14T03:34:35.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.213817637s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15762024-12-14T03:34:35.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.4855194s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15772024-12-14T03:34:35.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 896.924074ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15782024-12-14T03:34:36.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.237663221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15792024-12-14T03:34:36.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.398699297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
15802024-12-14T03:34:36.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.414365172s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
15812024-12-14T03:34:36.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 673.953316ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15822024-12-14T03:34:36.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.445355356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
15832024-12-14T03:34:36.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 638.508352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15842024-12-14T03:34:36.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.212209938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
15852024-12-14T03:34:36.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.144266542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
15862024-12-14T03:34:36.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.36265324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
15872024-12-14T03:34:36.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.200898769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
15882024-12-14T03:34:36.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 730.660615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15892024-12-14T03:34:36.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 741.437889ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
15902024-12-14T03:34:36.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 953.656418ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
15912024-12-14T03:34:36.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 565.704266ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
15922024-12-14T03:34:37.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 775.392301ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
15932024-12-14T03:34:37.336ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='17cab8d9-bbb6-468c-882d-52d3820ba3a3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15942024-12-14T03:34:37.336ZINFOSledAgent (ServiceManager): Booting oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
15952024-12-14T03:34:37.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.316726812s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
15962024-12-14T03:34:37.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 714.05641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
15972024-12-14T03:34:37.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.366482876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
15982024-12-14T03:34:37.492ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15992024-12-14T03:34:37.492ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16002024-12-14T03:34:37.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.118425942s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
16012024-12-14T03:34:37.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.429821715s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
16022024-12-14T03:34:37.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 569.967992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
16032024-12-14T03:34:37.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.315888467s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
16042024-12-14T03:34:37.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 631.443863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
16052024-12-14T03:34:37.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.347730669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
16062024-12-14T03:34:37.707ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16072024-12-14T03:34:37.712ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16082024-12-14T03:34:37.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 521.986189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
16092024-12-14T03:34:37.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 861.386894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
16102024-12-14T03:34:37.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 64.224473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16112024-12-14T03:34:37.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.166034478s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
16122024-12-14T03:34:37.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 598.60601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
16132024-12-14T03:34:37.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 71.064081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16142024-12-14T03:34:37.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.32840601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
16152024-12-14T03:34:37.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 38.700478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16162024-12-14T03:34:37.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 58.315885ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16172024-12-14T03:34:37.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 180.902014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16182024-12-14T03:34:38.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 148.675967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16192024-12-14T03:34:38.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 97.857376ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16202024-12-14T03:34:38.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 908.063142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
16212024-12-14T03:34:38.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 583.662862ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
16222024-12-14T03:34:38.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 285.812311ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16232024-12-14T03:34:38.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 252.593475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16242024-12-14T03:34:38.174ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16252024-12-14T03:34:38.174ZINFOSledAgent (ServiceManager): Booting oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16262024-12-14T03:34:38.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 289.886284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16272024-12-14T03:34:38.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 536.024302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
16282024-12-14T03:34:38.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.351174803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
16292024-12-14T03:34:38.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 45.890677ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16302024-12-14T03:34:38.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 478.085668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16312024-12-14T03:34:38.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 428.787627ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16322024-12-14T03:34:38.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 50.002271ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16332024-12-14T03:34:38.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 829.40767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16342024-12-14T03:34:38.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 800.717694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
16352024-12-14T03:34:38.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 223.778953ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16362024-12-14T03:34:38.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.337578458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
16372024-12-14T03:34:38.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.45301708s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
16382024-12-14T03:34:38.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 721.34059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
16392024-12-14T03:34:38.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 538.706925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
16402024-12-14T03:34:38.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 544.858039ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16412024-12-14T03:34:38.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.231331528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
16422024-12-14T03:34:38.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.208656844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
16432024-12-14T03:34:38.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 530.565473ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16442024-12-14T03:34:38.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.286338602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
16452024-12-14T03:34:38.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 642.880789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16462024-12-14T03:34:38.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 526.15206ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
16472024-12-14T03:34:39.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 1.412654564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
16482024-12-14T03:34:39.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.032754642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
16492024-12-14T03:34:39.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 618.884749ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
16502024-12-14T03:34:39.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.245400522s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
16512024-12-14T03:34:39.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 921.500962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
16522024-12-14T03:34:39.290ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64690
16532024-12-14T03:34:39.292ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 502 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64690 req_id = b7a44551-7311-43e2-91be-10411834ca7f response_code = 200 uri = /baseboard
16542024-12-14T03:34:39.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.458224687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
16552024-12-14T03:34:39.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 741.756106ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16562024-12-14T03:34:39.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 1.496659016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16572024-12-14T03:34:39.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 863.922162ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
16582024-12-14T03:34:39.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 873.165193ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16592024-12-14T03:34:39.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.222819301s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
16602024-12-14T03:34:39.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 729.697062ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16612024-12-14T03:34:39.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.438710988s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
16622024-12-14T03:34:39.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 836.660272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
16632024-12-14T03:34:39.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 847.010574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
16642024-12-14T03:34:40.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 746.275884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
16652024-12-14T03:34:40.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 753.602995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
16662024-12-14T03:34:40.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 805.639229ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16672024-12-14T03:34:40.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.310046416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
16682024-12-14T03:34:40.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.147112564s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
16692024-12-14T03:34:40.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 529.422472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
16702024-12-14T03:34:40.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 994.606453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
16712024-12-14T03:34:40.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.027007493s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
16722024-12-14T03:34:40.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 862.547923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16732024-12-14T03:34:40.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 1.180939981s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16742024-12-14T03:34:40.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 842.05514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
16752024-12-14T03:34:40.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.220560195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
16762024-12-14T03:34:40.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.232430845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
16772024-12-14T03:34:40.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 795.341186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
16782024-12-14T03:34:40.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 596.386326ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
16792024-12-14T03:34:40.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 744.478229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
16802024-12-14T03:34:40.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.316085434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
16812024-12-14T03:34:40.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 930.818884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
16822024-12-14T03:34:40.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 1.317299206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
16832024-12-14T03:34:40.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 821.726006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
16842024-12-14T03:34:40.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 1.1131857s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
16852024-12-14T03:34:41.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.057984857s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
16862024-12-14T03:34:41.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 1.352511827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
16872024-12-14T03:34:41.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 791.990577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
16882024-12-14T03:34:41.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 681.811506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
16892024-12-14T03:34:41.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 918.750061ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
16902024-12-14T03:34:41.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.139437231s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
16912024-12-14T03:34:41.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 579.375851ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
16922024-12-14T03:34:41.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 572.686374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
16932024-12-14T03:34:41.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 569.92324ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
16942024-12-14T03:34:41.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.056926716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
16952024-12-14T03:34:41.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 600.355252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
16962024-12-14T03:34:41.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.260270886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
16972024-12-14T03:34:41.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 781.78523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
16982024-12-14T03:34:41.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.493579466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
16992024-12-14T03:34:41.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.496844867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
17002024-12-14T03:34:41.810ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
17012024-12-14T03:34:41.811ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17022024-12-14T03:34:41.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 593.235754ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
17032024-12-14T03:34:41.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 579.966384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
17042024-12-14T03:34:42.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.18192334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
17052024-12-14T03:34:42.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 748.201578ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
17062024-12-14T03:34:42.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 738.487131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
17072024-12-14T03:34:42.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 1.396116049s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17082024-12-14T03:34:42.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 57.316704ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17092024-12-14T03:34:42.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 882.675205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
17102024-12-14T03:34:42.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 994.990792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
17112024-12-14T03:34:42.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.439744886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
17122024-12-14T03:34:42.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 755.423817ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
17132024-12-14T03:34:42.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 84.401928ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17142024-12-14T03:34:42.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 785.606197ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
17152024-12-14T03:34:42.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 105.833671ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17162024-12-14T03:34:42.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 706.731495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
17172024-12-14T03:34:42.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 954.905324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
17182024-12-14T03:34:42.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 858.569012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
17192024-12-14T03:34:42.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.17817098s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
17202024-12-14T03:34:42.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 957.024847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
17212024-12-14T03:34:42.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 574.302554ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17222024-12-14T03:34:42.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.313255026s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
17232024-12-14T03:34:42.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 1.171892587s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
17242024-12-14T03:34:42.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.123030063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
17252024-12-14T03:34:42.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 690.601898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
17262024-12-14T03:34:42.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.417363768s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
17272024-12-14T03:34:43.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 1.356040169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
17282024-12-14T03:34:43.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 804.082488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
17292024-12-14T03:34:43.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 727.640336ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17302024-12-14T03:34:43.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.453657313s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
17312024-12-14T03:34:43.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.067088323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
17322024-12-14T03:34:43.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.004905664s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
17332024-12-14T03:34:43.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 981.130123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
17342024-12-14T03:34:43.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 1.212350289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
17352024-12-14T03:34:43.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 755.083652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
17362024-12-14T03:34:43.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 774.121154ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17372024-12-14T03:34:43.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.051096344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
17382024-12-14T03:34:43.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 630.155523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
17392024-12-14T03:34:43.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.065882642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
17402024-12-14T03:34:43.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 1.328616205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
17412024-12-14T03:34:43.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.287482007s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
17422024-12-14T03:34:43.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 1.02920072s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17432024-12-14T03:34:43.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 1.348976381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
17442024-12-14T03:34:43.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 1.443175723s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
17452024-12-14T03:34:43.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 932.131012ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
17462024-12-14T03:34:44.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 668.547603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
17472024-12-14T03:34:44.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 793.624868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
17482024-12-14T03:34:44.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 943.079621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
17492024-12-14T03:34:44.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8") failed: Property not found. retry in 1.396994568s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
17502024-12-14T03:34:44.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 969.909475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
17512024-12-14T03:34:44.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.062873643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
17522024-12-14T03:34:44.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 722.786648ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17532024-12-14T03:34:44.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 737.704309ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
17542024-12-14T03:34:44.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 699.871781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
17552024-12-14T03:34:44.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 551.996624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
17562024-12-14T03:34:44.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.323031347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
17572024-12-14T03:34:44.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 949.624122ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
17582024-12-14T03:34:44.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 889.671352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
17592024-12-14T03:34:44.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 1.134702783s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
17602024-12-14T03:34:44.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 1.452425224s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
17612024-12-14T03:34:44.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 722.759033ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17622024-12-14T03:34:45.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 617.355129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
17632024-12-14T03:34:45.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 1.249833436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
17642024-12-14T03:34:45.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 936.411573ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17652024-12-14T03:34:45.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 786.21575ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
17662024-12-14T03:34:45.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf") failed: Property not found. retry in 538.088252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
17672024-12-14T03:34:45.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc") failed: Property not found. retry in 780.970214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
17682024-12-14T03:34:45.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.296196101s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
17692024-12-14T03:34:45.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296") failed: Property not found. retry in 997.412763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
17702024-12-14T03:34:45.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e") failed: Property not found. retry in 1.01484758s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
17712024-12-14T03:34:45.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf") failed: Property not found. retry in 587.083439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
17722024-12-14T03:34:45.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 817.313976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
17732024-12-14T03:34:45.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c") failed: Property not found. retry in 713.835487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
17742024-12-14T03:34:45.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 1.236753297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
17752024-12-14T03:34:45.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.284801301s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
17762024-12-14T03:34:45.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775") failed: Property not found. retry in 844.259504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
17772024-12-14T03:34:45.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 1.073962926s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17782024-12-14T03:34:45.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 1.3872802s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
17792024-12-14T03:34:45.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 989.214219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
17802024-12-14T03:34:45.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.123957488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
17812024-12-14T03:34:46.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 759.107834ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17822024-12-14T03:34:46.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.131811665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
17832024-12-14T03:34:46.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 1.240748595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
17842024-12-14T03:34:46.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 897.917798ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
17852024-12-14T03:34:46.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 539.774378ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
17862024-12-14T03:34:46.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 564.702929ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17872024-12-14T03:34:46.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 1.267163442s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
17882024-12-14T03:34:46.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481") failed: Property not found. retry in 1.415188361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
17892024-12-14T03:34:46.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 956.384645ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
17902024-12-14T03:34:46.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 567.316156ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
17912024-12-14T03:34:47.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3") failed: Property not found. retry in 1.486090925s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
17922024-12-14T03:34:47.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83") failed: Property not found. retry in 1.448246342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
17932024-12-14T03:34:47.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166") failed: Property not found. retry in 723.523371ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
17942024-12-14T03:34:47.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 753.914795ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
17952024-12-14T03:34:47.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230") failed: Property not found. retry in 916.59223ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
17962024-12-14T03:34:47.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3") failed: Property not found. retry in 1.276582023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
17972024-12-14T03:34:47.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1") failed: Property not found. retry in 1.244358951s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
17982024-12-14T03:34:47.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 795.940666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
17992024-12-14T03:34:47.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4") failed: Property not found. retry in 983.064865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
18002024-12-14T03:34:48.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936") failed: Property not found. retry in 1.095167408s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
18012024-12-14T03:34:48.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 977.763898ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
18022024-12-14T03:34:48.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c") failed: Property not found. retry in 736.127309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
18032024-12-14T03:34:49.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 1.258785835s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
18042024-12-14T03:34:49.580ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18052024-12-14T03:34:50.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d") failed: Property not found. retry in 938.784278ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
18062024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_e3d2c20f-c2a7-4f54-9db9-8659dcb7cb83
18072024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_b974dc5d-1c9c-40f2-82f3-2fdc6cce6481
18082024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_da486e84-c3c4-4913-896c-480797d4253c
18092024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f10ebc72-1785-47bb-8cf0-9fdb414404bf
18102024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_e8d9646f-a541-4c11-b5b2-f953427ca2f3
18112024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_a321e00a-3126-4ea4-b26d-c0e3eea69166
18122024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_f2a02677-b9b6-40cb-9b43-47c372653abf
18132024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_1e12c85d-7ae8-4529-9fe3-6e42d4d6087c
18142024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_15e0a3c9-7f83-4ab1-ba93-52a8bbd26b3e
18152024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_7274e15f-a5f6-4975-bcdd-a2ef890c0230
18162024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_dc6862c8-90dd-40bf-a461-5b36c4239936
18172024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_0212236d-21e5-41c5-97f7-16fc6c7f46c3
18182024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_57290f0a-26c5-4c0b-8349-591dffa4c9c4
18192024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_96c38cba-8876-4643-8f76-c848a3309775
18202024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9f85acd0-be93-4a8b-93d2-87d65b9f6296
18212024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_21b7c7af-9796-44cc-a548-8d8e7731e1dc
18222024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_28f528f1-3159-4fbc-9304-37b7e4a50ae8
18232024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_5f2fe413-3c4a-4994-b4a0-995c1da486b1
18242024-12-14T03:34:51.339ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_d5c9737b-fd9e-49b2-bfbe-1f06eb563a3d
18252024-12-14T03:34:51.340ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18262024-12-14T03:34:51.342ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18272024-12-14T03:34:51.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42160523 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58820 req_id = 626aff3e-b0d1-450f-adf1-efaceddfde46 response_code = 204 uri = /omicron-zones
18282024-12-14T03:34:51.361ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18292024-12-14T03:34:51.365ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18302024-12-14T03:34:51.368ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
18312024-12-14T03:34:51.403ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
18322024-12-14T03:34:51.407ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18332024-12-14T03:34:51.499ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18342024-12-14T03:34:51.651ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18352024-12-14T03:34:51.809ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18362024-12-14T03:34:52.030ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18372024-12-14T03:34:52.227ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18382024-12-14T03:34:52.443ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18392024-12-14T03:34:52.856ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18402024-12-14T03:34:53.055ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18412024-12-14T03:34:53.569ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18422024-12-14T03:34:54.040ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18432024-12-14T03:34:54.364ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18442024-12-14T03:34:54.759ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/a121ca05-bbee-41bf-b9db-9e03ff035200/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
18452024-12-14T03:34:55.570ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "00fa02ba-c8ed-4947-aea1-86e8c800fb87", "content-length": "173", "date": "Sat, 14 Dec 2024 03:34:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"a121ca05-bbee-41bf-b9db-9e03ff035200\"", request_id: "00fa02ba-c8ed-4947-aea1-86e8c800fb87" } file = sled-agent/src/rack_setup/service.rs:1078
18462024-12-14T03:34:56.842ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b5337da0-6c2f-41ce-9b5f-d860d6a59ba5", "content-length": "173", "date": "Sat, 14 Dec 2024 03:34:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"a121ca05-bbee-41bf-b9db-9e03ff035200\"", request_id: "b5337da0-6c2f-41ce-9b5f-d860d6a59ba5" } file = sled-agent/src/rack_setup/service.rs:1078
18472024-12-14T03:34:58.657ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "13aa55bd-b0ee-4043-adb5-5b89499de379", "content-length": "173", "date": "Sat, 14 Dec 2024 03:34:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "13aa55bd-b0ee-4043-adb5-5b89499de379" } file = sled-agent/src/rack_setup/service.rs:1078
18482024-12-14T03:35:00.553ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "46fa4837-d8a5-4db6-a8d3-9e6c865c6eeb" } file = sled-agent/src/rack_setup/service.rs:1078
18492024-12-14T03:35:02.127ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "00c6d885-7333-4437-ae29-670e04d474af", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "00c6d885-7333-4437-ae29-670e04d474af" } file = sled-agent/src/rack_setup/service.rs:1078
18502024-12-14T03:35:04.499ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "65d2c580-6aac-47db-a2ca-c97db997201b", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "65d2c580-6aac-47db-a2ca-c97db997201b" } file = sled-agent/src/rack_setup/service.rs:1078
18512024-12-14T03:35:06.573ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f2dc57d7-467e-483d-a644-e778adc6b204", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "f2dc57d7-467e-483d-a644-e778adc6b204" } file = sled-agent/src/rack_setup/service.rs:1078
18522024-12-14T03:35:09.300ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3d44980b-ea9e-48d9-9be8-75d43f4391c8", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "3d44980b-ea9e-48d9-9be8-75d43f4391c8" } file = sled-agent/src/rack_setup/service.rs:1078
18532024-12-14T03:35:09.329ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55658
18542024-12-14T03:35:09.329ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55658 req_id = 019b0c85-971c-46c2-96d3-d1d749fbb972 response_code = 200 uri = /baseboard
18552024-12-14T03:35:15.422ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2b83d200-4c75-4a7a-9956-199310783c8e", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "2b83d200-4c75-4a7a-9956-199310783c8e" } file = sled-agent/src/rack_setup/service.rs:1078
18562024-12-14T03:35:18.614ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e0213694-1dcd-41cf-af41-e5a2b9e1a7a8", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "e0213694-1dcd-41cf-af41-e5a2b9e1a7a8" } file = sled-agent/src/rack_setup/service.rs:1078
18572024-12-14T03:35:23.277ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a52633c1-b120-42a9-b8bf-24a590a15686", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "a52633c1-b120-42a9-b8bf-24a590a15686" } file = sled-agent/src/rack_setup/service.rs:1078
18582024-12-14T03:35:30.083ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d05d4717-2ca8-4274-aaf3-40926ea27a17", "content-length": "173", "date": "Sat, 14 Dec 2024 03:35:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"8d70e61c-94ed-41ce-b36c-cb904f92c534\"", request_id: "d05d4717-2ca8-4274-aaf3-40926ea27a17" } file = sled-agent/src/rack_setup/service.rs:1078
18592024-12-14T03:35:37.454ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
18602024-12-14T03:35:37.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55321
18612024-12-14T03:35:37.554ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18622024-12-14T03:35:37.554ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18632024-12-14T03:35:37.555ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
18642024-12-14T03:35:37.556ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
18652024-12-14T03:35:37.569ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18662024-12-14T03:35:37.569ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99
18672024-12-14T03:35:37.594ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18682024-12-14T03:35:37.594ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_128dcb8a-56c9-451c-a438-d3ea94a82725
18692024-12-14T03:35:37.614ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18702024-12-14T03:35:37.614ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9
18712024-12-14T03:35:37.634ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18722024-12-14T03:35:37.634ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4a91d090-6980-43b2-8cca-44eb6dd10741
18732024-12-14T03:35:37.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18742024-12-14T03:35:37.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_73bc07b3-a806-455e-a40b-a99deea605ef
18752024-12-14T03:35:37.675ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18762024-12-14T03:35:37.675ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb
18772024-12-14T03:35:37.693ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18782024-12-14T03:35:37.693ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb
18792024-12-14T03:35:37.712ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18802024-12-14T03:35:37.712ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2
18812024-12-14T03:35:37.732ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18822024-12-14T03:35:37.732ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb57e12e-6889-4ba5-8f94-102093287f39
18832024-12-14T03:35:37.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190970 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55321 req_id = a320303f-8d7c-4ddd-b68f-b008b5a40654 response_code = 200 uri = /inventory
18842024-12-14T03:35:39.365ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64494
18852024-12-14T03:35:39.365ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 495 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64494 req_id = c9994045-0ff1-4639-b60d-ae3dbd78fb9a response_code = 200 uri = /baseboard
18862024-12-14T03:35:41.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56338
18872024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18882024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18892024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18902024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18912024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18922024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18932024-12-14T03:35:41.166ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18942024-12-14T03:35:41.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56338 req_id = 6e91bcb7-2b01-46aa-a917-e310827e9bdd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18952024-12-14T03:35:41.168ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
18962024-12-14T03:35:41.172ZINFOSledAgent (RSS): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18972024-12-14T03:35:41.172ZINFOSledAgent (RSS): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
18982024-12-14T03:35:41.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57865
18992024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19002024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19012024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19022024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19032024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19042024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19052024-12-14T03:35:41.379ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19062024-12-14T03:35:41.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57865 req_id = dee38751-a1e9-4626-ad00-a9ffbc6c37ba response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19072024-12-14T03:35:41.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59843
19082024-12-14T03:35:41.391ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19092024-12-14T03:35:41.392ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19102024-12-14T03:35:41.392ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
19112024-12-14T03:35:41.392ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
19122024-12-14T03:35:41.405ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19132024-12-14T03:35:41.405ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99
19142024-12-14T03:35:41.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19152024-12-14T03:35:41.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_128dcb8a-56c9-451c-a438-d3ea94a82725
19162024-12-14T03:35:41.452ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19172024-12-14T03:35:41.452ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9
19182024-12-14T03:35:41.474ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19192024-12-14T03:35:41.474ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4a91d090-6980-43b2-8cca-44eb6dd10741
19202024-12-14T03:35:41.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50165
19212024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19222024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19232024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19242024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19252024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19262024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19272024-12-14T03:35:41.480ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19282024-12-14T03:35:41.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 426 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50165 req_id = b521a676-d69c-4e31-8882-fcf3ac3eb8e1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19292024-12-14T03:35:41.496ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19302024-12-14T03:35:41.496ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_73bc07b3-a806-455e-a40b-a99deea605ef
19312024-12-14T03:35:41.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19322024-12-14T03:35:41.517ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb
19332024-12-14T03:35:41.534ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19342024-12-14T03:35:41.534ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb
19352024-12-14T03:35:41.553ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19362024-12-14T03:35:41.553ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2
19372024-12-14T03:35:41.572ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19382024-12-14T03:35:41.572ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb57e12e-6889-4ba5-8f94-102093287f39
19392024-12-14T03:35:41.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190929 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59843 req_id = fc83a797-e4a7-48e9-8876-449b42e4c9fe response_code = 200 uri = /inventory
19402024-12-14T03:35:42.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52888
19412024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19422024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19432024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19442024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19452024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19462024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19472024-12-14T03:35:42.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19482024-12-14T03:35:42.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52888 req_id = c97ed4d0-0069-4254-bfae-68c9163d0fe0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19492024-12-14T03:35:45.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56354
19502024-12-14T03:35:45.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56354 req_id = 33205ab8-3a36-4138-b2f7-1fb43a90324c response_code = 200 uri = /vpc-routes
19512024-12-14T03:35:45.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
19522024-12-14T03:35:45.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 636 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56354 req_id = 6478f638-527d-4e91-b663-a9ba04250563 response_code = 204 uri = /eip-gateways
19532024-12-14T03:35:45.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56354 req_id = 1d4b3eed-749f-432c-a1f6-fbe320f84f5e response_code = 204 uri = /vpc-routes
19542024-12-14T03:35:56.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64944
19552024-12-14T03:35:56.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64944 req_id = df3eb50d-d8ab-4e42-a5c3-32f034a8bc81 response_code = 200 uri = /vpc-routes
19562024-12-14T03:35:56.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
19572024-12-14T03:35:56.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64944 req_id = 95791d4a-ffd1-420c-a457-e2172512dff5 response_code = 204 uri = /eip-gateways
19582024-12-14T03:35:56.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64944 req_id = 84de02e3-72d3-4c71-98bf-3782ba1245bf response_code = 204 uri = /vpc-routes
19592024-12-14T03:35:56.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37269
19602024-12-14T03:35:56.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 420 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37269 req_id = 33dc390e-8fbe-48a5-b9f9-5a88bc4125af response_code = 200 uri = /v2p
19612024-12-14T03:35:56.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49205
19622024-12-14T03:35:56.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19632024-12-14T03:35:57.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19642024-12-14T03:35:57.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49205 req_id = f5cfcb4c-b954-4b58-8475-51e3768eb321 response_code = 204 uri = /switch-ports
19652024-12-14T03:35:57.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49205 req_id = c9509eee-78bc-45ba-908a-26b888943813 response_code = 200 uri = /network-bootstore-config
19662024-12-14T03:35:57.124ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
19672024-12-14T03:35:57.124ZINFOSledAgent (bootstore): Writing ledger to /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19682024-12-14T03:35:57.125ZINFOSledAgent (bootstore): Writing ledger to /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
19692024-12-14T03:35:57.127ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19702024-12-14T03:35:57.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49205 req_id = 86e4801e-b335-44c9-a3bf-d4ebe3f11955 response_code = 204 uri = /network-bootstore-config
19712024-12-14T03:35:57.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47716
19722024-12-14T03:35:57.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47716 req_id = b17d4988-b29e-40a0-b57d-1998e5c87f2a response_code = 200 uri = /vpc-routes
19732024-12-14T03:35:57.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
19742024-12-14T03:35:57.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47716 req_id = 12ac3562-2a52-4342-9c16-a073fb6059e9 response_code = 204 uri = /eip-gateways
19752024-12-14T03:35:57.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47716 req_id = f9791a7e-13a0-4423-b325-4588a026bd5e response_code = 204 uri = /vpc-routes
19762024-12-14T03:35:57.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47699
19772024-12-14T03:35:57.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47699 req_id = 5f59fe9b-06e3-4455-8871-bdea0aab3d19 response_code = 200 uri = /vpc-routes
19782024-12-14T03:35:57.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35510
19792024-12-14T03:35:57.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35510 req_id = ade883a4-6d45-415f-965e-0f73fae2992b response_code = 200 uri = /v2p
19802024-12-14T03:35:57.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
19812024-12-14T03:35:57.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47699 req_id = 1a57ca87-6ef1-4858-bd13-3e8bea663f99 response_code = 204 uri = /eip-gateways
19822024-12-14T03:35:57.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47699 req_id = 029f4537-a3a2-4f8d-9d62-2d6a5b657388 response_code = 204 uri = /vpc-routes
19832024-12-14T03:35:57.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35278
19842024-12-14T03:35:57.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35278 req_id = 6e983a9d-adf4-4e3a-9a22-d83bec826979 response_code = 200 uri = /v2p
19852024-12-14T03:35:57.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52122
19862024-12-14T03:35:57.924ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19872024-12-14T03:35:57.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19882024-12-14T03:35:58.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98804 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52122 req_id = 296e6d29-6809-4a50-b053-f1b2dc17b055 response_code = 204 uri = /switch-ports
19892024-12-14T03:35:58.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37272
19902024-12-14T03:35:58.024ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19912024-12-14T03:35:58.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3607 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52122 req_id = 1934b396-0772-4587-822e-0278c692617a response_code = 200 uri = /network-bootstore-config
19922024-12-14T03:35:58.060ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19932024-12-14T03:35:58.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37272 req_id = 8d289328-2f31-4c5d-be60-9c11f78c8bad response_code = 204 uri = /switch-ports
19942024-12-14T03:35:58.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37272 req_id = 5ef89f2e-cef7-443b-960f-094c98efcdc2 response_code = 200 uri = /network-bootstore-config
19952024-12-14T03:36:09.400ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45853
19962024-12-14T03:36:09.400ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45853 req_id = 7b5e4a39-3450-4bc2-9121-648f82242163 response_code = 200 uri = /baseboard
19972024-12-14T03:36:10.607ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:40070 remote_addr = [fd00:1122:3344:101::d]:49481 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
19982024-12-14T03:36:10.633ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25361 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = b6984f79-8a50-42e3-9b65-39c6af340cff response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
19992024-12-14T03:36:26.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35974
20002024-12-14T03:36:26.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35974 req_id = f42ae434-0ff4-4282-8cd7-88da6e1dbe35 response_code = 200 uri = /v2p
20012024-12-14T03:36:26.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58223
20022024-12-14T03:36:26.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58223 req_id = 68620eb7-5122-4011-8f90-0fd1e4927def response_code = 200 uri = /vpc-routes
20032024-12-14T03:36:26.796ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20042024-12-14T03:36:26.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58223 req_id = a7806b46-ce08-4590-b10d-383392521173 response_code = 204 uri = /eip-gateways
20052024-12-14T03:36:26.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58223 req_id = 52981b89-b06d-48f5-b470-50f7f3d9f1eb response_code = 204 uri = /vpc-routes
20062024-12-14T03:36:26.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34885
20072024-12-14T03:36:26.857ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20082024-12-14T03:36:26.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20092024-12-14T03:36:26.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34885 req_id = 76ffa6f3-3307-4616-a758-33a56c941fb9 response_code = 204 uri = /switch-ports
20102024-12-14T03:36:26.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34885 req_id = 5b5034f2-fe7a-4c11-956a-6fec10ab184e response_code = 200 uri = /network-bootstore-config
20112024-12-14T03:36:27.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64504
20122024-12-14T03:36:27.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64504 req_id = bcd0f7a3-3873-4660-bcc9-7516523cb504 response_code = 200 uri = /vpc-routes
20132024-12-14T03:36:27.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20142024-12-14T03:36:27.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64504 req_id = 27498994-0770-4d97-ad1e-4b87a2a484ff response_code = 204 uri = /eip-gateways
20152024-12-14T03:36:27.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64504 req_id = 9f655f27-4306-4d68-a543-5d3e7c0ef8e3 response_code = 204 uri = /vpc-routes
20162024-12-14T03:36:27.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36719
20172024-12-14T03:36:27.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36719 req_id = c9d526d0-da7a-467b-af29-4d7a182d9a24 response_code = 200 uri = /v2p
20182024-12-14T03:36:27.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54402
20192024-12-14T03:36:27.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20202024-12-14T03:36:27.670ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20212024-12-14T03:36:27.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109942 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54402 req_id = dd30dbb0-9951-4c9e-bd70-5348a9c1847c response_code = 204 uri = /switch-ports
20222024-12-14T03:36:27.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39130
20232024-12-14T03:36:27.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65176
20242024-12-14T03:36:27.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39130 req_id = d0964b5f-9c7c-4751-8c79-7ffea8993b6c response_code = 200 uri = /vpc-routes
20252024-12-14T03:36:27.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54402 req_id = ee6128ee-5734-4911-9eb5-123661163210 response_code = 200 uri = /network-bootstore-config
20262024-12-14T03:36:27.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20272024-12-14T03:36:27.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20282024-12-14T03:36:27.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20292024-12-14T03:36:27.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39130 req_id = e823a7e8-da97-46ab-9ab6-cc56a27158b7 response_code = 204 uri = /eip-gateways
20302024-12-14T03:36:27.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39130 req_id = 313ce11e-1457-4616-80d4-9713c9b3870e response_code = 204 uri = /vpc-routes
20312024-12-14T03:36:27.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44003
20322024-12-14T03:36:27.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44003 req_id = 5af7b64c-9063-4a84-907f-002eb2e82968 response_code = 200 uri = /v2p
20332024-12-14T03:36:27.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65176 req_id = be6e8cb6-ff3e-4d3f-8fc0-c3d46ee81043 response_code = 204 uri = /switch-ports
20342024-12-14T03:36:27.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65176 req_id = 6dd9178b-cce3-49d4-b0e0-27289c77e8a7 response_code = 200 uri = /network-bootstore-config
20352024-12-14T03:36:39.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44531
20362024-12-14T03:36:39.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44531 req_id = a90aa571-fd9a-48fc-bc57-8f8e01bb858b response_code = 200 uri = /baseboard
20372024-12-14T03:36:40.614ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6598 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 7e169e90-15f8-44c2-bfe8-28260ecf783d response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
20382024-12-14T03:36:56.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61196
20392024-12-14T03:36:56.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61196 req_id = 23cc3307-3188-4288-8f22-387786c641bc response_code = 200 uri = /v2p
20402024-12-14T03:36:56.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37504
20412024-12-14T03:36:56.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37504 req_id = 05c50749-a36c-436d-8e25-359a1e586d42 response_code = 200 uri = /vpc-routes
20422024-12-14T03:36:56.757ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20432024-12-14T03:36:56.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37504 req_id = 405cf706-cc12-490b-b3f3-8c55e11835ab response_code = 204 uri = /eip-gateways
20442024-12-14T03:36:56.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37504 req_id = ba40a7dd-0b3b-409b-ac96-934780d83331 response_code = 204 uri = /vpc-routes
20452024-12-14T03:36:56.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39276
20462024-12-14T03:36:56.956ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20472024-12-14T03:36:56.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20482024-12-14T03:36:57.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39276 req_id = 75aa4acb-2a78-4e9d-b522-e7cb7ba64f49 response_code = 204 uri = /switch-ports
20492024-12-14T03:36:57.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39276 req_id = 6d05041e-4b5b-467e-b582-dbb7c8350a90 response_code = 200 uri = /network-bootstore-config
20502024-12-14T03:36:57.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47379
20512024-12-14T03:36:57.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47379 req_id = 43e1ed18-8feb-4a99-8333-6be9b1d62e37 response_code = 200 uri = /vpc-routes
20522024-12-14T03:36:57.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20532024-12-14T03:36:57.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47379 req_id = ea3e2e2d-e13a-4a86-9d80-6e768075cc47 response_code = 204 uri = /eip-gateways
20542024-12-14T03:36:57.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47377
20552024-12-14T03:36:57.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47377 req_id = 3bf70b15-be97-41ae-8439-80c6d874594f response_code = 200 uri = /v2p
20562024-12-14T03:36:57.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47379 req_id = ed4754ac-87ec-4c0a-a5b4-0a35efe96874 response_code = 204 uri = /vpc-routes
20572024-12-14T03:36:57.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47781
20582024-12-14T03:36:57.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47781 req_id = a3d61432-32fb-48cd-848f-a1e5bf2b0599 response_code = 200 uri = /vpc-routes
20592024-12-14T03:36:57.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20602024-12-14T03:36:57.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47781 req_id = 2eed683e-4e4d-4039-a77d-33002b4f6b35 response_code = 204 uri = /eip-gateways
20612024-12-14T03:36:57.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52226
20622024-12-14T03:36:57.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20632024-12-14T03:36:57.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20642024-12-14T03:36:57.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94167 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52226 req_id = e86512ba-0431-4586-b434-0ce22831e2c0 response_code = 204 uri = /switch-ports
20652024-12-14T03:36:57.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48054
20662024-12-14T03:36:57.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42527
20672024-12-14T03:36:57.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47781 req_id = fbfc07fb-5208-40bb-9aa1-2419755b0df4 response_code = 204 uri = /vpc-routes
20682024-12-14T03:36:57.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52226 req_id = ba03a003-b2f6-4f21-8834-a60913546108 response_code = 200 uri = /network-bootstore-config
20692024-12-14T03:36:57.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48054 req_id = 8d921883-07ef-4669-a296-ba8f20aed8ac response_code = 200 uri = /v2p
20702024-12-14T03:36:57.880ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20712024-12-14T03:36:57.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20722024-12-14T03:36:57.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42527 req_id = e3fe5cd2-eb75-4ec7-9a32-e2150b9ab3e8 response_code = 204 uri = /switch-ports
20732024-12-14T03:36:57.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42527 req_id = d144d4f3-cb16-4a27-9606-7ae09d8b48a8 response_code = 200 uri = /network-bootstore-config
20742024-12-14T03:37:09.469ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36347
20752024-12-14T03:37:09.469ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36347 req_id = 0c9dff1f-76b9-443a-9220-f83580ceb8e1 response_code = 200 uri = /baseboard
20762024-12-14T03:37:10.615ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7260 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = f75d7ad1-7661-4cf9-a7f4-0a61875cce48 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
20772024-12-14T03:37:26.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39833
20782024-12-14T03:37:26.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39833 req_id = c16b94ab-e837-44f7-89cb-4b74f48f7503 response_code = 200 uri = /v2p
20792024-12-14T03:37:26.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35166
20802024-12-14T03:37:26.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35166 req_id = 7b65339d-cc5c-41ff-a39b-3a7b7dabdb36 response_code = 200 uri = /vpc-routes
20812024-12-14T03:37:26.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20822024-12-14T03:37:26.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35166 req_id = 554104cd-0156-49d3-bd4c-180d08e3d359 response_code = 204 uri = /eip-gateways
20832024-12-14T03:37:26.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35166 req_id = 2ca7e380-874d-4266-916c-d2c19eafcfaf response_code = 204 uri = /vpc-routes
20842024-12-14T03:37:26.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61245
20852024-12-14T03:37:26.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20862024-12-14T03:37:26.742ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20872024-12-14T03:37:26.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61245 req_id = 3ec3bb8c-39c9-438e-9609-263bd5319862 response_code = 204 uri = /switch-ports
20882024-12-14T03:37:26.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61245 req_id = bab2c389-b081-4266-80a4-f980dea70e86 response_code = 200 uri = /network-bootstore-config
20892024-12-14T03:37:27.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40537
20902024-12-14T03:37:27.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40537 req_id = 6cc29597-1f4c-4fdc-9be7-defbfbb76f38 response_code = 200 uri = /vpc-routes
20912024-12-14T03:37:27.457ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20922024-12-14T03:37:27.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40537 req_id = 0ce44803-28f8-4b25-9311-38f4ec5c7c7b response_code = 204 uri = /eip-gateways
20932024-12-14T03:37:27.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38805
20942024-12-14T03:37:27.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38805 req_id = 1bb6b362-5f55-4b24-86a0-0504ae24bc70 response_code = 200 uri = /v2p
20952024-12-14T03:37:27.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40537 req_id = c11f8de3-c271-4461-9d91-7ac4506349b9 response_code = 204 uri = /vpc-routes
20962024-12-14T03:37:27.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55302
20972024-12-14T03:37:27.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55302 req_id = 58177e03-10b7-474a-8cb6-917f8f690f01 response_code = 200 uri = /vpc-routes
20982024-12-14T03:37:27.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
20992024-12-14T03:37:27.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55302 req_id = 344b44d7-8459-4a54-8bc0-9c3d76ba675c response_code = 204 uri = /eip-gateways
21002024-12-14T03:37:27.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36606
21012024-12-14T03:37:27.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21022024-12-14T03:37:27.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21032024-12-14T03:37:27.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36606 req_id = 15cac3ca-d63b-4bbe-bc69-0f8d93258ae7 response_code = 204 uri = /switch-ports
21042024-12-14T03:37:27.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62230
21052024-12-14T03:37:27.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55302 req_id = 1bef63de-9807-4f99-83de-915a1342544c response_code = 204 uri = /vpc-routes
21062024-12-14T03:37:27.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36606 req_id = 95b0bbfe-2009-40c7-b157-c0eb8a546add response_code = 200 uri = /network-bootstore-config
21072024-12-14T03:37:27.767ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21082024-12-14T03:37:27.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38270
21092024-12-14T03:37:27.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38270 req_id = fbb30cea-4754-413d-95d3-3326dcb1cc61 response_code = 200 uri = /v2p
21102024-12-14T03:37:27.809ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21112024-12-14T03:37:27.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62230 req_id = 13ad7512-2411-46b9-a8b5-0f26cc0f7f74 response_code = 204 uri = /switch-ports
21122024-12-14T03:37:27.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62230 req_id = a860b95c-9192-4002-9244-decc427b0b9b response_code = 200 uri = /network-bootstore-config
21132024-12-14T03:37:39.503ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45491
21142024-12-14T03:37:39.503ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45491 req_id = 6fe84b70-ccae-44cb-9265-279314c852c1 response_code = 200 uri = /baseboard
21152024-12-14T03:37:40.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5552 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 22fa91f6-c877-4de8-8038-25de0468571e response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
21162024-12-14T03:37:56.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50175
21172024-12-14T03:37:56.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50175 req_id = b5fe8b1e-a6fa-4921-95b9-67124e619ed2 response_code = 200 uri = /vpc-routes
21182024-12-14T03:37:56.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21192024-12-14T03:37:56.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50175 req_id = 5c75bc93-31c7-4a35-aa9c-baa61ffb295d response_code = 204 uri = /eip-gateways
21202024-12-14T03:37:56.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49884
21212024-12-14T03:37:56.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49884 req_id = c9e94b64-b3d3-4f0b-b799-b8cce97551cf response_code = 200 uri = /v2p
21222024-12-14T03:37:56.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50175 req_id = 8cfddb75-e361-4b01-98ea-d42256797508 response_code = 204 uri = /vpc-routes
21232024-12-14T03:37:57.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48796
21242024-12-14T03:37:57.002ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21252024-12-14T03:37:57.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21262024-12-14T03:37:57.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48796 req_id = 8292e495-58bf-4bdb-a301-9137211ff57d response_code = 204 uri = /switch-ports
21272024-12-14T03:37:57.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48796 req_id = fd44e016-f8ef-4f0d-b9af-ab37aefd2d2a response_code = 200 uri = /network-bootstore-config
21282024-12-14T03:37:57.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42561
21292024-12-14T03:37:57.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42561 req_id = 4a3237e7-d43a-42c3-81a4-ce8f46ae39e5 response_code = 200 uri = /vpc-routes
21302024-12-14T03:37:57.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21312024-12-14T03:37:57.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42561 req_id = 82f8d3fe-bfee-4378-9f41-13411b7c4603 response_code = 204 uri = /eip-gateways
21322024-12-14T03:37:57.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42561 req_id = ab2b10df-df24-443b-b6b6-dd9ed98eea55 response_code = 204 uri = /vpc-routes
21332024-12-14T03:37:57.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34289
21342024-12-14T03:37:57.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34289 req_id = 291e1ada-e451-4c84-858b-6dabead103b2 response_code = 200 uri = /v2p
21352024-12-14T03:37:57.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38793
21362024-12-14T03:37:57.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21372024-12-14T03:37:57.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21382024-12-14T03:37:57.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38793 req_id = e28914a1-d8ab-4fa2-8996-ebd8263fe679 response_code = 204 uri = /switch-ports
21392024-12-14T03:37:57.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61837
21402024-12-14T03:37:57.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61837 req_id = 2b130d1f-55eb-4fd2-b43f-9658e9e97243 response_code = 200 uri = /vpc-routes
21412024-12-14T03:37:57.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38793 req_id = 14918e5a-03a4-4800-b62f-486d5a89c569 response_code = 200 uri = /network-bootstore-config
21422024-12-14T03:37:57.845ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21432024-12-14T03:37:57.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61837 req_id = b435b7f4-32d1-4daa-8638-604d19ea652c response_code = 204 uri = /eip-gateways
21442024-12-14T03:37:57.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34773
21452024-12-14T03:37:57.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34773 req_id = ac7f8452-ec2d-49e0-af02-bf0803700573 response_code = 200 uri = /v2p
21462024-12-14T03:37:57.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61837 req_id = fdba7432-5137-4e19-999d-93eac7671334 response_code = 204 uri = /vpc-routes
21472024-12-14T03:37:57.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32890
21482024-12-14T03:37:57.926ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21492024-12-14T03:37:57.964ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21502024-12-14T03:37:58.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32890 req_id = 30a96745-8ddf-4591-958c-c7ab75e7ff2d response_code = 204 uri = /switch-ports
21512024-12-14T03:37:58.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32890 req_id = 6a32ca89-f1cd-43d4-9fd6-c69b58bb230b response_code = 200 uri = /network-bootstore-config
21522024-12-14T03:38:09.538ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41746
21532024-12-14T03:38:09.538ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41746 req_id = 02e0e75f-7448-4742-8bd5-a8302a28844a response_code = 200 uri = /baseboard
21542024-12-14T03:38:10.616ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7491 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 15da225a-da3b-4126-8932-ecd30b0c26ff response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
21552024-12-14T03:38:26.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60253
21562024-12-14T03:38:26.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60253 req_id = 01c01090-c9f4-47c5-b7b7-30ab59ab3c09 response_code = 200 uri = /vpc-routes
21572024-12-14T03:38:26.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21582024-12-14T03:38:26.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60253 req_id = a04caf55-006c-4efb-b9dc-e0495c718dc3 response_code = 204 uri = /eip-gateways
21592024-12-14T03:38:26.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60253 req_id = 073dac89-dfb4-465a-8458-ca8188033a2a response_code = 204 uri = /vpc-routes
21602024-12-14T03:38:26.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46210
21612024-12-14T03:38:26.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46210 req_id = 0ff63d66-e900-44bd-b88c-0e5030c01de2 response_code = 200 uri = /v2p
21622024-12-14T03:38:26.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59804
21632024-12-14T03:38:26.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21642024-12-14T03:38:26.839ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21652024-12-14T03:38:26.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59804 req_id = 0ce9bca0-2f2b-4aef-8c7c-0184fb89bf56 response_code = 204 uri = /switch-ports
21662024-12-14T03:38:26.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59804 req_id = f1826b19-9299-4478-85f2-96ebcbea621b response_code = 200 uri = /network-bootstore-config
21672024-12-14T03:38:27.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37687
21682024-12-14T03:38:27.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37687 req_id = 0a6d1418-c02c-4022-b27f-675ee4d400f9 response_code = 200 uri = /v2p
21692024-12-14T03:38:27.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40802
21702024-12-14T03:38:27.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40802 req_id = 5a39b1f1-d84a-4529-956c-1ae50e5b4a98 response_code = 200 uri = /vpc-routes
21712024-12-14T03:38:27.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21722024-12-14T03:38:27.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40802 req_id = d8fc45cd-a285-4e5e-a738-bd7727dfa7ff response_code = 204 uri = /eip-gateways
21732024-12-14T03:38:27.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40802 req_id = cb7a8a6d-f3be-420d-a32c-bfeef700a600 response_code = 204 uri = /vpc-routes
21742024-12-14T03:38:27.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59363
21752024-12-14T03:38:27.578ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21762024-12-14T03:38:27.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21772024-12-14T03:38:27.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59363 req_id = b400e898-434a-4cdd-bbd1-cf4c5a0131a6 response_code = 204 uri = /switch-ports
21782024-12-14T03:38:27.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59363 req_id = 8cc59556-6f50-4524-a57b-edd50d8e7d84 response_code = 200 uri = /network-bootstore-config
21792024-12-14T03:38:27.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50313
21802024-12-14T03:38:27.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50313 req_id = 1d0cfe2e-3d97-42bd-a93a-0de7bec70b0b response_code = 200 uri = /vpc-routes
21812024-12-14T03:38:27.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21822024-12-14T03:38:27.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50313 req_id = ab8a69cf-ef5f-4c63-a0db-a1e8393b6a54 response_code = 204 uri = /eip-gateways
21832024-12-14T03:38:27.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45375
21842024-12-14T03:38:27.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45375 req_id = b5049998-0ba6-45dc-8af8-88af857672ae response_code = 200 uri = /v2p
21852024-12-14T03:38:27.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50313 req_id = e8fb063e-a818-48b3-a0b8-6f91d636e11d response_code = 204 uri = /vpc-routes
21862024-12-14T03:38:27.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50709
21872024-12-14T03:38:27.944ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21882024-12-14T03:38:27.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21892024-12-14T03:38:28.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50709 req_id = 9b490934-37c8-40b8-81f3-e54aad027386 response_code = 204 uri = /switch-ports
21902024-12-14T03:38:28.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50709 req_id = e1e89611-1614-483d-afa3-277d9b1f7266 response_code = 200 uri = /network-bootstore-config
21912024-12-14T03:38:39.573ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63099
21922024-12-14T03:38:39.573ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63099 req_id = 2ffb504a-03b7-499c-9261-eebde9906d5a response_code = 200 uri = /baseboard
21932024-12-14T03:38:40.615ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6888 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 92971a71-4955-4fa0-880b-f7570e938a23 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
21942024-12-14T03:38:56.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44546
21952024-12-14T03:38:56.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44546 req_id = 7a7b6ea6-6a43-4501-80c3-f525dbf95705 response_code = 200 uri = /vpc-routes
21962024-12-14T03:38:56.761ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
21972024-12-14T03:38:56.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44546 req_id = d563b26e-93a7-4da1-8704-cae727ea1e05 response_code = 204 uri = /eip-gateways
21982024-12-14T03:38:56.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44546 req_id = 2fa4fe66-ecea-4fe6-a16c-42e7e4d0b6d6 response_code = 204 uri = /vpc-routes
21992024-12-14T03:38:56.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60254
22002024-12-14T03:38:56.854ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22012024-12-14T03:38:56.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22022024-12-14T03:38:56.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60254 req_id = 4e2b1c89-3251-481f-bdf3-1f4303c4eeae response_code = 204 uri = /switch-ports
22032024-12-14T03:38:56.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48726
22042024-12-14T03:38:56.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48726 req_id = c54a363d-4dc5-4d8e-9a27-0dc2a09771a8 response_code = 200 uri = /v2p
22052024-12-14T03:38:56.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60254 req_id = df228799-9a8d-4cc5-9255-a26286c3a011 response_code = 200 uri = /network-bootstore-config
22062024-12-14T03:38:57.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58869
22072024-12-14T03:38:57.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58869 req_id = 96d98f06-0a22-4b93-85cd-82a5a61a3add response_code = 200 uri = /vpc-routes
22082024-12-14T03:38:57.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
22092024-12-14T03:38:57.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58869 req_id = 171b464b-2335-4773-ae54-905123c4c504 response_code = 204 uri = /eip-gateways
22102024-12-14T03:38:57.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58869 req_id = dceffa6e-d133-40b5-b5ea-091bfa648116 response_code = 204 uri = /vpc-routes
22112024-12-14T03:38:57.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40809
22122024-12-14T03:38:57.612ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22132024-12-14T03:38:57.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22142024-12-14T03:38:57.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40809 req_id = 7cc1a160-549f-459d-8e13-894ac735f358 response_code = 204 uri = /switch-ports
22152024-12-14T03:38:57.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51783
22162024-12-14T03:38:57.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51783 req_id = 72b74b2b-5897-45d1-b591-5e57293c123a response_code = 200 uri = /v2p
22172024-12-14T03:38:57.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40809 req_id = 50b69ccf-491b-4676-bb51-b56c8c2a436a response_code = 200 uri = /network-bootstore-config
22182024-12-14T03:38:57.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61319
22192024-12-14T03:38:57.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61319 req_id = b34aeaac-859f-4707-a6c7-737f5d3f74ae response_code = 200 uri = /vpc-routes
22202024-12-14T03:38:57.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
22212024-12-14T03:38:57.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61319 req_id = bf4c5f21-db62-41a4-a211-605b76813e8f response_code = 204 uri = /eip-gateways
22222024-12-14T03:38:57.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61319 req_id = ca0d6cf9-d649-46ab-a9fc-1ab03433a69c response_code = 204 uri = /vpc-routes
22232024-12-14T03:38:57.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57265
22242024-12-14T03:38:57.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57265 req_id = 51c465da-b7ee-4af4-a831-18e465effb30 response_code = 200 uri = /v2p
22252024-12-14T03:38:57.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36542
22262024-12-14T03:38:57.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22272024-12-14T03:38:57.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22282024-12-14T03:38:57.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36542 req_id = f9bc4c93-5231-4dbe-b7cf-b759044aad52 response_code = 204 uri = /switch-ports
22292024-12-14T03:38:57.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36542 req_id = 05276810-1715-40e6-a8f2-298673a7a67e response_code = 200 uri = /network-bootstore-config
22302024-12-14T03:39:09.605ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37765
22312024-12-14T03:39:09.605ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37765 req_id = 345d35e8-526b-4a98-974b-09e34788c12e response_code = 200 uri = /baseboard
22322024-12-14T03:39:10.615ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5370 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 04231a31-42fc-4cf6-a885-6b07897c0d02 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
22332024-12-14T03:39:26.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62572
22342024-12-14T03:39:26.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62572 req_id = b1f4dc29-3d2e-4fff-9d0f-b9b92677254d response_code = 200 uri = /vpc-routes
22352024-12-14T03:39:26.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
22362024-12-14T03:39:26.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62572 req_id = 4929d549-4112-4b51-92ee-f6b188ac7177 response_code = 204 uri = /eip-gateways
22372024-12-14T03:39:26.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62572 req_id = 7deb1cc1-63a6-42a0-8af0-f800f2ae61c2 response_code = 204 uri = /vpc-routes
22382024-12-14T03:39:26.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52045
22392024-12-14T03:39:26.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52045 req_id = e94b67c8-7c95-472b-9c0a-a3789a6625e4 response_code = 200 uri = /v2p
22402024-12-14T03:39:26.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48665
22412024-12-14T03:39:26.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22422024-12-14T03:39:26.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22432024-12-14T03:39:26.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48665 req_id = 15fd975b-da8f-4f80-86bd-ed23d1adfd33 response_code = 204 uri = /switch-ports
22442024-12-14T03:39:26.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48665 req_id = 6df2e19b-d1ae-44e9-8ca2-fa05d07ea06a response_code = 200 uri = /network-bootstore-config
22452024-12-14T03:39:27.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36249
22462024-12-14T03:39:27.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36249 req_id = 615823ec-4c9f-451b-a025-84448f08b5f0 response_code = 200 uri = /vpc-routes
22472024-12-14T03:39:27.430ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
22482024-12-14T03:39:27.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36249 req_id = 2a6f4c78-128a-4955-8b5d-3c2dd7518fc3 response_code = 204 uri = /eip-gateways
22492024-12-14T03:39:27.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36249 req_id = 78c66c5e-7ac1-4a02-8b53-0c3e992bfdbf response_code = 204 uri = /vpc-routes
22502024-12-14T03:39:27.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46859
22512024-12-14T03:39:27.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22522024-12-14T03:39:27.527ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22532024-12-14T03:39:27.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46859 req_id = 589dede3-7009-4fa6-aba8-7f28d7b8d134 response_code = 204 uri = /switch-ports
22542024-12-14T03:39:27.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39250
22552024-12-14T03:39:27.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46859 req_id = ac570ef9-2bf3-4697-a419-32289a09024d response_code = 200 uri = /network-bootstore-config
22562024-12-14T03:39:27.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39250 req_id = ffe48e84-80f2-4c1c-90b4-4b9579bd102d response_code = 200 uri = /v2p
22572024-12-14T03:39:27.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49471
22582024-12-14T03:39:27.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49471 req_id = ace6eda3-66d9-4747-b092-80f9e1cb0042 response_code = 200 uri = /vpc-routes
22592024-12-14T03:39:27.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65410
22602024-12-14T03:39:27.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65410 req_id = 3522be52-6936-40e0-a0a2-f0f21e449530 response_code = 200 uri = /v2p
22612024-12-14T03:39:27.701ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
22622024-12-14T03:39:27.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49471 req_id = d42ad88d-3e35-4f2c-aa6d-30764fbaf7db response_code = 204 uri = /eip-gateways
22632024-12-14T03:39:27.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49471 req_id = b217af8f-9117-4d54-a259-ee27d2141a5f response_code = 204 uri = /vpc-routes
22642024-12-14T03:39:27.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61385
22652024-12-14T03:39:27.756ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22662024-12-14T03:39:27.795ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22672024-12-14T03:39:27.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61385 req_id = 9f904aec-bb8c-4de3-99de-f4cf3b731cd5 response_code = 204 uri = /switch-ports
22682024-12-14T03:39:27.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61385 req_id = 0ee6b334-3f7f-4a6e-b0d4-38753ae4f074 response_code = 200 uri = /network-bootstore-config
22692024-12-14T03:39:35.082ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22702024-12-14T03:39:35.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22712024-12-14T03:39:35.110ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1981, tv_nsec: 428899313 } time_to_next_cleanup = 599.99999785s
22722024-12-14T03:39:39.638ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45095
22732024-12-14T03:39:39.638ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45095 req_id = 70d8f1e3-24d0-4808-89ad-26da5c318b25 response_code = 200 uri = /baseboard
22742024-12-14T03:39:40.616ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6373 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 081a5001-1efa-4436-b281-bd1617b9507d response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
22752024-12-14T03:39:49.585ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22762024-12-14T03:39:56.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55540
22772024-12-14T03:39:56.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55540 req_id = b236e712-fdb6-497c-b40c-0248c0bbc1bb response_code = 200 uri = /vpc-routes
22782024-12-14T03:39:56.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
22792024-12-14T03:39:56.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55540 req_id = 829948cd-7b2c-4412-a51d-5e5e444cffc1 response_code = 204 uri = /eip-gateways
22802024-12-14T03:39:56.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48958
22812024-12-14T03:39:56.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48958 req_id = 8c5c5896-fe53-44a5-9e16-0b10242195c6 response_code = 200 uri = /v2p
22822024-12-14T03:39:56.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55540 req_id = 76fcc018-d9ad-46d6-a4fd-a6306f5fc44d response_code = 204 uri = /vpc-routes
22832024-12-14T03:39:57.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61382
22842024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22852024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22862024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22872024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22882024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22892024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22902024-12-14T03:39:57.163ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22912024-12-14T03:39:57.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61382 req_id = 16ffb23c-e88e-412b-97bb-0a9d1b88f931 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22922024-12-14T03:39:57.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38575
22932024-12-14T03:39:57.195ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22942024-12-14T03:39:57.251ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22952024-12-14T03:39:57.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145417 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38575 req_id = 2f48a52b-f6f1-4894-9f00-d22c9c2133d6 response_code = 204 uri = /switch-ports
22962024-12-14T03:39:57.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38575 req_id = cc2d5824-29f2-442d-a575-06c425239b62 response_code = 200 uri = /network-bootstore-config
22972024-12-14T03:39:57.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46646
22982024-12-14T03:39:57.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46646 req_id = 65391875-66d4-4abe-9374-5a24849b6bb3 response_code = 200 uri = /vpc-routes
22992024-12-14T03:39:57.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23002024-12-14T03:39:57.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46646 req_id = 0bbe5c04-5d26-4eec-ac03-b87b026b2717 response_code = 204 uri = /eip-gateways
23012024-12-14T03:39:57.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46646 req_id = fe8df64c-611e-46d7-9e0a-8f8a869c4edc response_code = 204 uri = /vpc-routes
23022024-12-14T03:39:57.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48101
23032024-12-14T03:39:57.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48101 req_id = 4f2537f8-c723-49a4-8e0f-0b78b69210ee response_code = 200 uri = /v2p
23042024-12-14T03:39:57.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41641
23052024-12-14T03:39:57.686ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23062024-12-14T03:39:57.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23072024-12-14T03:39:57.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41641 req_id = ff19a110-9b13-464b-aa84-ba4798b58eb3 response_code = 204 uri = /switch-ports
23082024-12-14T03:39:57.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53710
23092024-12-14T03:39:57.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53710 req_id = 69643b1e-a8ab-4ea1-9ec7-a134e2f9a158 response_code = 200 uri = /vpc-routes
23102024-12-14T03:39:57.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41641 req_id = 2e6d9836-3708-420e-a215-def1ed7db1d6 response_code = 200 uri = /network-bootstore-config
23112024-12-14T03:39:57.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23122024-12-14T03:39:57.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53710 req_id = 43570129-4887-4510-9752-a84f717140b4 response_code = 204 uri = /eip-gateways
23132024-12-14T03:39:57.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53710 req_id = 59b03fa9-5264-46d3-b719-455bfffdaff6 response_code = 204 uri = /vpc-routes
23142024-12-14T03:39:57.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42560
23152024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23162024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23172024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23182024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23192024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23202024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23212024-12-14T03:39:57.904ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23222024-12-14T03:39:57.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42560 req_id = 87bfc326-9320-43f9-87eb-91b0ceaec5a9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23232024-12-14T03:39:57.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34960
23242024-12-14T03:39:57.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34960 req_id = 621f2616-81a6-4eed-87d1-a2d87453d89a response_code = 200 uri = /v2p
23252024-12-14T03:39:57.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50717
23262024-12-14T03:39:57.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23272024-12-14T03:39:58.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23282024-12-14T03:39:58.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50717 req_id = 39d3eda7-b4ff-49c4-98b1-a8e3a41bef7a response_code = 204 uri = /switch-ports
23292024-12-14T03:39:58.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63178
23302024-12-14T03:39:58.069ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23312024-12-14T03:39:58.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50717 req_id = d7a57c74-fa3a-41e2-9fd3-1c459fc733a9 response_code = 200 uri = /network-bootstore-config
23322024-12-14T03:39:58.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23332024-12-14T03:39:58.069ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23342024-12-14T03:39:58.070ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23352024-12-14T03:39:58.070ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23362024-12-14T03:39:58.070ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23372024-12-14T03:39:58.070ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23382024-12-14T03:39:58.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63178 req_id = fc41e1fc-4a33-417f-9b0c-db4687c4dd30 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23392024-12-14T03:40:09.672ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40485
23402024-12-14T03:40:09.672ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40485 req_id = 4ec3a0bf-f2da-4edb-a9ff-969c83f8e050 response_code = 200 uri = /baseboard
23412024-12-14T03:40:10.615ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5497 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 41b3ee33-043c-4c7c-8b7f-c7091782f4fe response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
23422024-12-14T03:40:26.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46365
23432024-12-14T03:40:26.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46365 req_id = 6caa17a6-30a1-4264-a41c-85caf0a9d7bc response_code = 200 uri = /vpc-routes
23442024-12-14T03:40:26.514ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23452024-12-14T03:40:26.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46365 req_id = f1e96801-2d24-4d45-ad03-aed574ac4aaa response_code = 204 uri = /eip-gateways
23462024-12-14T03:40:26.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46365 req_id = fa91380e-f0fc-48de-934c-b7ba693e3cc1 response_code = 204 uri = /vpc-routes
23472024-12-14T03:40:26.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41260
23482024-12-14T03:40:26.612ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23492024-12-14T03:40:26.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23502024-12-14T03:40:26.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41260 req_id = 550cfdd4-030a-416b-9f5d-6a8cfb8b6d74 response_code = 204 uri = /switch-ports
23512024-12-14T03:40:26.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43737
23522024-12-14T03:40:26.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41260 req_id = 4d51930e-08c7-4837-8a6f-3d1c1619d1da response_code = 200 uri = /network-bootstore-config
23532024-12-14T03:40:26.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43737 req_id = eeb652d9-b8fe-4001-bb9b-e88cb4383eb4 response_code = 200 uri = /v2p
23542024-12-14T03:40:27.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47868
23552024-12-14T03:40:27.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47868 req_id = 03f913f9-5692-4f4b-8b9e-315c6e19dcd9 response_code = 200 uri = /vpc-routes
23562024-12-14T03:40:27.374ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23572024-12-14T03:40:27.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47868 req_id = 5702584b-087f-4d20-bd5b-b54fa844848b response_code = 204 uri = /eip-gateways
23582024-12-14T03:40:27.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47868 req_id = 7278fb85-808f-4b9a-850e-4882756272bc response_code = 204 uri = /vpc-routes
23592024-12-14T03:40:27.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59159
23602024-12-14T03:40:27.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59159 req_id = 06682cd9-15f0-437f-879e-9ccba5bfa0ae response_code = 200 uri = /v2p
23612024-12-14T03:40:27.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41212
23622024-12-14T03:40:27.481ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23632024-12-14T03:40:27.531ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23642024-12-14T03:40:27.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41212 req_id = fc09f90b-a421-4783-8b0a-fd866b867d19 response_code = 204 uri = /switch-ports
23652024-12-14T03:40:27.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41212 req_id = 9c1bd2ee-e701-4154-a4d4-d24ba058668e response_code = 200 uri = /network-bootstore-config
23662024-12-14T03:40:27.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35312
23672024-12-14T03:40:27.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35312 req_id = d12767db-62cd-495f-9320-9fd17a0d81bc response_code = 200 uri = /vpc-routes
23682024-12-14T03:40:27.843ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23692024-12-14T03:40:27.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35312 req_id = 71066080-8182-4b90-933b-6d1b5a2ea795 response_code = 204 uri = /eip-gateways
23702024-12-14T03:40:27.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35312 req_id = 86554716-a82b-45a6-9c8d-50222518a31f response_code = 204 uri = /vpc-routes
23712024-12-14T03:40:27.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39543
23722024-12-14T03:40:27.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23732024-12-14T03:40:27.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23742024-12-14T03:40:27.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39543 req_id = 6938bbcf-4cbf-49a3-89ca-7d3cd8f1449b response_code = 204 uri = /switch-ports
23752024-12-14T03:40:27.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39543 req_id = 486a1500-e406-49f8-ba2c-eead37fa5a99 response_code = 200 uri = /network-bootstore-config
23762024-12-14T03:40:27.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37609
23772024-12-14T03:40:27.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37609 req_id = ac0d3e41-bc59-4402-a68b-ad790e5dc540 response_code = 200 uri = /v2p
23782024-12-14T03:40:39.710ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64391
23792024-12-14T03:40:39.710ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64391 req_id = 1a7472eb-d6c1-4864-8f10-e57f5179344e response_code = 200 uri = /baseboard
23802024-12-14T03:40:40.615ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5418 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 50e6cf7e-f6fc-404b-83f6-48f94ddfd944 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
23812024-12-14T03:40:56.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35863
23822024-12-14T03:40:56.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35863 req_id = 101abaf4-1b47-4588-83e5-58c5ce0447fc response_code = 200 uri = /vpc-routes
23832024-12-14T03:40:56.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23842024-12-14T03:40:56.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35863 req_id = 28823f93-1826-4f65-8cbb-790761a4c03f response_code = 204 uri = /eip-gateways
23852024-12-14T03:40:56.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51463
23862024-12-14T03:40:56.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51463 req_id = 017220bd-7cf0-4444-875a-85db5be7ad51 response_code = 200 uri = /v2p
23872024-12-14T03:40:56.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35863 req_id = b2b34ed2-4706-4261-8aea-efbb7a85598e response_code = 204 uri = /vpc-routes
23882024-12-14T03:40:56.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61501
23892024-12-14T03:40:56.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23902024-12-14T03:40:56.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23912024-12-14T03:40:57.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61501 req_id = 814d1dad-9a1c-4fbe-a60b-5d3430e8b897 response_code = 204 uri = /switch-ports
23922024-12-14T03:40:57.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61501 req_id = ae0f9c5c-ab96-4753-b2f2-510c22edf81b response_code = 200 uri = /network-bootstore-config
23932024-12-14T03:40:57.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50579
23942024-12-14T03:40:57.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50579 req_id = 2fea6f6b-3dc7-47b6-bd43-263b22b8d687 response_code = 200 uri = /vpc-routes
23952024-12-14T03:40:57.472ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
23962024-12-14T03:40:57.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50579 req_id = dc00b536-c5e0-4e9e-9c77-2f6c132fe52a response_code = 204 uri = /eip-gateways
23972024-12-14T03:40:57.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50579 req_id = 7435e8e7-00f9-4049-a819-201dbccb075c response_code = 204 uri = /vpc-routes
23982024-12-14T03:40:57.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59027
23992024-12-14T03:40:57.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59027 req_id = fcadf35d-81d0-4b14-8d90-d04a1dae1440 response_code = 200 uri = /v2p
24002024-12-14T03:40:57.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50963
24012024-12-14T03:40:57.706ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24022024-12-14T03:40:57.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24032024-12-14T03:40:57.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50963 req_id = ee49ae0e-4f50-4d3c-beb5-a89d7b11b544 response_code = 204 uri = /switch-ports
24042024-12-14T03:40:57.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50963 req_id = fd89cd81-0d85-4a4d-90c4-87f29b685985 response_code = 200 uri = /network-bootstore-config
24052024-12-14T03:40:57.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53712
24062024-12-14T03:40:57.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53712 req_id = 990fada7-0e5a-4aad-bc5b-e811f23f3e66 response_code = 200 uri = /vpc-routes
24072024-12-14T03:40:57.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24082024-12-14T03:40:57.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53712 req_id = b1a7806e-79da-46a2-9c6e-dee599a58d53 response_code = 204 uri = /eip-gateways
24092024-12-14T03:40:57.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53712 req_id = d53fcc95-3765-4df9-9e03-c16758e6c184 response_code = 204 uri = /vpc-routes
24102024-12-14T03:40:58.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40005
24112024-12-14T03:40:58.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40005 req_id = 8185bcc8-ab39-484a-b06f-cf08925a40ff response_code = 200 uri = /v2p
24122024-12-14T03:40:58.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61284
24132024-12-14T03:40:58.123ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24142024-12-14T03:40:58.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24152024-12-14T03:40:58.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89159 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61284 req_id = c7b3c564-76ce-4b57-8149-845da48ebcc6 response_code = 204 uri = /switch-ports
24162024-12-14T03:40:58.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61284 req_id = 89e746f9-0e18-4e7e-a23a-b0f5e83ecf5e response_code = 200 uri = /network-bootstore-config
24172024-12-14T03:41:09.743ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44902
24182024-12-14T03:41:09.743ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44902 req_id = cc9aaa1d-3e5f-44a0-a1a7-c29f82bfefa1 response_code = 200 uri = /baseboard
24192024-12-14T03:41:10.617ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7490 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 6d8d0387-b51a-45ef-9f0a-8c94d4b1770a response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
24202024-12-14T03:41:26.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54892
24212024-12-14T03:41:26.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54892 req_id = e3a18bfd-444a-43c9-9fb0-1b7998667612 response_code = 200 uri = /vpc-routes
24222024-12-14T03:41:26.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24232024-12-14T03:41:26.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54892 req_id = c6e18e15-65d4-4fe0-87c0-d32418a213c5 response_code = 204 uri = /eip-gateways
24242024-12-14T03:41:26.579ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38222
24252024-12-14T03:41:26.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38222 req_id = 70e44127-2071-4f74-b920-7829fbeb9f4f response_code = 200 uri = /v2p
24262024-12-14T03:41:26.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54892 req_id = 906ea63c-d540-4487-953e-0e80128888b1 response_code = 204 uri = /vpc-routes
24272024-12-14T03:41:26.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51596
24282024-12-14T03:41:26.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24292024-12-14T03:41:26.672ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24302024-12-14T03:41:26.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 57633c37-f3d7-4935-8f16-938e2a848141 response_code = 204 uri = /switch-ports
24312024-12-14T03:41:26.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51596 req_id = 7ed1fd32-e1f4-485d-82d9-8b236274699d response_code = 200 uri = /network-bootstore-config
24322024-12-14T03:41:27.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45142
24332024-12-14T03:41:27.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45142 req_id = 5570c061-6485-4a01-bf40-bd18c2fcb811 response_code = 200 uri = /vpc-routes
24342024-12-14T03:41:27.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55804
24352024-12-14T03:41:27.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55804 req_id = d99c5266-ea47-4c3d-b4af-ad67e5fc70fe response_code = 200 uri = /v2p
24362024-12-14T03:41:27.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24372024-12-14T03:41:27.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45142 req_id = 3040acd4-3fc6-431d-8a3f-5b1132e90264 response_code = 204 uri = /eip-gateways
24382024-12-14T03:41:27.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45142 req_id = 30dceb32-012a-46e1-b5c9-13b7be18a85b response_code = 204 uri = /vpc-routes
24392024-12-14T03:41:27.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49498
24402024-12-14T03:41:27.513ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24412024-12-14T03:41:27.555ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24422024-12-14T03:41:27.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101966 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49498 req_id = 1c336082-3bb5-47e6-8ff3-bf32af7f2395 response_code = 204 uri = /switch-ports
24432024-12-14T03:41:27.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49498 req_id = 55708250-3025-4920-9488-80368d6e20e0 response_code = 200 uri = /network-bootstore-config
24442024-12-14T03:41:27.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37846
24452024-12-14T03:41:27.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37846 req_id = 247c6389-3243-46c5-8d73-82c9e2157555 response_code = 200 uri = /vpc-routes
24462024-12-14T03:41:27.693ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24472024-12-14T03:41:27.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37846 req_id = 549b552f-8145-47c7-bb15-7a782488fa29 response_code = 204 uri = /eip-gateways
24482024-12-14T03:41:27.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63567
24492024-12-14T03:41:27.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63567 req_id = 93b03cc4-b66c-4ec5-a033-d707221e40ca response_code = 200 uri = /v2p
24502024-12-14T03:41:27.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37846 req_id = 9715ccdb-5ccf-4d0b-a2a8-11c38fd808e4 response_code = 204 uri = /vpc-routes
24512024-12-14T03:41:27.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46742
24522024-12-14T03:41:27.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24532024-12-14T03:41:27.846ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24542024-12-14T03:41:27.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85663 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46742 req_id = 80477f51-045e-4950-84e1-49bd2cbe963c response_code = 204 uri = /switch-ports
24552024-12-14T03:41:27.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46742 req_id = 16eedc90-5ccb-47bb-86f0-f221868e8ba2 response_code = 200 uri = /network-bootstore-config
24562024-12-14T03:41:39.776ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40453
24572024-12-14T03:41:39.776ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40453 req_id = a0b63b78-4ea5-4bf7-9b58-83accb62676a response_code = 200 uri = /baseboard
24582024-12-14T03:41:40.616ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5699 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 139316b4-41aa-4c76-a708-91b1d270af5f response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
24592024-12-14T03:41:56.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38214
24602024-12-14T03:41:56.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38214 req_id = c5d93d15-4db8-4d3b-8915-cf17474b0d62 response_code = 200 uri = /vpc-routes
24612024-12-14T03:41:56.611ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24622024-12-14T03:41:56.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38214 req_id = 39f42270-288d-4d3a-baef-6b8e891ddd7b response_code = 204 uri = /eip-gateways
24632024-12-14T03:41:56.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38214 req_id = dd763daf-8548-4c7e-86df-676dfece31d8 response_code = 204 uri = /vpc-routes
24642024-12-14T03:41:56.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48680
24652024-12-14T03:41:56.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48680 req_id = 27dbc00d-a0c6-4a05-bba6-bff673565be2 response_code = 200 uri = /v2p
24662024-12-14T03:41:56.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35248
24672024-12-14T03:41:56.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24682024-12-14T03:41:56.918ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24692024-12-14T03:41:56.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35248 req_id = c8b30e10-d056-4dc7-81ef-f2951855459e response_code = 204 uri = /switch-ports
24702024-12-14T03:41:56.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35248 req_id = d62119db-8dfb-41ee-87aa-6a0767105e43 response_code = 200 uri = /network-bootstore-config
24712024-12-14T03:41:57.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52598
24722024-12-14T03:41:57.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52598 req_id = b69ea0cc-f09a-4e39-a300-e2e99c0351e2 response_code = 200 uri = /vpc-routes
24732024-12-14T03:41:57.570ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24742024-12-14T03:41:57.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52598 req_id = 582940cb-8279-43ac-b14b-0eddb3bbe9ec response_code = 204 uri = /eip-gateways
24752024-12-14T03:41:57.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52598 req_id = 6de898a8-f45e-4277-b897-8cec0beb9f38 response_code = 204 uri = /vpc-routes
24762024-12-14T03:41:57.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41427
24772024-12-14T03:41:57.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24782024-12-14T03:41:57.752ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24792024-12-14T03:41:57.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41427 req_id = a6ecc631-364b-4e43-a0df-1274115f36ae response_code = 204 uri = /switch-ports
24802024-12-14T03:41:57.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63919
24812024-12-14T03:41:57.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47346
24822024-12-14T03:41:57.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41427 req_id = 09a10d72-7be4-40bb-8d5e-e3fce7f97d4a response_code = 200 uri = /network-bootstore-config
24832024-12-14T03:41:57.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63919 req_id = d23835da-cad0-4924-901b-bfd61efa68e3 response_code = 200 uri = /vpc-routes
24842024-12-14T03:41:57.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47346 req_id = 88b8ffe5-b218-4aae-aac7-affe75e65425 response_code = 200 uri = /v2p
24852024-12-14T03:41:57.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
24862024-12-14T03:41:57.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63919 req_id = c29cc78c-6027-4809-80b6-ae5f1af8d096 response_code = 204 uri = /eip-gateways
24872024-12-14T03:41:57.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62975
24882024-12-14T03:41:57.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62975 req_id = 4469110f-a49b-488e-8abf-30b21384157e response_code = 200 uri = /v2p
24892024-12-14T03:41:57.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63919 req_id = 9b39fdcb-0eca-44f8-9309-3d74d1956a04 response_code = 204 uri = /vpc-routes
24902024-12-14T03:41:58.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54645
24912024-12-14T03:41:58.035ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24922024-12-14T03:41:58.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24932024-12-14T03:41:58.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90817 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54645 req_id = ff4ba238-8d06-4fe6-8cce-3b5f4a4f8ffb response_code = 204 uri = /switch-ports
24942024-12-14T03:41:58.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54645 req_id = 96569337-0111-4791-b91f-2df8dff321b2 response_code = 200 uri = /network-bootstore-config
24952024-12-14T03:42:09.809ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55121
24962024-12-14T03:42:09.809ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55121 req_id = 9a429226-be03-4be3-a74d-0f3d8ac2670b response_code = 200 uri = /baseboard
24972024-12-14T03:42:10.615ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5278 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 59f9d068-b262-4209-83c2-185f142f3762 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
24982024-12-14T03:42:26.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40656
24992024-12-14T03:42:26.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40656 req_id = 2eff4aad-7129-4405-be93-9c67062ca0ae response_code = 200 uri = /vpc-routes
25002024-12-14T03:42:26.595ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25012024-12-14T03:42:26.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40656 req_id = 6ad49a3b-d9f2-4c95-a159-fabf10e8b0a1 response_code = 204 uri = /eip-gateways
25022024-12-14T03:42:26.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39517
25032024-12-14T03:42:26.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39517 req_id = 8cc821f5-761d-4b50-a7fe-95b2c30676f0 response_code = 200 uri = /v2p
25042024-12-14T03:42:26.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40656 req_id = 81c47faa-3169-4389-8120-e8400698e580 response_code = 204 uri = /vpc-routes
25052024-12-14T03:42:26.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61534
25062024-12-14T03:42:26.622ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25072024-12-14T03:42:26.663ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25082024-12-14T03:42:26.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61534 req_id = 48c09966-575a-47ab-8b7c-6fc73d3f6a14 response_code = 204 uri = /switch-ports
25092024-12-14T03:42:26.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61534 req_id = 2bc82cd3-0695-47ef-ab23-80228a277dc8 response_code = 200 uri = /network-bootstore-config
25102024-12-14T03:42:27.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41900
25112024-12-14T03:42:27.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41900 req_id = 2e484933-d1ca-4169-862d-87bb79bed540 response_code = 200 uri = /vpc-routes
25122024-12-14T03:42:27.420ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25132024-12-14T03:42:27.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41900 req_id = c8bdefb0-d715-4ca5-91ba-40c0ec082d9e response_code = 204 uri = /eip-gateways
25142024-12-14T03:42:27.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41900 req_id = 5b7cff93-798d-4c01-aecf-6b2339137f49 response_code = 204 uri = /vpc-routes
25152024-12-14T03:42:27.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33561
25162024-12-14T03:42:27.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33561 req_id = fc828538-10b5-4912-9d31-0535cb3fe432 response_code = 200 uri = /v2p
25172024-12-14T03:42:27.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46821
25182024-12-14T03:42:27.468ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25192024-12-14T03:42:27.513ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25202024-12-14T03:42:27.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46821 req_id = 4fbd8ef8-cc0b-46ce-9e95-00d5db2bb876 response_code = 204 uri = /switch-ports
25212024-12-14T03:42:27.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46821 req_id = 572d7690-aed8-40c3-bdee-1b2e49154fb6 response_code = 200 uri = /network-bootstore-config
25222024-12-14T03:42:27.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60304
25232024-12-14T03:42:27.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60304 req_id = f0fea111-645f-4589-82f3-f0273e7d110f response_code = 200 uri = /v2p
25242024-12-14T03:42:27.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46554
25252024-12-14T03:42:27.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46554 req_id = 652b107b-15aa-4bf9-941c-88e6a3258d4d response_code = 200 uri = /vpc-routes
25262024-12-14T03:42:27.674ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25272024-12-14T03:42:27.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46554 req_id = cc18ade8-1feb-4c1a-bed4-95a902a00f67 response_code = 204 uri = /eip-gateways
25282024-12-14T03:42:27.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46554 req_id = 85141177-1ff7-4acb-8233-aa0713fafcee response_code = 204 uri = /vpc-routes
25292024-12-14T03:42:27.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42819
25302024-12-14T03:42:27.708ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25312024-12-14T03:42:27.744ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25322024-12-14T03:42:27.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42819 req_id = daf13da7-ec5d-4ce5-a890-34304a0ec104 response_code = 204 uri = /switch-ports
25332024-12-14T03:42:27.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42819 req_id = e2eaa8d4-c9d5-4ac8-9bf3-b7bbaab9fe06 response_code = 200 uri = /network-bootstore-config
25342024-12-14T03:42:39.842ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61932
25352024-12-14T03:42:39.842ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61932 req_id = aad222a5-49e6-488f-a575-26c456198aef response_code = 200 uri = /baseboard
25362024-12-14T03:42:40.617ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6554 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = beff33fb-4396-4c35-ac7c-8851c6334cc3 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
25372024-12-14T03:42:56.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64661
25382024-12-14T03:42:56.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64661 req_id = aef75546-a88c-4c15-8eb9-43deb20ed83a response_code = 200 uri = /vpc-routes
25392024-12-14T03:42:56.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25402024-12-14T03:42:56.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64661 req_id = 9f5c38f9-91af-4b9b-9efc-8c86319aeac8 response_code = 204 uri = /eip-gateways
25412024-12-14T03:42:56.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57364
25422024-12-14T03:42:56.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57364 req_id = 240af74b-03ac-43ac-99e1-b777d2f26b57 response_code = 200 uri = /v2p
25432024-12-14T03:42:56.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64661 req_id = 797ea0c0-8e4f-4a0f-b0ef-7854a8a1d94d response_code = 204 uri = /vpc-routes
25442024-12-14T03:42:56.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34930
25452024-12-14T03:42:56.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25462024-12-14T03:42:56.920ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25472024-12-14T03:42:56.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92574 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34930 req_id = f3bbb4aa-65f2-4c18-afd9-1b70be799bf2 response_code = 204 uri = /switch-ports
25482024-12-14T03:42:56.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34930 req_id = b6774b32-ef94-4a6d-8b8d-62899969ef6c response_code = 200 uri = /network-bootstore-config
25492024-12-14T03:42:57.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48169
25502024-12-14T03:42:57.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48169 req_id = 131a5e61-35f9-479a-bdb3-ef21b072fb75 response_code = 200 uri = /vpc-routes
25512024-12-14T03:42:57.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25522024-12-14T03:42:57.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48169 req_id = 667e68cb-2cdb-4b29-a57f-a4e5ecec1be5 response_code = 204 uri = /eip-gateways
25532024-12-14T03:42:57.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33077
25542024-12-14T03:42:57.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33077 req_id = 59a7758d-a596-4cd6-b3e8-21a5a5624059 response_code = 200 uri = /vpc-routes
25552024-12-14T03:42:57.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25562024-12-14T03:42:57.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33077 req_id = 2e182083-500c-4ff0-b919-05e4279199e1 response_code = 204 uri = /eip-gateways
25572024-12-14T03:42:57.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33077 req_id = 257fca02-51a8-4880-92e3-812979aa1451 response_code = 204 uri = /vpc-routes
25582024-12-14T03:42:57.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36440
25592024-12-14T03:42:57.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36440 req_id = 053c1a3a-66e2-4c38-a44d-e069486b6e4a response_code = 200 uri = /v2p
25602024-12-14T03:42:57.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48169 req_id = 988acea1-fa70-4a8b-be99-1ad5a50afaa5 response_code = 204 uri = /vpc-routes
25612024-12-14T03:42:57.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61700
25622024-12-14T03:42:57.799ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25632024-12-14T03:42:57.841ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25642024-12-14T03:42:57.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61700 req_id = cbc12579-8c22-4114-8e36-4492800158f3 response_code = 204 uri = /switch-ports
25652024-12-14T03:42:57.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61700 req_id = 0fc87d47-c5b0-4653-bfbb-2c403861ad00 response_code = 200 uri = /network-bootstore-config
25662024-12-14T03:42:58.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47581
25672024-12-14T03:42:58.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47581 req_id = cad64b6c-123e-4377-97e9-164b06abe637 response_code = 200 uri = /v2p
25682024-12-14T03:42:58.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60077
25692024-12-14T03:42:58.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25702024-12-14T03:42:58.144ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25712024-12-14T03:42:58.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60077 req_id = 8e1494d7-d211-438c-a210-62fdff47bf0d response_code = 204 uri = /switch-ports
25722024-12-14T03:42:58.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60077 req_id = 2e0915ba-a3dc-4601-ad7b-c33ed65bbb47 response_code = 200 uri = /network-bootstore-config
25732024-12-14T03:43:09.875ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39207
25742024-12-14T03:43:09.875ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39207 req_id = 33166ce5-e511-4821-9833-a78297bb5334 response_code = 200 uri = /baseboard
25752024-12-14T03:43:10.616ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6079 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = 7c18d6a6-973b-463d-bd70-923055cb58ad response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
25762024-12-14T03:43:26.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45556
25772024-12-14T03:43:26.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45556 req_id = 22457eec-1e57-4a21-b4fb-73667575857b response_code = 200 uri = /v2p
25782024-12-14T03:43:26.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59876
25792024-12-14T03:43:26.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59876 req_id = 7400098e-72b2-493f-bdc1-fbec466d482f response_code = 200 uri = /vpc-routes
25802024-12-14T03:43:26.725ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25812024-12-14T03:43:26.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59876 req_id = 9ef7438e-6d6f-45b0-a523-9d08b44607b7 response_code = 204 uri = /eip-gateways
25822024-12-14T03:43:26.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59876 req_id = 6fb1ad7b-9837-45db-b8f1-343d7a36d2b2 response_code = 204 uri = /vpc-routes
25832024-12-14T03:43:26.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64941
25842024-12-14T03:43:26.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25852024-12-14T03:43:26.778ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25862024-12-14T03:43:26.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64941 req_id = 39403f7d-5c6b-4699-8188-0ece25007f19 response_code = 204 uri = /switch-ports
25872024-12-14T03:43:26.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64941 req_id = 25a3ea8c-bceb-4f1b-86fb-6f75e626193a response_code = 200 uri = /network-bootstore-config
25882024-12-14T03:43:27.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58726
25892024-12-14T03:43:27.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58726 req_id = 58b472a1-7e5d-46aa-9978-c371eb60f2fc response_code = 200 uri = /vpc-routes
25902024-12-14T03:43:27.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
25912024-12-14T03:43:27.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58726 req_id = 8702e01f-eb20-4c5a-acc7-14a55bc11257 response_code = 204 uri = /eip-gateways
25922024-12-14T03:43:27.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58313
25932024-12-14T03:43:27.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58313 req_id = 29a29874-6d27-40af-b192-3329f4f78507 response_code = 200 uri = /v2p
25942024-12-14T03:43:27.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58726 req_id = 84cf9f21-1e18-44f3-aba8-0d1bd1a08370 response_code = 204 uri = /vpc-routes
25952024-12-14T03:43:27.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41745
25962024-12-14T03:43:27.571ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25972024-12-14T03:43:27.612ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25982024-12-14T03:43:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99657 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41745 req_id = e1770f47-a88f-427e-ae23-0740e4017dbb response_code = 204 uri = /switch-ports
25992024-12-14T03:43:27.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57484
26002024-12-14T03:43:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57484 req_id = b26f2d30-3236-47fc-9065-5900e2080650 response_code = 200 uri = /vpc-routes
26012024-12-14T03:43:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41745 req_id = 0a18d803-53e8-417f-b38f-90ac4ebf94bf response_code = 200 uri = /network-bootstore-config
26022024-12-14T03:43:27.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55603
26032024-12-14T03:43:27.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55603 req_id = a18a58d1-caae-4993-b592-bf6acaaba51c response_code = 200 uri = /v2p
26042024-12-14T03:43:27.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46173
26052024-12-14T03:43:27.725ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26062024-12-14T03:43:27.767ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26072024-12-14T03:43:27.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100346 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46173 req_id = 9a724a40-368d-4b85-b98a-b904f67d8186 response_code = 204 uri = /switch-ports
26082024-12-14T03:43:27.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26092024-12-14T03:43:27.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57484 req_id = a624cb75-ec77-4ba6-9fb6-74cf012e2da7 response_code = 204 uri = /eip-gateways
26102024-12-14T03:43:27.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46173 req_id = 8ce715cc-ef9d-4dd2-b38c-54fc783d91e2 response_code = 200 uri = /network-bootstore-config
26112024-12-14T03:43:27.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57484 req_id = 39d877cc-c6ba-4094-a8fb-91e795992b18 response_code = 204 uri = /vpc-routes
26122024-12-14T03:43:39.908ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54334
26132024-12-14T03:43:39.908ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54334 req_id = 2c04ecb7-5d58-4824-aa84-ddbcc76ec4a2 response_code = 200 uri = /baseboard
26142024-12-14T03:43:40.617ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6383 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = e1d9971f-d325-492d-bd74-333c06248d55 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
26152024-12-14T03:43:56.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40774
26162024-12-14T03:43:56.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40774 req_id = b01bc31f-f3fd-4097-98d5-20cb954b225b response_code = 200 uri = /vpc-routes
26172024-12-14T03:43:56.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26182024-12-14T03:43:56.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40774 req_id = de95852b-c3f0-4f82-b490-7ef20d5a415d response_code = 204 uri = /eip-gateways
26192024-12-14T03:43:56.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40774 req_id = 40f35951-21f6-460a-a15e-a27970e60939 response_code = 204 uri = /vpc-routes
26202024-12-14T03:43:56.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50209
26212024-12-14T03:43:56.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50209 req_id = df7b7da2-a218-4e2c-aa35-7a4f655e984c response_code = 200 uri = /v2p
26222024-12-14T03:43:56.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50991
26232024-12-14T03:43:56.855ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26242024-12-14T03:43:56.890ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26252024-12-14T03:43:56.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87453 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50991 req_id = 4f718cd0-b18b-44a4-902d-71fa3a24d9e2 response_code = 204 uri = /switch-ports
26262024-12-14T03:43:56.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50991 req_id = 51def6c0-f9ff-46fd-94b0-e8f1eb01d132 response_code = 200 uri = /network-bootstore-config
26272024-12-14T03:43:57.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47541
26282024-12-14T03:43:57.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47541 req_id = ad0aca67-0e1e-4d50-aefc-319e27541e2c response_code = 200 uri = /vpc-routes
26292024-12-14T03:43:57.568ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26302024-12-14T03:43:57.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47541 req_id = 386704ca-a032-4a25-964f-70d303d29e29 response_code = 204 uri = /eip-gateways
26312024-12-14T03:43:57.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47541 req_id = 49e5c361-f5df-4ba8-a9ed-2c6c1026c614 response_code = 204 uri = /vpc-routes
26322024-12-14T03:43:57.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36774
26332024-12-14T03:43:57.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36774 req_id = 375790d3-1358-4461-a730-43d49ef292c4 response_code = 200 uri = /vpc-routes
26342024-12-14T03:43:57.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53736
26352024-12-14T03:43:57.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53736 req_id = 944facbb-ce79-4fd2-bc42-9f2ea7c602d9 response_code = 200 uri = /v2p
26362024-12-14T03:43:57.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26372024-12-14T03:43:57.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36774 req_id = 1d87953a-8556-4fd0-a281-54cc577d9f74 response_code = 204 uri = /eip-gateways
26382024-12-14T03:43:57.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36774 req_id = 6bfbddb2-256e-40f2-9686-77321c258daf response_code = 204 uri = /vpc-routes
26392024-12-14T03:43:57.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37721
26402024-12-14T03:43:57.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37721 req_id = d3cea3c1-4135-4d33-8165-a5bd1ee2dc11 response_code = 200 uri = /v2p
26412024-12-14T03:43:57.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47524
26422024-12-14T03:43:57.910ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26432024-12-14T03:43:57.949ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26442024-12-14T03:43:58.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47524 req_id = e276254d-d2cf-408e-a708-988ea3df4f25 response_code = 204 uri = /switch-ports
26452024-12-14T03:43:58.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58104
26462024-12-14T03:43:58.010ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26472024-12-14T03:43:58.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47524 req_id = 87629467-e2e8-4ae1-bb95-8ad77b5abdab response_code = 200 uri = /network-bootstore-config
26482024-12-14T03:43:58.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26492024-12-14T03:43:58.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58104 req_id = a9f31977-fae6-46c5-b249-214ee4e52f11 response_code = 204 uri = /switch-ports
26502024-12-14T03:43:58.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58104 req_id = b54e0397-e566-4f8f-a67b-be51f0c63284 response_code = 200 uri = /network-bootstore-config
26512024-12-14T03:44:09.941ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47867
26522024-12-14T03:44:09.941ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47867 req_id = 93ab8970-bb1b-4d21-8311-970e64f12c17 response_code = 200 uri = /baseboard
26532024-12-14T03:44:10.618ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6874 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = ada726bd-2fde-48ae-a666-f77d1e558b41 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
26542024-12-14T03:44:26.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52093
26552024-12-14T03:44:26.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52093 req_id = d99c47a7-2954-40e8-b63b-d652b845cf51 response_code = 200 uri = /vpc-routes
26562024-12-14T03:44:26.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26572024-12-14T03:44:26.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52093 req_id = 637207c0-6e1d-4c5d-a260-22cb16f27cc9 response_code = 204 uri = /eip-gateways
26582024-12-14T03:44:26.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54559
26592024-12-14T03:44:26.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54559 req_id = 9605a833-0f5c-4993-8351-208515712677 response_code = 200 uri = /v2p
26602024-12-14T03:44:26.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52093 req_id = acc6a9eb-8a20-4c8b-8e1b-9d6637b943b5 response_code = 204 uri = /vpc-routes
26612024-12-14T03:44:26.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33777
26622024-12-14T03:44:26.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26632024-12-14T03:44:26.738ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26642024-12-14T03:44:26.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33777 req_id = dbfab23b-a09c-4b34-bc1c-9ca450b2ba7a response_code = 204 uri = /switch-ports
26652024-12-14T03:44:26.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33777 req_id = e4bbb072-bc79-4429-9c5d-db421c963085 response_code = 200 uri = /network-bootstore-config
26662024-12-14T03:44:27.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55143
26672024-12-14T03:44:27.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55143 req_id = 842053d6-06d2-4663-adfa-bf07e986df65 response_code = 200 uri = /vpc-routes
26682024-12-14T03:44:27.365ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26692024-12-14T03:44:27.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55143 req_id = 37045287-ab14-4741-a669-f45c76443d00 response_code = 204 uri = /eip-gateways
26702024-12-14T03:44:27.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50589
26712024-12-14T03:44:27.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50589 req_id = c61ae457-8ec3-4833-9707-bee1ad3d2d78 response_code = 200 uri = /v2p
26722024-12-14T03:44:27.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55143 req_id = 1f7da001-ffe2-4223-a5d1-0d8bf75459f1 response_code = 204 uri = /vpc-routes
26732024-12-14T03:44:27.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50338
26742024-12-14T03:44:27.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26752024-12-14T03:44:27.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26762024-12-14T03:44:27.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50338 req_id = 82883cea-0c24-4003-b9b4-d4d0ffecfcc0 response_code = 204 uri = /switch-ports
26772024-12-14T03:44:27.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45176
26782024-12-14T03:44:27.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34062
26792024-12-14T03:44:27.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45176 req_id = e7dd73d8-39f5-4e45-8959-fd70110dc37a response_code = 200 uri = /vpc-routes
26802024-12-14T03:44:27.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34062 req_id = 8238bbcf-1b7e-42ce-b612-6f77a2a8b20e response_code = 200 uri = /v2p
26812024-12-14T03:44:27.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50338 req_id = 2cf0d2d6-4bf1-4d4e-b79d-d321862e4656 response_code = 200 uri = /network-bootstore-config
26822024-12-14T03:44:27.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26832024-12-14T03:44:27.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45176 req_id = 0420a531-1054-462d-9d37-57c8d62f6f91 response_code = 204 uri = /eip-gateways
26842024-12-14T03:44:27.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45176 req_id = 3fed03b1-9561-4eef-9049-95bc579bc475 response_code = 204 uri = /vpc-routes
26852024-12-14T03:44:27.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34393
26862024-12-14T03:44:27.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26872024-12-14T03:44:27.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26882024-12-14T03:44:27.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94061 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34393 req_id = d8f09480-1d8e-4115-9634-1eb9686e6182 response_code = 204 uri = /switch-ports
26892024-12-14T03:44:27.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34393 req_id = c059f914-1085-4114-873f-6773178927c9 response_code = 200 uri = /network-bootstore-config
26902024-12-14T03:44:39.973ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42283
26912024-12-14T03:44:39.973ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42283 req_id = 0089ebcb-c22b-43f5-ad87-28c940ec1968 response_code = 200 uri = /baseboard
26922024-12-14T03:44:40.617ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5451 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = a813b463-dc1a-45a5-b509-6272ad89e2fa response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
26932024-12-14T03:44:49.588ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
26942024-12-14T03:44:56.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33378
26952024-12-14T03:44:56.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33378 req_id = ef278a25-c1af-4e51-ada6-bf98f9c194e4 response_code = 200 uri = /vpc-routes
26962024-12-14T03:44:56.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
26972024-12-14T03:44:56.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33378 req_id = bdc14206-8ad5-48c5-85e7-0af9cffaf304 response_code = 204 uri = /eip-gateways
26982024-12-14T03:44:56.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36416
26992024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27002024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27012024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27022024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27032024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27042024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27052024-12-14T03:44:56.865ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27062024-12-14T03:44:56.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36416 req_id = 65d4e448-1a89-49d3-8522-7ce13c92a6f9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27072024-12-14T03:44:56.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39998
27082024-12-14T03:44:56.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39998 req_id = 99bef245-840a-4fbb-af7a-3884bac00d1e response_code = 200 uri = /v2p
27092024-12-14T03:44:56.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33378 req_id = bab4a1eb-b215-49f2-9ed5-e7c0f16c359b response_code = 204 uri = /vpc-routes
27102024-12-14T03:44:56.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35579
27112024-12-14T03:44:56.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27122024-12-14T03:44:57.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27132024-12-14T03:44:57.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94145 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35579 req_id = 99cc4a60-52ee-4b7d-a752-9c4387fb8906 response_code = 204 uri = /switch-ports
27142024-12-14T03:44:57.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46905
27152024-12-14T03:44:57.064ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27162024-12-14T03:44:57.064ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27172024-12-14T03:44:57.064ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
27182024-12-14T03:44:57.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35579 req_id = e4475996-18f4-4be6-944c-435133907efe response_code = 200 uri = /network-bootstore-config
27192024-12-14T03:44:57.064ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
27202024-12-14T03:44:57.076ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27212024-12-14T03:44:57.076ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99
27222024-12-14T03:44:57.098ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27232024-12-14T03:44:57.098ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_128dcb8a-56c9-451c-a438-d3ea94a82725
27242024-12-14T03:44:57.117ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27252024-12-14T03:44:57.117ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9
27262024-12-14T03:44:57.137ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27272024-12-14T03:44:57.137ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4a91d090-6980-43b2-8cca-44eb6dd10741
27282024-12-14T03:44:57.157ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27292024-12-14T03:44:57.157ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_73bc07b3-a806-455e-a40b-a99deea605ef
27302024-12-14T03:44:57.176ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27312024-12-14T03:44:57.176ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb
27322024-12-14T03:44:57.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27332024-12-14T03:44:57.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb
27342024-12-14T03:44:57.232ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27352024-12-14T03:44:57.232ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2
27362024-12-14T03:44:57.272ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27372024-12-14T03:44:57.272ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb57e12e-6889-4ba5-8f94-102093287f39
27382024-12-14T03:44:57.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46905 req_id = 1f50e47b-1ec9-4a19-a352-3821c465235b response_code = 200 uri = /inventory
27392024-12-14T03:44:57.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36010
27402024-12-14T03:44:57.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36010 req_id = 44961a47-d130-47e0-8b14-c7f18da1a507 response_code = 200 uri = /v2p
27412024-12-14T03:44:57.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62448
27422024-12-14T03:44:57.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62448 req_id = 3b256a0a-5545-4422-a6eb-816ca81031b5 response_code = 200 uri = /vpc-routes
27432024-12-14T03:44:57.711ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
27442024-12-14T03:44:57.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62448 req_id = 78d0293b-8507-413c-b5f4-838843424a70 response_code = 204 uri = /eip-gateways
27452024-12-14T03:44:57.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62448 req_id = 823946c5-a328-4064-970e-35a765cecbf3 response_code = 204 uri = /vpc-routes
27462024-12-14T03:44:57.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45729
27472024-12-14T03:44:57.726ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27482024-12-14T03:44:57.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27492024-12-14T03:44:57.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45729 req_id = 9b98badf-17d4-4d51-beb1-cfc1a45b9dae response_code = 204 uri = /switch-ports
27502024-12-14T03:44:57.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64497
27512024-12-14T03:44:57.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33693
27522024-12-14T03:44:57.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33693 req_id = e2b12f2c-c934-4f08-a192-ff6bb0d5b951 response_code = 200 uri = /vpc-routes
27532024-12-14T03:44:57.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45729 req_id = 10c3978f-9863-459a-b107-ce6f3fa3a433 response_code = 200 uri = /network-bootstore-config
27542024-12-14T03:44:57.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64497 req_id = eef0be29-b34e-44bc-a1cb-e53450eb1283 response_code = 200 uri = /v2p
27552024-12-14T03:44:57.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63953
27562024-12-14T03:44:57.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27572024-12-14T03:44:57.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27582024-12-14T03:44:57.832ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
27592024-12-14T03:44:57.832ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
27602024-12-14T03:44:57.846ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27612024-12-14T03:44:57.846ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99
27622024-12-14T03:44:57.868ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
27632024-12-14T03:44:57.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33693 req_id = fbdda5a7-41e4-4ed5-b1c2-b6e773275d2f response_code = 204 uri = /eip-gateways
27642024-12-14T03:44:57.875ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27652024-12-14T03:44:57.875ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_128dcb8a-56c9-451c-a438-d3ea94a82725
27662024-12-14T03:44:57.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 951 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33693 req_id = 46367820-70b2-4d30-8e4e-25482ce60586 response_code = 204 uri = /vpc-routes
27672024-12-14T03:44:57.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39524
27682024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27692024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27702024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27712024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27722024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27732024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27742024-12-14T03:44:57.896ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27752024-12-14T03:44:57.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39524 req_id = bdff2c98-b8e7-4632-949f-d840de9e522b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27762024-12-14T03:44:57.902ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27772024-12-14T03:44:57.902ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9
27782024-12-14T03:44:57.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27792024-12-14T03:44:57.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4a91d090-6980-43b2-8cca-44eb6dd10741
27802024-12-14T03:44:57.949ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27812024-12-14T03:44:57.949ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_73bc07b3-a806-455e-a40b-a99deea605ef
27822024-12-14T03:44:57.971ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27832024-12-14T03:44:57.971ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb
27842024-12-14T03:44:57.991ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27852024-12-14T03:44:57.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb
27862024-12-14T03:44:58.013ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27872024-12-14T03:44:58.013ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2
27882024-12-14T03:44:58.035ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27892024-12-14T03:44:58.035ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb57e12e-6889-4ba5-8f94-102093287f39
27902024-12-14T03:44:58.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39747
27912024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0951ac68-a8db-47fb-ad0e-675cae6d693a, kind: Service { id: 28f528f1-3159-4fbc-9304-37b7e4a50ae8 }, name: Name("external-dns-28f528f1-3159-4fbc-9304-37b7e4a50ae8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 181])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cb55e4cb-e945-41d1-ba05-5e6f98df2e24, kind: Service { id: 7274e15f-a5f6-4975-bcdd-a2ef890c0230 }, name: Name("external-dns-7274e15f-a5f6-4975-bcdd-a2ef890c0230"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 158])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f1fe649-79cb-49da-9215-8ff632ac6466, kind: Service { id: e8d9646f-a541-4c11-b5b2-f953427ca2f3 }, name: Name("nexus-e8d9646f-a541-4c11-b5b2-f953427ca2f3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 226])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 513aa8b2-d165-4db3-997f-2262204f1075, kind: Service { id: dc6862c8-90dd-40bf-a461-5b36c4239936 }, name: Name("nexus-dc6862c8-90dd-40bf-a461-5b36c4239936"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 203])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 669bb0eb-969e-4430-94e4-187a825d1f3d, kind: Service { id: 5f2fe413-3c4a-4994-b4a0-995c1da486b1 }, name: Name("nexus-5f2fe413-3c4a-4994-b4a0-995c1da486b1"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 224])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27922024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27932024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27942024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27952024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27962024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27972024-12-14T03:44:58.044ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27982024-12-14T03:44:58.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39747 req_id = 11c29792-5618-4e52-97ed-81084aa9a871 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27992024-12-14T03:44:58.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213721 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63953 req_id = 62eddb22-bac2-48e4-95cc-e96756ac7585 response_code = 200 uri = /inventory
28002024-12-14T03:44:58.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33312
28012024-12-14T03:44:58.060ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28022024-12-14T03:44:58.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28032024-12-14T03:44:58.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94067 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33312 req_id = 0ec35b0e-a682-4d42-8d63-905153372876 response_code = 204 uri = /switch-ports
28042024-12-14T03:44:58.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45833
28052024-12-14T03:44:58.155ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28062024-12-14T03:44:58.155ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28072024-12-14T03:44:58.155ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/config/omicron-zones.json file = common/src/ledger.rs:177
28082024-12-14T03:44:58.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33312 req_id = 449a083e-f197-49d4-bafc-5f032f4f9de5 response_code = 200 uri = /network-bootstore-config
28092024-12-14T03:44:58.155ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/config/omicron-zones.json file = common/src/ledger.rs:177
28102024-12-14T03:44:58.169ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0943bac0-9587-46a8-9356-3f72a7cd0f99 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28112024-12-14T03:44:58.169ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0943bac0-9587-46a8-9356-3f72a7cd0f99
28122024-12-14T03:44:58.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 128dcb8a-56c9-451c-a438-d3ea94a82725 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28132024-12-14T03:44:58.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_128dcb8a-56c9-451c-a438-d3ea94a82725
28142024-12-14T03:44:58.221ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7abbec18-6cce-4b1e-9880-d5caa99cf0a9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28152024-12-14T03:44:58.221ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7abbec18-6cce-4b1e-9880-d5caa99cf0a9
28162024-12-14T03:44:58.244ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4a91d090-6980-43b2-8cca-44eb6dd10741 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28172024-12-14T03:44:58.244ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4a91d090-6980-43b2-8cca-44eb6dd10741
28182024-12-14T03:44:58.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 73bc07b3-a806-455e-a40b-a99deea605ef (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28192024-12-14T03:44:58.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_73bc07b3-a806-455e-a40b-a99deea605ef
28202024-12-14T03:44:58.289ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28212024-12-14T03:44:58.289ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb
28222024-12-14T03:44:58.311ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e59f3d16-25c0-46d9-becf-30583dc64eeb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28232024-12-14T03:44:58.311ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e59f3d16-25c0-46d9-becf-30583dc64eeb
28242024-12-14T03:44:58.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a74803d1-a742-40d3-90f4-c7bf854f2fa2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28252024-12-14T03:44:58.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a74803d1-a742-40d3-90f4-c7bf854f2fa2
28262024-12-14T03:44:58.356ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb57e12e-6889-4ba5-8f94-102093287f39 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28272024-12-14T03:44:58.356ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_fb57e12e-6889-4ba5-8f94-102093287f39
28282024-12-14T03:44:58.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45833 req_id = ce31e37b-2e24-436b-b49d-f40736a4c8a4 response_code = 200 uri = /inventory
28292024-12-14T03:45:10.006ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60262
28302024-12-14T03:45:10.006ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60262 req_id = 18b10711-8362-4011-86d2-0c680f1e70e5 response_code = 200 uri = /baseboard
28312024-12-14T03:45:10.618ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5566 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = e6c0d84c-8656-413b-b46c-f281936d0e93 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
28322024-12-14T03:45:26.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53286
28332024-12-14T03:45:26.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53286 req_id = e6abc746-e7ac-4571-a144-b5b0d9d3c65d response_code = 200 uri = /vpc-routes
28342024-12-14T03:45:26.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
28352024-12-14T03:45:26.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53286 req_id = d5558841-4de6-404e-b406-a3d6e0c96c8a response_code = 204 uri = /eip-gateways
28362024-12-14T03:45:26.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56068
28372024-12-14T03:45:26.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56068 req_id = 5b73b1c0-fdba-4f84-bfbb-58050653186e response_code = 200 uri = /v2p
28382024-12-14T03:45:26.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53286 req_id = 86a48fbb-18f8-4c9e-8580-90cd6de2ff67 response_code = 204 uri = /vpc-routes
28392024-12-14T03:45:26.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53634
28402024-12-14T03:45:26.717ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28412024-12-14T03:45:26.751ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28422024-12-14T03:45:26.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53634 req_id = dcab3ae9-4812-496b-817f-39290c53ac69 response_code = 204 uri = /switch-ports
28432024-12-14T03:45:26.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53634 req_id = a5f175d5-6f03-4bda-a873-1a9d9e7e165b response_code = 200 uri = /network-bootstore-config
28442024-12-14T03:45:27.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43472
28452024-12-14T03:45:27.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43472 req_id = 4160cbe9-fc37-4093-9b24-f6630dea7a7d response_code = 200 uri = /vpc-routes
28462024-12-14T03:45:27.478ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
28472024-12-14T03:45:27.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43472 req_id = 4ac533a7-bff0-48f8-ac1b-b533852df52b response_code = 204 uri = /eip-gateways
28482024-12-14T03:45:27.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43472 req_id = 10e42e27-9055-4b81-8479-4168bda5f175 response_code = 204 uri = /vpc-routes
28492024-12-14T03:45:27.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34528
28502024-12-14T03:45:27.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34528 req_id = 9cf7bad7-0886-4f71-b77d-b6169531c1de response_code = 200 uri = /v2p
28512024-12-14T03:45:27.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34573
28522024-12-14T03:45:27.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28532024-12-14T03:45:27.687ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28542024-12-14T03:45:27.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34573 req_id = 43fa21d6-e028-4dc2-82c3-45a001ce23e5 response_code = 204 uri = /switch-ports
28552024-12-14T03:45:27.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51853
28562024-12-14T03:45:27.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44554
28572024-12-14T03:45:27.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34573 req_id = e5ea5fc4-214d-460b-a53e-76f406b6c080 response_code = 200 uri = /network-bootstore-config
28582024-12-14T03:45:27.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51853 req_id = dd8009b4-b0a0-47b0-bfb6-3b6388cea340 response_code = 200 uri = /vpc-routes
28592024-12-14T03:45:27.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44554 req_id = 1df20fb6-ed40-4e91-9af5-8b66983bafc7 response_code = 200 uri = /v2p
28602024-12-14T03:45:27.757ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
28612024-12-14T03:45:27.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51853 req_id = 1c3a6868-4413-492b-8ae9-fbb9b716c0e4 response_code = 204 uri = /eip-gateways
28622024-12-14T03:45:27.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51853 req_id = e3048a2c-9340-4c69-8a3a-95a08863b23f response_code = 204 uri = /vpc-routes
28632024-12-14T03:45:27.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48898
28642024-12-14T03:45:27.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28652024-12-14T03:45:27.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28662024-12-14T03:45:27.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48898 req_id = 7ff021fd-82e5-43bd-a665-1069101655d6 response_code = 204 uri = /switch-ports
28672024-12-14T03:45:27.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48898 req_id = 4a1160cc-6d7e-4ff0-b6fd-5b7f98206652 response_code = 200 uri = /network-bootstore-config
28682024-12-14T03:45:40.039ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63320
28692024-12-14T03:45:40.039ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63320 req_id = 0b16d6e7-a306-44a7-a598-d8e1d2e081b3 response_code = 200 uri = /baseboard
28702024-12-14T03:45:40.620ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7214 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = edf55595-6264-4cc4-b2c5-d8efbd803335 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
28712024-12-14T03:45:56.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64449
28722024-12-14T03:45:56.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64449 req_id = 7cebaf28-8a51-4590-97f4-0695944629c1 response_code = 200 uri = /vpc-routes
28732024-12-14T03:45:56.612ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
28742024-12-14T03:45:56.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64449 req_id = b53ba55f-1922-454b-a339-eda15098d869 response_code = 204 uri = /eip-gateways
28752024-12-14T03:45:56.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64449 req_id = 39c00b53-6cb6-4cae-ab5f-8300b6bf8d7b response_code = 204 uri = /vpc-routes
28762024-12-14T03:45:56.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54675
28772024-12-14T03:45:56.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54675 req_id = 700f9788-d4ba-4a52-ac9c-994ddd5d08f6 response_code = 200 uri = /v2p
28782024-12-14T03:45:56.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59021
28792024-12-14T03:45:56.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28802024-12-14T03:45:57.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28812024-12-14T03:45:57.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59021 req_id = 968e2b3f-b4cf-43a2-8eed-3a38f0218066 response_code = 204 uri = /switch-ports
28822024-12-14T03:45:57.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59021 req_id = 1b67d820-a886-464f-bdd6-552b79720e7b response_code = 200 uri = /network-bootstore-config
28832024-12-14T03:45:57.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64260
28842024-12-14T03:45:57.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64260 req_id = 4ea3716c-05ee-4fd9-ae99-9777ceaa4ffb response_code = 200 uri = /vpc-routes
28852024-12-14T03:45:57.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57860
28862024-12-14T03:45:57.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57860 req_id = 60c554a6-6e4b-466c-955f-f3f2fd6ff08b response_code = 200 uri = /v2p
28872024-12-14T03:45:57.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
28882024-12-14T03:45:57.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64260 req_id = 35a073d1-92fa-42da-a485-e095596a0a58 response_code = 204 uri = /eip-gateways
28892024-12-14T03:45:57.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64260 req_id = d179d06f-83c1-4f4c-8c50-5f2e0164ceee response_code = 204 uri = /vpc-routes
28902024-12-14T03:45:57.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41503
28912024-12-14T03:45:57.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41503 req_id = 57e75f34-3cf3-480f-b67d-2b9474f393fa response_code = 200 uri = /vpc-routes
28922024-12-14T03:45:57.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
28932024-12-14T03:45:57.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41503 req_id = 72a546c7-c3c7-47e4-ae54-151835217c5a response_code = 204 uri = /eip-gateways
28942024-12-14T03:45:57.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41503 req_id = bf42d249-8437-4290-8438-c009345c23ea response_code = 204 uri = /vpc-routes
28952024-12-14T03:45:57.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40307
28962024-12-14T03:45:57.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28972024-12-14T03:45:57.904ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28982024-12-14T03:45:57.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137150 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40307 req_id = 1c5fd622-a0cf-45ab-a59e-d87df76b6c4c response_code = 204 uri = /switch-ports
28992024-12-14T03:45:57.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44105
29002024-12-14T03:45:57.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47795
29012024-12-14T03:45:57.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29022024-12-14T03:45:57.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40307 req_id = 06cbf2fa-f26c-496e-b7b7-64594b8f7a5b response_code = 200 uri = /network-bootstore-config
29032024-12-14T03:45:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4796 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44105 req_id = 3ca3add4-9b51-4446-a575-6adbb58bd89c response_code = 200 uri = /v2p
29042024-12-14T03:45:58.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29052024-12-14T03:45:58.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47795 req_id = c2d952bd-9bc2-4c1f-a915-ea710339a4a7 response_code = 204 uri = /switch-ports
29062024-12-14T03:45:58.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47795 req_id = 47cc10bb-e209-40e2-bf96-89233f1d04bf response_code = 200 uri = /network-bootstore-config
29072024-12-14T03:46:10.074ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40132
29082024-12-14T03:46:10.075ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40132 req_id = 9ea86b37-3a22-446a-93b0-494f1394071c response_code = 200 uri = /baseboard
29092024-12-14T03:46:10.619ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6123 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = e5c39ab2-7775-4007-90ad-38254278b03f response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
29102024-12-14T03:46:26.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56219
29112024-12-14T03:46:26.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56219 req_id = 3ab59cbb-5836-465b-a689-9d1e9b4ef070 response_code = 200 uri = /vpc-routes
29122024-12-14T03:46:26.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39636
29132024-12-14T03:46:26.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39636 req_id = 4d2b21c3-df20-41f4-97dc-66cbad7725e1 response_code = 200 uri = /v2p
29142024-12-14T03:46:26.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
29152024-12-14T03:46:26.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56219 req_id = ddcd2acc-b3d7-47a6-afa3-d3c16f0f2616 response_code = 204 uri = /eip-gateways
29162024-12-14T03:46:26.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56219 req_id = 7a3bc30e-3fe2-41fd-82b5-7ba9248b1371 response_code = 204 uri = /vpc-routes
29172024-12-14T03:46:26.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33518
29182024-12-14T03:46:26.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29192024-12-14T03:46:26.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29202024-12-14T03:46:26.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33518 req_id = 3621ebc6-79d9-472a-975d-4b09a7504e72 response_code = 204 uri = /switch-ports
29212024-12-14T03:46:26.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33518 req_id = 7d0c491b-83d9-457f-8466-2e2085340cea response_code = 200 uri = /network-bootstore-config
29222024-12-14T03:46:27.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45192
29232024-12-14T03:46:27.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45192 req_id = 154adb6c-ebf6-4091-8310-a6b71a111034 response_code = 200 uri = /vpc-routes
29242024-12-14T03:46:27.340ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
29252024-12-14T03:46:27.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45192 req_id = 5f6ef164-ed27-4d40-b89c-afc84d6d435b response_code = 204 uri = /eip-gateways
29262024-12-14T03:46:27.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45192 req_id = 4dbe3101-5945-44bf-8871-491356ccfbca response_code = 204 uri = /vpc-routes
29272024-12-14T03:46:27.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58053
29282024-12-14T03:46:27.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58053 req_id = 096646de-f5ad-4023-9c93-9c677eb8905e response_code = 200 uri = /v2p
29292024-12-14T03:46:27.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49106
29302024-12-14T03:46:27.537ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29312024-12-14T03:46:27.588ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29322024-12-14T03:46:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49106 req_id = 46560fdf-99da-4664-932e-2461dcf24fe4 response_code = 204 uri = /switch-ports
29332024-12-14T03:46:27.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46287
29342024-12-14T03:46:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49106 req_id = 4458e21c-c09e-4653-ac92-9f7d5585e8d1 response_code = 200 uri = /network-bootstore-config
29352024-12-14T03:46:27.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46287 req_id = 620bab72-b40e-420b-aa66-b17638fcca0c response_code = 200 uri = /vpc-routes
29362024-12-14T03:46:27.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
29372024-12-14T03:46:27.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46287 req_id = b3b25368-fc11-46a5-b6c8-8c9aa7775620 response_code = 204 uri = /eip-gateways
29382024-12-14T03:46:27.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45807
29392024-12-14T03:46:27.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45807 req_id = 0222b72b-8dc2-45f6-b1fc-90c004ec44f1 response_code = 200 uri = /v2p
29402024-12-14T03:46:27.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46287 req_id = 2b0b14c2-bda2-49cd-bdc9-81fd4dd9d66a response_code = 204 uri = /vpc-routes
29412024-12-14T03:46:27.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37661
29422024-12-14T03:46:27.778ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29432024-12-14T03:46:27.817ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29442024-12-14T03:46:27.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37661 req_id = 1c0fa084-1b8f-465f-a7f5-f1d4498a589d response_code = 204 uri = /switch-ports
29452024-12-14T03:46:27.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37661 req_id = d6a20981-565d-4011-a2f1-d0402ebf8cbb response_code = 200 uri = /network-bootstore-config
29462024-12-14T03:46:36.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62019
29472024-12-14T03:46:36.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62019 req_id = ca93e7cb-0a64-4eb6-9886-0d00ceec97fc response_code = 200 uri = /v2p
29482024-12-14T03:46:36.470ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(878139) }
29492024-12-14T03:46:36.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62019 req_id = ddd0d1b6-33b5-498c-8e0e-da3016bbf77f response_code = 204 uri = /v2p
29502024-12-14T03:46:36.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46538
29512024-12-14T03:46:36.552ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(878139))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-57ccbdeae81", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: a564f2ec-e28d-4827-809e-bfe817372315, read_only_parent: Some(Volume { block_size: 512, id: ba074b2e-ee34-4d95-ae78-504ec8bb03a4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b576da14-1bf6-4e73-8710-4a4f9f66f9ee, key: Some("Qd+G4cIfzKIwjFMk+2bxMQ5zqbyfjj/Vpmp947QcuFk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a564f2ec-e28d-4827-809e-bfe817372315, key: Some("K6kzzfpl3qn/PEV9kwZHnWQnZz7dpJ2DCBoEFILfqD4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-57ccbdeae81" }] }), cloud_init_bytes: Some(..) } instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 metadata = InstanceMetadata { silo_id: 578bc52c-ac81-41a6-a56b-dfc79805368e, project_id: fbc8a44b-35f5-4292-9d29-6b8f4a9ad3f9 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-14T03:46:36.545766721Z }
29522024-12-14T03:46:36.552ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 migration_id = None propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29532024-12-14T03:46:36.552ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 migration_id = None propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(878139))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c80f5460-b063-4d28-aa31-c5713d2e5121, kind: Instance { id: 500e6059-a5e4-4b42-83ed-155e9ca41940 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(878139), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-57ccbdeae81", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: a564f2ec-e28d-4827-809e-bfe817372315, read_only_parent: Some(Volume { block_size: 512, id: ba074b2e-ee34-4d95-ae78-504ec8bb03a4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b576da14-1bf6-4e73-8710-4a4f9f66f9ee, key: Some("Qd+G4cIfzKIwjFMk+2bxMQ5zqbyfjj/Vpmp947QcuFk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a564f2ec-e28d-4827-809e-bfe817372315, key: Some("K6kzzfpl3qn/PEV9kwZHnWQnZz7dpJ2DCBoEFILfqD4="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-57ccbdeae81" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-14T03:46:36.545766721Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29542024-12-14T03:46:36.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46538 req_id = 477b30f7-e789-439d-84c2-ec21a492a1cc response_code = 200 uri = /vmms/77db7f0c-ab53-4efc-aca3-831f5fbc4943
29552024-12-14T03:46:36.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50960
29562024-12-14T03:46:36.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50960 req_id = a07bcecc-98da-42ec-ae56-885bd7e4fe08 response_code = 200 uri = /vmms/77db7f0c-ab53-4efc-aca3-831f5fbc4943/state
29572024-12-14T03:46:36.657ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 878139 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29582024-12-14T03:46:36.657ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29592024-12-14T03:46:36.695ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943 file = illumos-utils/src/zone.rs:325 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29602024-12-14T03:46:36.722ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943 file = illumos-utils/src/zone.rs:363 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29612024-12-14T03:46:36.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41088
29622024-12-14T03:46:36.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41088 req_id = 06fd8aba-8ead-439a-b95c-c9956d33fda2 response_code = 200 uri = /vpc-routes
29632024-12-14T03:46:36.850ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {c80f5460-b063-4d28-aa31-c5713d2e5121: {10.151.1.175: {08950d67-dffe-4b3c-bc5f-4ac6f36a86ba}, 10.151.1.176: {08950d67-dffe-4b3c-bc5f-4ac6f36a86ba}}} }
29642024-12-14T03:46:38.100ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29652024-12-14T03:46:38.100ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29662024-12-14T03:46:38.275ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 46.498258ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29672024-12-14T03:46:38.331ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 113.756285ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29682024-12-14T03:46:38.463ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 211.764915ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29692024-12-14T03:46:38.687ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 345.120251ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29702024-12-14T03:46:39.047ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 444.499695ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29712024-12-14T03:46:39.506ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 936.599538ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29722024-12-14T03:46:40.110ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35084
29732024-12-14T03:46:40.110ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35084 req_id = efca4895-dbfd-4224-aea6-2a6732640114 response_code = 200 uri = /baseboard
29742024-12-14T03:46:40.455ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 679.400882ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29752024-12-14T03:46:40.619ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7316 local_addr = [fd00:1122:3344:101::1]:40070 method = GET remote_addr = [fd00:1122:3344:101::d]:49481 req_id = e7c674ab-2501-4755-8f2d-dcd3c712c940 response_code = 200 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 uri = /8d70e61c-94ed-41ce-b36c-cb904f92c534
29762024-12-14T03:46:41.145ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 771.792361ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29772024-12-14T03:46:41.927ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 991.408292ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29782024-12-14T03:46:42.930ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 622.99271ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 zone = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
29792024-12-14T03:46:43.583ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943 file = sled-agent/src/instance.rs:1786 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29802024-12-14T03:46:43.592ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 49.752477ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29812024-12-14T03:46:43.652ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943") failed: Property not found. retry in 119.344889ms file = illumos-utils/src/svc.rs:36 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29822024-12-14T03:46:43.783ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29832024-12-14T03:46:43.821ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29842024-12-14T03:46:43.959ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29852024-12-14T03:46:43.959ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1240 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
29862024-12-14T03:46:43.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7109305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41088 req_id = fb7cf6fb-286f-4ce5-a4d3-764e99ee37e0 response_code = 204 uri = /eip-gateways
29872024-12-14T03:46:43.960ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-14T03:46:43.960737483Z } file = sled-agent/src/instance.rs:780 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29882024-12-14T03:46:43.960ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-14T03:46:43.960737483Z } propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29892024-12-14T03:46:43.960ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-14T03:46:43.960737483Z }, migration_in: None, migration_out: None }
29902024-12-14T03:46:43.999ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-14T03:46:43.999897198Z } file = sled-agent/src/instance.rs:780 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29912024-12-14T03:46:43.999ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-14T03:46:43.999897198Z } propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29922024-12-14T03:46:43.999ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-14T03:46:43.999897198Z }, migration_in: None, migration_out: None }
29932024-12-14T03:46:44.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41088 req_id = eb3c8366-46d3-4968-bb47-391af54f0172 response_code = 204 uri = /vpc-routes
29942024-12-14T03:46:54.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51090
29952024-12-14T03:46:54.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51090 req_id = 9d1fb21d-4ce8-441d-bce2-65a3c36c4ac4 response_code = 200 uri = /vmms/77db7f0c-ab53-4efc-aca3-831f5fbc4943/state
29962024-12-14T03:46:54.192ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-14T03:46:54.192667089Z } file = sled-agent/src/instance.rs:780 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29972024-12-14T03:46:54.192ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-14T03:46:54.192667089Z } propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
29982024-12-14T03:46:54.192ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-14T03:46:54.192667089Z }, migration_in: None, migration_out: None }
29992024-12-14T03:46:54.203ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-14T03:46:54.203438965Z } file = sled-agent/src/instance.rs:780 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
30002024-12-14T03:46:54.203ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-14T03:46:54.203438965Z } propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
30012024-12-14T03:46:54.203ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
30022024-12-14T03:46:54.203ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30032024-12-14T03:46:54.204ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14132659905492570340 n_samples = 6 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
30042024-12-14T03:46:54.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30052024-12-14T03:46:54.204ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/1a2cfee1-7f3c-4dd8-b244-1c269d8dd2a2/debug/bundle/zone", "/pool/int/bdc25360-ecc2-4ebe-8d54-cee94a0ed9f1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/0943bac0-9587-46a8-9356-3f72a7cd0f99/crypt/debug", "/pool/ext/128dcb8a-56c9-451c-a438-d3ea94a82725/crypt/debug", "/pool/ext/7abbec18-6cce-4b1e-9880-d5caa99cf0a9/crypt/debug", "/pool/ext/4a91d090-6980-43b2-8cca-44eb6dd10741/crypt/debug", "/pool/ext/73bc07b3-a806-455e-a40b-a99deea605ef/crypt/debug", "/pool/ext/5954eff0-cf65-42fa-b1c1-3fcfe6fa4fdb/crypt/debug", "/pool/ext/e59f3d16-25c0-46d9-becf-30583dc64eeb/crypt/debug", "/pool/ext/a74803d1-a742-40d3-90f4-c7bf854f2fa2/crypt/debug", "/pool/ext/fb57e12e-6889-4ba5-8f94-102093287f39/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943
30062024-12-14T03:46:54.204ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 17542917481774717461 n_samples = 6 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
30072024-12-14T03:46:54.845ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943", bundle_id: 68a12489-d157-4287-8ba3-9bb1b1cc9a93 }, time_created: 2024-12-14T03:46:54.205723261Z, version: 0, cause: TerminatedInstance }
30082024-12-14T03:46:54.845ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_77db7f0c-ab53-4efc-aca3-831f5fbc4943 file = sled-agent/src/instance.rs:1032 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
30092024-12-14T03:46:56.665ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
30102024-12-14T03:46:56.682ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(878139), kind: System }
30112024-12-14T03:46:56.682ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(878139), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30122024-12-14T03:46:56.682ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-14T03:46:56.682595883Z }, migration_in: None, migration_out: None }
30132024-12-14T03:46:56.710ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-14T03:46:56.682595883Z }, migration_in: None, migration_out: None }
30142024-12-14T03:46:56.715ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 500e6059-a5e4-4b42-83ed-155e9ca41940 propolis_id = 77db7f0c-ab53-4efc-aca3-831f5fbc4943
30152024-12-14T03:46:56.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53814
30162024-12-14T03:46:56.848ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Not Found error_message_internal = VMM with ID 77db7f0c-ab53-4efc-aca3-831f5fbc4943 not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53814 req_id = 83ca9190-cd30-489b-9500-31b33149011e response_code = 404 uri = /vmms/77db7f0c-ab53-4efc-aca3-831f5fbc4943/state
30172024-12-14T03:46:56.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61416
30182024-12-14T03:46:56.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61416 req_id = bf9fa369-9d2d-40da-abad-996371638fc1 response_code = 200 uri = /vpc-routes
30192024-12-14T03:46:56.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {c80f5460-b063-4d28-aa31-c5713d2e5121: {10.151.1.175: {08950d67-dffe-4b3c-bc5f-4ac6f36a86ba}, 10.151.1.176: {08950d67-dffe-4b3c-bc5f-4ac6f36a86ba}}} }
30202024-12-14T03:46:56.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61416 req_id = 9e7126fd-8362-4d86-83e5-5594a5f013b3 response_code = 204 uri = /eip-gateways
30212024-12-14T03:46:56.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61416 req_id = a5e3a36d-df59-44d4-a159-b6802b7468bc response_code = 204 uri = /vpc-routes
30222024-12-14T03:46:56.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43764
30232024-12-14T03:46:56.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30242024-12-14T03:46:57.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30252024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43764 req_id = 551e6c4e-f68c-49b1-9fad-460eb92c65bf response_code = 204 uri = /switch-ports
30262024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37316
30272024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43052
30282024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43052 req_id = 93cb94fe-c0e1-472b-aafa-fb9f0dcfc78d response_code = 200 uri = /v2p
30292024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43764 req_id = 23083019-eaa7-4bae-863c-7c90db987f31 response_code = 200 uri = /network-bootstore-config
30302024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37316 req_id = 3a322a08-7074-4829-9bb4-e8b8d4634c76 response_code = 200 uri = /vpc-routes
30312024-12-14T03:46:57.101ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(878139) }
30322024-12-14T03:46:57.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43052 req_id = a9df5163-d07b-4c3c-8e51-28b067d614ab response_code = 204 uri = /v2p
30332024-12-14T03:46:57.115ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
30342024-12-14T03:46:57.115ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1240 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534
30352024-12-14T03:46:57.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37316 req_id = cb64f401-8cef-4876-875f-d7825782601c response_code = 204 uri = /eip-gateways
30362024-12-14T03:46:57.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37316 req_id = c05d612d-9cb8-419c-b17c-2f7b5aef05e9 response_code = 204 uri = /vpc-routes
30372024-12-14T03:46:57.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58474
30382024-12-14T03:46:57.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58474 req_id = aa647084-3e42-40da-95ea-f37e2eb3c2ef response_code = 200 uri = /v2p
30392024-12-14T03:46:57.204ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:914 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(878139) }
30402024-12-14T03:46:57.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 684 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58474 req_id = 0f6f9b68-183e-490e-9058-364fe0524298 response_code = 204 uri = /v2p
30412024-12-14T03:46:57.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36215
30422024-12-14T03:46:57.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36215 req_id = f636222e-4a3e-469d-ab1d-996999b6c237 response_code = 200 uri = /v2p
30432024-12-14T03:46:57.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33767
30442024-12-14T03:46:57.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33767 req_id = 3b0ddbed-00fa-4aa6-a882-07c28d9e6fd8 response_code = 200 uri = /vpc-routes
30452024-12-14T03:46:57.745ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
30462024-12-14T03:46:57.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33767 req_id = a861b0db-529e-40c5-9bc5-88b198012cd4 response_code = 204 uri = /eip-gateways
30472024-12-14T03:46:57.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33767 req_id = 18178aa6-a3c4-4100-aef9-3dad2a1d493a response_code = 204 uri = /vpc-routes
30482024-12-14T03:46:57.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63265
30492024-12-14T03:46:57.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63265 req_id = 386f7164-54bf-4d08-92b6-cfe8682e922f response_code = 200 uri = /v2p
30502024-12-14T03:46:57.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49700
30512024-12-14T03:46:57.805ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30522024-12-14T03:46:57.845ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30532024-12-14T03:46:57.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94733 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49700 req_id = 2a66c604-ae91-45dc-8aaa-914304a58a4b response_code = 204 uri = /switch-ports
30542024-12-14T03:46:57.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54809
30552024-12-14T03:46:57.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54809 req_id = c0bedfa1-9acf-4d48-a0cc-77a43c1488fb response_code = 200 uri = /vpc-routes
30562024-12-14T03:46:57.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49700 req_id = a5d3aea0-a373-4c32-b1e9-971e5367f9e2 response_code = 200 uri = /network-bootstore-config
30572024-12-14T03:46:57.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
30582024-12-14T03:46:57.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54809 req_id = bb6c709e-713d-4e47-a477-6dfbd3fe67c7 response_code = 204 uri = /eip-gateways
30592024-12-14T03:46:58.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57007
30602024-12-14T03:46:58.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57007 req_id = 1586d7af-47b4-4b1f-90aa-7192f700b0bf response_code = 200 uri = /v2p
30612024-12-14T03:46:58.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54809 req_id = bc981446-242e-4d11-8f26-5ee544cd18d0 response_code = 204 uri = /vpc-routes
30622024-12-14T03:46:58.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51408
30632024-12-14T03:46:58.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30642024-12-14T03:46:58.061ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30652024-12-14T03:46:58.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51408 req_id = 03c683ac-97a8-4b7a-946d-aee011a27357 response_code = 204 uri = /switch-ports
30662024-12-14T03:46:58.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55866
30672024-12-14T03:46:58.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55866 req_id = c97c875a-61af-4bd5-a73b-65417bc4ffeb response_code = 200 uri = /vpc-routes
30682024-12-14T03:46:58.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51408 req_id = afa27468-a903-4252-8ec1-4cd34a1a0610 response_code = 200 uri = /network-bootstore-config
30692024-12-14T03:46:58.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
30702024-12-14T03:46:58.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55866 req_id = 24572d63-069c-4003-836a-93196f1a6a58 response_code = 204 uri = /eip-gateways
30712024-12-14T03:46:58.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55866 req_id = 6041ea06-ebe4-4d13-971b-d1fbfe4a6d71 response_code = 204 uri = /vpc-routes
30722024-12-14T03:46:58.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34806
30732024-12-14T03:46:58.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34806 req_id = 74a729c8-dc32-4a24-ba6d-e236e26776e9 response_code = 200 uri = /vpc-routes
30742024-12-14T03:46:58.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1214 sled_id = 8d70e61c-94ed-41ce-b36c-cb904f92c534 values = ExternalIpGatewayMap { mappings: {} }
30752024-12-14T03:46:58.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34806 req_id = 76f9847c-96c6-4c34-b23c-28379b8024b6 response_code = 204 uri = /eip-gateways
30762024-12-14T03:46:58.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34806 req_id = e24a9a84-c947-4df5-a248-97e768225d2a response_code = 204 uri = /vpc-routes