Max level shown:
1 [ Dec 20 22:51:45 Enabled. ]
2 [ Dec 20 22:51:45 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 20 22:51:45 Method "start" exited with status 0. ]
4 [ Dec 20 22:51:45 Rereading configuration. ]
5 [ Dec 20 22:51:45 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-20T22:51:45.920ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-20T22:51:45.920ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-20T22:51:45.973ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-20T22:51:45.973ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-20T22:51:46.087ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-20T22:51:46.096ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-20T22:51:46.104ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-20T22:51:46.707ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-20T22:51:46.848ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-20T22:51:46.848ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-20T22:51:46.848ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-20T22:51:46.848ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-20T22:51:46.848ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-20T22:51:46.848ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-20T22:51:46.851ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-20T22:51:46.851ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-20T22:51:46.851ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-20T22:51:46.851ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-20T22:51:46.851ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-20T22:51:46.851ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-20T22:51:46.851ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-20T22:51:46.851ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-20T22:51:46.851ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-20T22:51:46.862ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-20T22:51:46.862ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool)
322024-12-20T22:51:46.958ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal }
332024-12-20T22:51:47.324ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-20T22:51:47.324ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-20T22:51:47.324ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-20T22:51:47.324ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-20T22:51:47.324ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-20T22:51:47.324ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-20T22:51:47.324ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-20T22:51:47.333ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-20T22:51:47.333ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool)
422024-12-20T22:51:47.420ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal }
432024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
462024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
642024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
722024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
762024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
772024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
782024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-20T22:51:47.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962024-12-20T22:51:47.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-12-20T22:51:47.781ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-20T22:51:47.781ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-20T22:51:47.781ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002024-12-20T22:51:47.781ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-20T22:51:47.781ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1032024-12-20T22:51:47.781ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1042024-12-20T22:51:47.781ZINFOSledAgent (bootstore): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-20T22:51:47.781ZINFOSledAgent (bootstore): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-20T22:51:47.781ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-20T22:51:47.781ZINFOSledAgent (bootstore): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-20T22:51:47.781ZINFOSledAgent (bootstore): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-20T22:51:47.781ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-20T22:51:47.781ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-20T22:51:47.781ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-20T22:51:47.792ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-20T22:51:47.792ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1123, tv_nsec: 431089393 } time_to_next_cleanup = 599.999933978s
1142024-12-20T22:51:47.792ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-20T22:51:47.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-20T22:51:47.794ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-20T22:51:47.794ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-20T22:51:47.795ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-20T22:51:47.796ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-20T22:51:47.797ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-20T22:51:47.797ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-20T22:51:47.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-20T22:51:47.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-20T22:51:47.797ZINFOSledAgent (RSS): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-20T22:51:47.797ZINFOSledAgent (RSS): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-20T22:51:47.797ZINFOSledAgent (RSS): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-20T22:51:47.797ZINFOSledAgent (RSS): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-20T22:51:47.797ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-20T22:51:47.797ZINFOSledAgent (RSS): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-20T22:51:47.797ZINFOSledAgent (RSS): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-20T22:51:47.797ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-20T22:51:47.797ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-20T22:51:47.797ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-20T22:51:47.797ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-20T22:51:47.797ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-20T22:51:47.797ZINFOSledAgent (bootstore): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-20T22:51:47.798ZINFOSledAgent (bootstore): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-20T22:51:47.798ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-20T22:51:47.798ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 287d6774-d3e6-4b73-8c77-c90534d4a54d (sled), rack_id: b394d0c6-19a8-4136-9148-af6c47c1f8e0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-20T22:51:47.799ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-20T22:51:47.799ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-20T22:51:47.803ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-20T22:51:47.809ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-20T22:51:47.809ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-20T22:51:47.813ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-20T22:51:47.813ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-20T22:51:47.814ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:45680
1482024-12-20T22:51:47.814ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 287d6774-d3e6-4b73-8c77-c90534d4a54d (sled), rack_id: b394d0c6-19a8-4136-9148-af6c47c1f8e0, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-20T22:51:47.814ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-20T22:51:47.814ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-20T22:51:47.814ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-20T22:51:47.814ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-20T22:51:47.814ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-20T22:51:47.814ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-20T22:51:47.829ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-20T22:51:47.849ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-20T22:51:47.866ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-20T22:51:47.874ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1662024-12-20T22:51:47.874ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-20T22:51:47.874ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1682024-12-20T22:51:47.874ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-20T22:51:47.878ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 116.379821ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c6d3d8a-b38f-4411-9fc8-6ef66be33d74", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c6d3d8a-b38f-4411-9fc8-6ef66be33d74" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-20T22:51:47.887ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_54947fde-6f46-42c6-a75c-eac205d82ba4/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-20T22:51:47.911ZINFOSledAgent: successfully created encrypted zvol: name="oxi_54947fde-6f46-42c6-a75c-eac205d82ba4/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-20T22:51:47.911ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_54947fde-6f46-42c6-a75c-eac205d82ba4/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-20T22:51:47.916ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1742024-12-20T22:51:47.916ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-20T22:51:47.916ZINFOSledAgent (BackingFs): Ensuring dataset oxi_54947fde-6f46-42c6-a75c-eac205d82ba4/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-20T22:51:47.986ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772024-12-20T22:51:47.995ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-20T22:51:47.995ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 123.749543ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "17fbb9e1-0631-4c76-8503-51cc00a6342a", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "17fbb9e1-0631-4c76-8503-51cc00a6342a" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-20T22:51:48.120ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-20T22:51:48.120ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 112.510633ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "abd028ea-9fbe-41cf-9104-3a92bc8a44e2", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "abd028ea-9fbe-41cf-9104-3a92bc8a44e2" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-20T22:51:48.205ZINFOSledAgent (BackingFs): Mounting oxi_54947fde-6f46-42c6-a75c-eac205d82ba4/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-20T22:51:48.219ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-20T22:51:48.219ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-20T22:51:48.219ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-20T22:51:48.219ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-20T22:51:48.234ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-20T22:51:48.235ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 130.896043ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9a1b6f6-fa67-4d00-92bd-6ea05f91f6ae", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9a1b6f6-fa67-4d00-92bd-6ea05f91f6ae" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-20T22:51:48.367ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-20T22:51:48.367ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 186.315741ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "22b2edba-0f70-4eeb-b57b-1746312e31e8", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "22b2edba-0f70-4eeb-b57b-1746312e31e8" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-20T22:51:48.555ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-20T22:51:48.555ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 308.568797ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "22ee42aa-693d-4fd4-ac8e-5aa0fc6c8a70", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "22ee42aa-693d-4fd4-ac8e-5aa0fc6c8a70" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-20T22:51:48.865ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-20T22:51:48.865ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 345.057452ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e893308e-30d5-4fae-9f25-b82e87b91aee", "content-length": "124", "date": "Fri, 20 Dec 2024 22:51:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e893308e-30d5-4fae-9f25-b82e87b91aee" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-20T22:51:48.948ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1952024-12-20T22:51:48.953ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:54328 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1962024-12-20T22:51:48.953ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1972024-12-20T22:51:48.953ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:54328 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1982024-12-20T22:51:48.954ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 262.158147ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
1992024-12-20T22:51:48.955ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2002024-12-20T22:51:48.955ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2012024-12-20T22:51:48.955ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022024-12-20T22:51:48.955ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-20T22:51:49.211ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-12-20T22:51:49.217ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 658.353228ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2052024-12-20T22:51:49.877ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.086759942s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2062024-12-20T22:51:50.966ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.029384059s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2072024-12-20T22:51:51.646ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2082024-12-20T22:51:51.646ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2092024-12-20T22:51:51.646ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2102024-12-20T22:51:51.646ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2112024-12-20T22:51:51.646ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2122024-12-20T22:51:51.646ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2132024-12-20T22:51:51.648ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2142024-12-20T22:51:51.650ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2152024-12-20T22:51:51.650ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='b8933e6b-2a3e-4740-9b95-439cad1f1ef0'/> <propval type="astring" name="rack_id" value='b394d0c6-19a8-4136-9148-af6c47c1f8e0'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe90:3764'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='b394d0c6-19a8-4136-9148-af6c47c1f8e0'/> <propval type="astring" name="sled_id" value='287d6774-d3e6-4b73-8c77-c90534d4a54d'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='287d6774-d3e6-4b73-8c77-c90534d4a54d'/> <propval type="astring" name="rack_uuid" value='b394d0c6-19a8-4136-9148-af6c47c1f8e0'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='287d6774-d3e6-4b73-8c77-c90534d4a54d'/> <propval type="astring" name="rack_uuid" value='b394d0c6-19a8-4136-9148-af6c47c1f8e0'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-20T22:51:51.650ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-20T22:51:51.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 45.670541ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-20T22:51:52.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 91.46896ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-20T22:51:52.156ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.208501204s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2202024-12-20T22:51:52.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 183.666364ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-20T22:51:52.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 245.239036ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-20T22:51:52.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 460.108275ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-20T22:51:53.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 581.602195ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-20T22:51:54.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.135763838s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-20T22:51:55.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.29589054s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-20T22:51:56.366ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.987965115s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2272024-12-20T22:51:56.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 735.093011ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-12-20T22:51:57.925ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/nexus.rs:527 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2292024-12-20T22:51:57.955ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302024-12-20T22:51:57.955ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2312024-12-20T22:51:57.956ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2322024-12-20T22:51:57.956ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332024-12-20T22:51:57.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2342024-12-20T22:51:57.956ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-20T22:51:57.957ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362024-12-20T22:51:57.957ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372024-12-20T22:51:57.957ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382024-12-20T22:51:57.957ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2392024-12-20T22:51:57.957ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:45680
2402024-12-20T22:51:58.160ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-12-20T22:51:58.160ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2422024-12-20T22:51:58.165ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432024-12-20T22:51:58.165ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2442024-12-20T22:51:58.165ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2452024-12-20T22:51:58.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65245
2462024-12-20T22:51:58.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472024-12-20T22:51:58.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482024-12-20T22:51:58.421ZINFOSledAgent (ServiceManager): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:188
2492024-12-20T22:51:58.421ZINFOSledAgent (ServiceManager): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:188
2502024-12-20T22:51:58.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65245 req_id = afd67f48-4c5b-45cd-8c0b-f83c68399067 response_code = 200 uri = /inventory
2512024-12-20T22:51:58.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54836
2522024-12-20T22:51:58.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54836 req_id = 579f80c5-046b-4931-a721-3b795623c2c0 response_code = 200 uri = /sled-role
2532024-12-20T22:51:58.483ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7264d2ad-f4f9-4093-a781-88ebabccff53 (physical_disk), pool_id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: df8199cc-cd13-4dd6-ad40-c107f940c830 (physical_disk), pool_id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6a061d85-983d-4876-b88a-80c3926b4221 (physical_disk), pool_id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 40044024-bca2-49f0-aa20-1a9b9df71d5c (physical_disk), pool_id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c5178f54-f2a2-4a54-8fcb-6f0aa59b9b71 (physical_disk), pool_id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 724edbae-4eb9-409b-85a2-ee251d970223 (physical_disk), pool_id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4c0c6f64-d8b2-4f40-881c-1e9d545da7ee (physical_disk), pool_id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e118c261-64aa-4765-a207-50f48c2be38d (physical_disk), pool_id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0e7bb578-49de-4a52-9525-56d7ec3e18cc (physical_disk), pool_id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2542024-12-20T22:51:58.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60528
2552024-12-20T22:51:58.483ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2562024-12-20T22:51:58.483ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7264d2ad-f4f9-4093-a781-88ebabccff53 (physical_disk), pool_id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: df8199cc-cd13-4dd6-ad40-c107f940c830 (physical_disk), pool_id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6a061d85-983d-4876-b88a-80c3926b4221 (physical_disk), pool_id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 40044024-bca2-49f0-aa20-1a9b9df71d5c (physical_disk), pool_id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c5178f54-f2a2-4a54-8fcb-6f0aa59b9b71 (physical_disk), pool_id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 724edbae-4eb9-409b-85a2-ee251d970223 (physical_disk), pool_id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4c0c6f64-d8b2-4f40-881c-1e9d545da7ee (physical_disk), pool_id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e118c261-64aa-4765-a207-50f48c2be38d (physical_disk), pool_id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0e7bb578-49de-4a52-9525-56d7ec3e18cc (physical_disk), pool_id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2572024-12-20T22:51:58.483ZINFOSledAgent (StorageManager): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582024-12-20T22:51:58.483ZINFOSledAgent (StorageManager): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592024-12-20T22:51:58.483ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2602024-12-20T22:51:58.483ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2612024-12-20T22:51:58.483ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2622024-12-20T22:51:58.483ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2632024-12-20T22:51:58.483ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2642024-12-20T22:51:58.681ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2652024-12-20T22:51:58.682ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool)
2662024-12-20T22:51:59.141ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17594947564682583980 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2672024-12-20T22:51:59.141ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15905602940983613339 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2682024-12-20T22:51:59.141ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2692024-12-20T22:51:59.589ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
2702024-12-20T22:51:59.620ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }
2712024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2722024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2732024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2742024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2752024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772024-12-20T22:51:59.628ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2782024-12-20T22:51:59.663ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792024-12-20T22:51:59.671ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone file = sled-storage/src/dataset.rs:302
2802024-12-20T22:51:59.807ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1bebbc47-252a-4b92-8d16-64a505e777ec file = sled-storage/src/dataset.rs:388
2812024-12-20T22:51:59.815ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822024-12-20T22:51:59.815ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832024-12-20T22:51:59.815ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842024-12-20T22:51:59.815ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852024-12-20T22:51:59.815ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862024-12-20T22:51:59.826ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2872024-12-20T22:51:59.826ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool)
2882024-12-20T22:51:59.921ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }
2892024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2902024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2912024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2922024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2932024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952024-12-20T22:51:59.930ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2962024-12-20T22:51:59.964ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972024-12-20T22:51:59.972ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone file = sled-storage/src/dataset.rs:302
2982024-12-20T22:52:00.110ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2 file = sled-storage/src/dataset.rs:388
2992024-12-20T22:52:00.118ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002024-12-20T22:52:00.118ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012024-12-20T22:52:00.118ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022024-12-20T22:52:00.118ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032024-12-20T22:52:00.118ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042024-12-20T22:52:00.127ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052024-12-20T22:52:00.127ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d31b2b69-efd5-461d-912c-5052088aed91 (zpool)
3062024-12-20T22:52:00.219ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }
3072024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3082024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3092024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3102024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3112024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-12-20T22:52:00.227ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3142024-12-20T22:52:00.230ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
3152024-12-20T22:52:00.261ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162024-12-20T22:52:00.268ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone file = sled-storage/src/dataset.rs:302
3172024-12-20T22:52:00.396ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d31b2b69-efd5-461d-912c-5052088aed91 file = sled-storage/src/dataset.rs:388
3182024-12-20T22:52:00.403ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192024-12-20T22:52:00.403ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202024-12-20T22:52:00.403ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212024-12-20T22:52:00.403ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222024-12-20T22:52:00.403ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232024-12-20T22:52:00.413ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242024-12-20T22:52:00.413ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool)
3252024-12-20T22:52:00.509ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }
3262024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3272024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3282024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3292024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3302024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-12-20T22:52:00.517ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3332024-12-20T22:52:00.554ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342024-12-20T22:52:00.562ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone file = sled-storage/src/dataset.rs:302
3352024-12-20T22:52:00.705ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1 file = sled-storage/src/dataset.rs:388
3362024-12-20T22:52:00.713ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372024-12-20T22:52:00.713ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382024-12-20T22:52:00.713ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392024-12-20T22:52:00.713ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402024-12-20T22:52:00.713ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412024-12-20T22:52:00.722ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422024-12-20T22:52:00.722ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool)
3432024-12-20T22:52:00.817ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }
3442024-12-20T22:52:00.825ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3452024-12-20T22:52:00.825ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3462024-12-20T22:52:00.825ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3472024-12-20T22:52:00.825ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3482024-12-20T22:52:00.825ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-12-20T22:52:00.826ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-12-20T22:52:00.826ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3512024-12-20T22:52:00.860ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-12-20T22:52:00.868ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone file = sled-storage/src/dataset.rs:302
3532024-12-20T22:52:01.004ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27 file = sled-storage/src/dataset.rs:388
3542024-12-20T22:52:01.013ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552024-12-20T22:52:01.013ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562024-12-20T22:52:01.013ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572024-12-20T22:52:01.013ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582024-12-20T22:52:01.013ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592024-12-20T22:52:01.022ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602024-12-20T22:52:01.022ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool)
3612024-12-20T22:52:01.117ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }
3622024-12-20T22:52:01.124ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3632024-12-20T22:52:01.124ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3642024-12-20T22:52:01.124ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3652024-12-20T22:52:01.124ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3662024-12-20T22:52:01.124ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-20T22:52:01.125ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-12-20T22:52:01.125ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3692024-12-20T22:52:01.160ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-12-20T22:52:01.168ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone file = sled-storage/src/dataset.rs:302
3712024-12-20T22:52:01.232ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
3722024-12-20T22:52:01.304ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 file = sled-storage/src/dataset.rs:388
3732024-12-20T22:52:01.311ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3742024-12-20T22:52:01.312ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3752024-12-20T22:52:01.312ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3762024-12-20T22:52:01.312ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772024-12-20T22:52:01.312ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782024-12-20T22:52:01.321ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3792024-12-20T22:52:01.322ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool)
3802024-12-20T22:52:01.418ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }
3812024-12-20T22:52:01.426ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3822024-12-20T22:52:01.426ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3832024-12-20T22:52:01.426ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3842024-12-20T22:52:01.427ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3852024-12-20T22:52:01.427ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-12-20T22:52:01.427ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-12-20T22:52:01.427ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3882024-12-20T22:52:01.461ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-12-20T22:52:01.468ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/zone file = sled-storage/src/dataset.rs:302
3902024-12-20T22:52:01.597ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_091028cb-f478-4341-abae-5f1e6cecc3ba file = sled-storage/src/dataset.rs:388
3912024-12-20T22:52:01.604ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922024-12-20T22:52:01.604ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932024-12-20T22:52:01.604ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942024-12-20T22:52:01.604ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952024-12-20T22:52:01.604ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962024-12-20T22:52:01.614ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972024-12-20T22:52:01.614ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool)
3982024-12-20T22:52:01.710ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }
3992024-12-20T22:52:01.717ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002024-12-20T22:52:01.718ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012024-12-20T22:52:01.718ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022024-12-20T22:52:01.718ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032024-12-20T22:52:01.718ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-12-20T22:52:01.718ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-12-20T22:52:01.718ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062024-12-20T22:52:01.753ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-12-20T22:52:01.760ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/zone file = sled-storage/src/dataset.rs:302
4082024-12-20T22:52:01.913ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b960ef68-fd77-411f-b5e4-77a645524bc5 file = sled-storage/src/dataset.rs:388
4092024-12-20T22:52:01.922ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102024-12-20T22:52:01.922ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112024-12-20T22:52:01.922ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122024-12-20T22:52:01.922ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132024-12-20T22:52:01.922ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-12-20T22:52:01.932ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4152024-12-20T22:52:01.932ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool)
4162024-12-20T22:52:02.036ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }
4172024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4182024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4192024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4202024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4212024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-12-20T22:52:02.044ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4242024-12-20T22:52:02.081ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-12-20T22:52:02.089ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/zone file = sled-storage/src/dataset.rs:302
4262024-12-20T22:52:02.230ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae file = sled-storage/src/dataset.rs:388
4272024-12-20T22:52:02.234ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4282024-12-20T22:52:02.238ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292024-12-20T22:52:02.238ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302024-12-20T22:52:02.238ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-20T22:52:02.238ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54947fde-6f46-42c6-a75c-eac205d82ba4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 708c9a94-dadb-4abd-b4a8-a26b3220460f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322024-12-20T22:52:02.238ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332024-12-20T22:52:02.238ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342024-12-20T22:52:02.238ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352024-12-20T22:52:02.238ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4362024-12-20T22:52:02.238ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4372024-12-20T22:52:02.238ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4382024-12-20T22:52:02.238ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4392024-12-20T22:52:02.238ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4402024-12-20T22:52:02.238ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4412024-12-20T22:52:02.238ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4422024-12-20T22:52:02.238ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432024-12-20T22:52:02.238ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4442024-12-20T22:52:02.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3755582 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60528 req_id = c9a6de3d-a7c3-44d8-b4bd-cd86ae421686 response_code = 200 uri = /omicron-physical-disks
4452024-12-20T22:52:02.270ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01d75066-40dc-4d91-b007-844431939b1a (dataset): DatasetConfig { id: 01d75066-40dc-4d91-b007-844431939b1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0286033c-eff8-457e-9bd5-eddd6076fd15 (dataset): DatasetConfig { id: 0286033c-eff8-457e-9bd5-eddd6076fd15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0580d385-9610-4cb3-a672-9218efa9eb18 (dataset): DatasetConfig { id: 0580d385-9610-4cb3-a672-9218efa9eb18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05d8299a-6954-4d19-bf2e-cf42fd4d11e1 (dataset): DatasetConfig { id: 05d8299a-6954-4d19-bf2e-cf42fd4d11e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 088021da-1e31-4d7b-8d3f-eb4dd574d17c (dataset): DatasetConfig { id: 088021da-1e31-4d7b-8d3f-eb4dd574d17c (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 116b3a5d-c7b2-4abc-be3f-735849ab210c (dataset): DatasetConfig { id: 116b3a5d-c7b2-4abc-be3f-735849ab210c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 139c5fa9-09d2-4e00-83f4-0e6b8cbdccda (dataset): DatasetConfig { id: 139c5fa9-09d2-4e00-83f4-0e6b8cbdccda (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20018a1e-a65d-48bd-a856-ceb577f94d91 (dataset): DatasetConfig { id: 20018a1e-a65d-48bd-a856-ceb577f94d91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23085d96-8272-4f23-bfe4-84507f0667c9 (dataset): DatasetConfig { id: 23085d96-8272-4f23-bfe4-84507f0667c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23d64322-5932-4734-94ba-da958c83f045 (dataset): DatasetConfig { id: 23d64322-5932-4734-94ba-da958c83f045 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 241b92c0-ff03-4758-893b-a8b5f7a8f531 (dataset): DatasetConfig { id: 241b92c0-ff03-4758-893b-a8b5f7a8f531 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25e8c3cc-dd34-417a-8dc2-3ac51c319807 (dataset): DatasetConfig { id: 25e8c3cc-dd34-417a-8dc2-3ac51c319807 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b224e9d-d479-4712-a4b8-3de83c3b4888 (dataset): DatasetConfig { id: 2b224e9d-d479-4712-a4b8-3de83c3b4888 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cbc6c03-6fde-45b5-80b3-94065eec0609 (dataset): DatasetConfig { id: 2cbc6c03-6fde-45b5-80b3-94065eec0609 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 33d9e9c4-8d9e-4eec-8307-d7c68d8cec0b (dataset): DatasetConfig { id: 33d9e9c4-8d9e-4eec-8307-d7c68d8cec0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33dd13fc-3a86-49f2-a4fd-a61f4dc33555 (dataset): DatasetConfig { id: 33dd13fc-3a86-49f2-a4fd-a61f4dc33555 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38e1e043-c59f-4e68-b26e-8bc970b0889c (dataset): DatasetConfig { id: 38e1e043-c59f-4e68-b26e-8bc970b0889c (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 390ee389-1f8d-46d4-b489-f4a84b0b9289 (dataset): DatasetConfig { id: 390ee389-1f8d-46d4-b489-f4a84b0b9289 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3de76ed3-7fc9-4cf4-8038-555ad149c869 (dataset): DatasetConfig { id: 3de76ed3-7fc9-4cf4-8038-555ad149c869 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e6211c5-c16d-4f00-8186-7c7bcd0d7e81 (dataset): DatasetConfig { id: 3e6211c5-c16d-4f00-8186-7c7bcd0d7e81 (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 416e7b96-8a27-4984-bc81-ce8ad130070d (dataset): DatasetConfig { id: 416e7b96-8a27-4984-bc81-ce8ad130070d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 458ab9e8-76ef-48bf-919b-d37f03151275 (dataset): DatasetConfig { id: 458ab9e8-76ef-48bf-919b-d37f03151275 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46ab0de4-0194-4e18-91ea-c606285e73a7 (dataset): DatasetConfig { id: 46ab0de4-0194-4e18-91ea-c606285e73a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a111bbf-1413-46f4-806f-db018ce09e22 (dataset): DatasetConfig { id: 4a111bbf-1413-46f4-806f-db018ce09e22 (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4c8a1b0c-820e-4b5b-b74e-c1b3fe1099a6 (dataset): DatasetConfig { id: 4c8a1b0c-820e-4b5b-b74e-c1b3fe1099a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f2c1b10-5b86-45f3-9bd1-20b9e8a610c1 (dataset): DatasetConfig { id: 4f2c1b10-5b86-45f3-9bd1-20b9e8a610c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66e4a657-4334-4cdd-b3c1-d7541f900551 (dataset): DatasetConfig { id: 66e4a657-4334-4cdd-b3c1-d7541f900551 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69982497-2df8-462e-89e2-01b9649c64cc (dataset): DatasetConfig { id: 69982497-2df8-462e-89e2-01b9649c64cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b69029b-6714-4dea-b1b2-374ba185464b (dataset): DatasetConfig { id: 6b69029b-6714-4dea-b1b2-374ba185464b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c368d12-c0e6-417d-a571-e71f51103bec (dataset): DatasetConfig { id: 6c368d12-c0e6-417d-a571-e71f51103bec (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e1816af-3ea0-4629-9b0c-cd8e47e70ceb (dataset): DatasetConfig { id: 6e1816af-3ea0-4629-9b0c-cd8e47e70ceb (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ee0f1aa-f191-45f4-81b7-80076e11a973 (dataset): DatasetConfig { id: 6ee0f1aa-f191-45f4-81b7-80076e11a973 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 744ac255-8682-407a-a13d-20ac9699ee11 (dataset): DatasetConfig { id: 744ac255-8682-407a-a13d-20ac9699ee11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b24af1c-bc1d-4909-9d1a-7fdab7867cdb (dataset): DatasetConfig { id: 7b24af1c-bc1d-4909-9d1a-7fdab7867cdb (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b55efe1-0a12-4f7f-917b-894f93acfe56 (dataset): DatasetConfig { id: 7b55efe1-0a12-4f7f-917b-894f93acfe56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a14950-af66-429b-8c73-90fc62207846 (dataset): DatasetConfig { id: 85a14950-af66-429b-8c73-90fc62207846 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86dd52c9-a66e-41db-8f37-7fda474f2b29 (dataset): DatasetConfig { id: 86dd52c9-a66e-41db-8f37-7fda474f2b29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a062886-c337-4a4b-8ede-ee75f500eea9 (dataset): DatasetConfig { id: 8a062886-c337-4a4b-8ede-ee75f500eea9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d74d4de-07a1-4476-a0e4-d45fd3c93adc (dataset): DatasetConfig { id: 8d74d4de-07a1-4476-a0e4-d45fd3c93adc (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ddc3e3b-6cc7-41f0-8650-d1381a1031f6 (dataset): DatasetConfig { id: 8ddc3e3b-6cc7-41f0-8650-d1381a1031f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8f881c91-a70f-4e29-9ac1-ff5c6552703d (dataset): DatasetConfig { id: 8f881c91-a70f-4e29-9ac1-ff5c6552703d (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92387410-7954-4482-ac14-a61a07996780 (dataset): DatasetConfig { id: 92387410-7954-4482-ac14-a61a07996780 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92d0b669-8bdb-4d71-8ed1-c0e965a8f111 (dataset): DatasetConfig { id: 92d0b669-8bdb-4d71-8ed1-c0e965a8f111 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9392ad5e-c079-40b7-b614-dd1b7f1474b3 (dataset): DatasetConfig { id: 9392ad5e-c079-40b7-b614-dd1b7f1474b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94616029-e3f5-40e9-8040-e5023e6ad259 (dataset): DatasetConfig { id: 94616029-e3f5-40e9-8040-e5023e6ad259 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9d170b2e-fc46-4e04-9663-c835ba2851ad (dataset): DatasetConfig { id: 9d170b2e-fc46-4e04-9663-c835ba2851ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3f1d14e-3e42-41b9-8808-e2f8501f4f48 (dataset): DatasetConfig { id: a3f1d14e-3e42-41b9-8808-e2f8501f4f48 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4c39f0e-2a23-46ee-bec2-880ba0e479d4 (dataset): DatasetConfig { id: a4c39f0e-2a23-46ee-bec2-880ba0e479d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a79210e5-59ec-48ed-9bd6-bbf14e04ca78 (dataset): DatasetConfig { id: a79210e5-59ec-48ed-9bd6-bbf14e04ca78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa771307-f5a6-4830-b67a-7a9868dfc5d4 (dataset): DatasetConfig { id: aa771307-f5a6-4830-b67a-7a9868dfc5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afd8ed05-81d5-4743-ac89-eb4aea5c28ff (dataset): DatasetConfig { id: afd8ed05-81d5-4743-ac89-eb4aea5c28ff (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7208f79-9e50-4cea-84d0-43b6c4354bc3 (dataset): DatasetConfig { id: b7208f79-9e50-4cea-84d0-43b6c4354bc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbd77f05-2941-4d62-bf63-05233c86d973 (dataset): DatasetConfig { id: bbd77f05-2941-4d62-bf63-05233c86d973 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc055b53-7049-48a4-9664-fb91e0fa7bfe (dataset): DatasetConfig { id: bc055b53-7049-48a4-9664-fb91e0fa7bfe (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfd28ae2-9460-4d12-94ec-f24bff8501d4 (dataset): DatasetConfig { id: bfd28ae2-9460-4d12-94ec-f24bff8501d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8777ed9-0ae3-42e2-87f2-10a5221b1855 (dataset): DatasetConfig { id: c8777ed9-0ae3-42e2-87f2-10a5221b1855 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d12a3491-e639-4681-b151-5c3275dcb996 (dataset): DatasetConfig { id: d12a3491-e639-4681-b151-5c3275dcb996 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7381196-773e-4151-8f99-ecb79ef41590 (dataset): DatasetConfig { id: d7381196-773e-4151-8f99-ecb79ef41590 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc21e23a-6888-4c89-804c-8f72b8cc50c5 (dataset): DatasetConfig { id: dc21e23a-6888-4c89-804c-8f72b8cc50c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e0088f25-8e1e-475b-aa1d-d523defe311d (dataset): DatasetConfig { id: e0088f25-8e1e-475b-aa1d-d523defe311d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e06f0984-3a7a-4eaf-9ee8-2c502e9e9337 (dataset): DatasetConfig { id: e06f0984-3a7a-4eaf-9ee8-2c502e9e9337 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_371fea12-332e-4334-902e-d2154e69e006" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e11cbe5b-e8dc-4657-ac1b-613a7a92710a (dataset): DatasetConfig { id: e11cbe5b-e8dc-4657-ac1b-613a7a92710a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3aaf09f-d9d3-4dc3-bbe8-86c4b8ba117f (dataset): DatasetConfig { id: e3aaf09f-d9d3-4dc3-bbe8-86c4b8ba117f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5f86e36-215a-4b46-a78f-8b4d24cd481a (dataset): DatasetConfig { id: e5f86e36-215a-4b46-a78f-8b4d24cd481a (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec0a8f16-cc8f-4126-b88b-20ee6c85669d (dataset): DatasetConfig { id: ec0a8f16-cc8f-4126-b88b-20ee6c85669d (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edc1062a-8904-417b-bf62-01ad9eeef321 (dataset): DatasetConfig { id: edc1062a-8904-417b-bf62-01ad9eeef321 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462024-12-20T22:52:02.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51068
4472024-12-20T22:52:02.270ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
4482024-12-20T22:52:02.270ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01d75066-40dc-4d91-b007-844431939b1a (dataset): DatasetConfig { id: 01d75066-40dc-4d91-b007-844431939b1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0286033c-eff8-457e-9bd5-eddd6076fd15 (dataset): DatasetConfig { id: 0286033c-eff8-457e-9bd5-eddd6076fd15 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0580d385-9610-4cb3-a672-9218efa9eb18 (dataset): DatasetConfig { id: 0580d385-9610-4cb3-a672-9218efa9eb18 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05d8299a-6954-4d19-bf2e-cf42fd4d11e1 (dataset): DatasetConfig { id: 05d8299a-6954-4d19-bf2e-cf42fd4d11e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 088021da-1e31-4d7b-8d3f-eb4dd574d17c (dataset): DatasetConfig { id: 088021da-1e31-4d7b-8d3f-eb4dd574d17c (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 116b3a5d-c7b2-4abc-be3f-735849ab210c (dataset): DatasetConfig { id: 116b3a5d-c7b2-4abc-be3f-735849ab210c (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 139c5fa9-09d2-4e00-83f4-0e6b8cbdccda (dataset): DatasetConfig { id: 139c5fa9-09d2-4e00-83f4-0e6b8cbdccda (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20018a1e-a65d-48bd-a856-ceb577f94d91 (dataset): DatasetConfig { id: 20018a1e-a65d-48bd-a856-ceb577f94d91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23085d96-8272-4f23-bfe4-84507f0667c9 (dataset): DatasetConfig { id: 23085d96-8272-4f23-bfe4-84507f0667c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 23d64322-5932-4734-94ba-da958c83f045 (dataset): DatasetConfig { id: 23d64322-5932-4734-94ba-da958c83f045 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 241b92c0-ff03-4758-893b-a8b5f7a8f531 (dataset): DatasetConfig { id: 241b92c0-ff03-4758-893b-a8b5f7a8f531 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25e8c3cc-dd34-417a-8dc2-3ac51c319807 (dataset): DatasetConfig { id: 25e8c3cc-dd34-417a-8dc2-3ac51c319807 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b224e9d-d479-4712-a4b8-3de83c3b4888 (dataset): DatasetConfig { id: 2b224e9d-d479-4712-a4b8-3de83c3b4888 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cbc6c03-6fde-45b5-80b3-94065eec0609 (dataset): DatasetConfig { id: 2cbc6c03-6fde-45b5-80b3-94065eec0609 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 33d9e9c4-8d9e-4eec-8307-d7c68d8cec0b (dataset): DatasetConfig { id: 33d9e9c4-8d9e-4eec-8307-d7c68d8cec0b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33dd13fc-3a86-49f2-a4fd-a61f4dc33555 (dataset): DatasetConfig { id: 33dd13fc-3a86-49f2-a4fd-a61f4dc33555 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38e1e043-c59f-4e68-b26e-8bc970b0889c (dataset): DatasetConfig { id: 38e1e043-c59f-4e68-b26e-8bc970b0889c (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 390ee389-1f8d-46d4-b489-f4a84b0b9289 (dataset): DatasetConfig { id: 390ee389-1f8d-46d4-b489-f4a84b0b9289 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3de76ed3-7fc9-4cf4-8038-555ad149c869 (dataset): DatasetConfig { id: 3de76ed3-7fc9-4cf4-8038-555ad149c869 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e6211c5-c16d-4f00-8186-7c7bcd0d7e81 (dataset): DatasetConfig { id: 3e6211c5-c16d-4f00-8186-7c7bcd0d7e81 (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 416e7b96-8a27-4984-bc81-ce8ad130070d (dataset): DatasetConfig { id: 416e7b96-8a27-4984-bc81-ce8ad130070d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 458ab9e8-76ef-48bf-919b-d37f03151275 (dataset): DatasetConfig { id: 458ab9e8-76ef-48bf-919b-d37f03151275 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46ab0de4-0194-4e18-91ea-c606285e73a7 (dataset): DatasetConfig { id: 46ab0de4-0194-4e18-91ea-c606285e73a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a111bbf-1413-46f4-806f-db018ce09e22 (dataset): DatasetConfig { id: 4a111bbf-1413-46f4-806f-db018ce09e22 (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4c8a1b0c-820e-4b5b-b74e-c1b3fe1099a6 (dataset): DatasetConfig { id: 4c8a1b0c-820e-4b5b-b74e-c1b3fe1099a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f2c1b10-5b86-45f3-9bd1-20b9e8a610c1 (dataset): DatasetConfig { id: 4f2c1b10-5b86-45f3-9bd1-20b9e8a610c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66e4a657-4334-4cdd-b3c1-d7541f900551 (dataset): DatasetConfig { id: 66e4a657-4334-4cdd-b3c1-d7541f900551 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69982497-2df8-462e-89e2-01b9649c64cc (dataset): DatasetConfig { id: 69982497-2df8-462e-89e2-01b9649c64cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b69029b-6714-4dea-b1b2-374ba185464b (dataset): DatasetConfig { id: 6b69029b-6714-4dea-b1b2-374ba185464b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c368d12-c0e6-417d-a571-e71f51103bec (dataset): DatasetConfig { id: 6c368d12-c0e6-417d-a571-e71f51103bec (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6e1816af-3ea0-4629-9b0c-cd8e47e70ceb (dataset): DatasetConfig { id: 6e1816af-3ea0-4629-9b0c-cd8e47e70ceb (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ee0f1aa-f191-45f4-81b7-80076e11a973 (dataset): DatasetConfig { id: 6ee0f1aa-f191-45f4-81b7-80076e11a973 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 744ac255-8682-407a-a13d-20ac9699ee11 (dataset): DatasetConfig { id: 744ac255-8682-407a-a13d-20ac9699ee11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b24af1c-bc1d-4909-9d1a-7fdab7867cdb (dataset): DatasetConfig { id: 7b24af1c-bc1d-4909-9d1a-7fdab7867cdb (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b55efe1-0a12-4f7f-917b-894f93acfe56 (dataset): DatasetConfig { id: 7b55efe1-0a12-4f7f-917b-894f93acfe56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85a14950-af66-429b-8c73-90fc62207846 (dataset): DatasetConfig { id: 85a14950-af66-429b-8c73-90fc62207846 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86dd52c9-a66e-41db-8f37-7fda474f2b29 (dataset): DatasetConfig { id: 86dd52c9-a66e-41db-8f37-7fda474f2b29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a062886-c337-4a4b-8ede-ee75f500eea9 (dataset): DatasetConfig { id: 8a062886-c337-4a4b-8ede-ee75f500eea9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d74d4de-07a1-4476-a0e4-d45fd3c93adc (dataset): DatasetConfig { id: 8d74d4de-07a1-4476-a0e4-d45fd3c93adc (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ddc3e3b-6cc7-41f0-8650-d1381a1031f6 (dataset): DatasetConfig { id: 8ddc3e3b-6cc7-41f0-8650-d1381a1031f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8f881c91-a70f-4e29-9ac1-ff5c6552703d (dataset): DatasetConfig { id: 8f881c91-a70f-4e29-9ac1-ff5c6552703d (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92387410-7954-4482-ac14-a61a07996780 (dataset): DatasetConfig { id: 92387410-7954-4482-ac14-a61a07996780 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92d0b669-8bdb-4d71-8ed1-c0e965a8f111 (dataset): DatasetConfig { id: 92d0b669-8bdb-4d71-8ed1-c0e965a8f111 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9392ad5e-c079-40b7-b614-dd1b7f1474b3 (dataset): DatasetConfig { id: 9392ad5e-c079-40b7-b614-dd1b7f1474b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94616029-e3f5-40e9-8040-e5023e6ad259 (dataset): DatasetConfig { id: 94616029-e3f5-40e9-8040-e5023e6ad259 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9d170b2e-fc46-4e04-9663-c835ba2851ad (dataset): DatasetConfig { id: 9d170b2e-fc46-4e04-9663-c835ba2851ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3f1d14e-3e42-41b9-8808-e2f8501f4f48 (dataset): DatasetConfig { id: a3f1d14e-3e42-41b9-8808-e2f8501f4f48 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4c39f0e-2a23-46ee-bec2-880ba0e479d4 (dataset): DatasetConfig { id: a4c39f0e-2a23-46ee-bec2-880ba0e479d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a79210e5-59ec-48ed-9bd6-bbf14e04ca78 (dataset): DatasetConfig { id: a79210e5-59ec-48ed-9bd6-bbf14e04ca78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa771307-f5a6-4830-b67a-7a9868dfc5d4 (dataset): DatasetConfig { id: aa771307-f5a6-4830-b67a-7a9868dfc5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afd8ed05-81d5-4743-ac89-eb4aea5c28ff (dataset): DatasetConfig { id: afd8ed05-81d5-4743-ac89-eb4aea5c28ff (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7208f79-9e50-4cea-84d0-43b6c4354bc3 (dataset): DatasetConfig { id: b7208f79-9e50-4cea-84d0-43b6c4354bc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbd77f05-2941-4d62-bf63-05233c86d973 (dataset): DatasetConfig { id: bbd77f05-2941-4d62-bf63-05233c86d973 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc055b53-7049-48a4-9664-fb91e0fa7bfe (dataset): DatasetConfig { id: bc055b53-7049-48a4-9664-fb91e0fa7bfe (dataset), name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfd28ae2-9460-4d12-94ec-f24bff8501d4 (dataset): DatasetConfig { id: bfd28ae2-9460-4d12-94ec-f24bff8501d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c8777ed9-0ae3-42e2-87f2-10a5221b1855 (dataset): DatasetConfig { id: c8777ed9-0ae3-42e2-87f2-10a5221b1855 (dataset), name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d12a3491-e639-4681-b151-5c3275dcb996 (dataset): DatasetConfig { id: d12a3491-e639-4681-b151-5c3275dcb996 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7381196-773e-4151-8f99-ecb79ef41590 (dataset): DatasetConfig { id: d7381196-773e-4151-8f99-ecb79ef41590 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc21e23a-6888-4c89-804c-8f72b8cc50c5 (dataset): DatasetConfig { id: dc21e23a-6888-4c89-804c-8f72b8cc50c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e0088f25-8e1e-475b-aa1d-d523defe311d (dataset): DatasetConfig { id: e0088f25-8e1e-475b-aa1d-d523defe311d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e06f0984-3a7a-4eaf-9ee8-2c502e9e9337 (dataset): DatasetConfig { id: e06f0984-3a7a-4eaf-9ee8-2c502e9e9337 (dataset), name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_371fea12-332e-4334-902e-d2154e69e006" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e11cbe5b-e8dc-4657-ac1b-613a7a92710a (dataset): DatasetConfig { id: e11cbe5b-e8dc-4657-ac1b-613a7a92710a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e3aaf09f-d9d3-4dc3-bbe8-86c4b8ba117f (dataset): DatasetConfig { id: e3aaf09f-d9d3-4dc3-bbe8-86c4b8ba117f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5f86e36-215a-4b46-a78f-8b4d24cd481a (dataset): DatasetConfig { id: e5f86e36-215a-4b46-a78f-8b4d24cd481a (dataset), name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec0a8f16-cc8f-4126-b88b-20ee6c85669d (dataset): DatasetConfig { id: ec0a8f16-cc8f-4126-b88b-20ee6c85669d (dataset), name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edc1062a-8904-417b-bf62-01ad9eeef321 (dataset): DatasetConfig { id: edc1062a-8904-417b-bf62-01ad9eeef321 (dataset), name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4492024-12-20T22:52:02.270ZINFOSledAgent (StorageManager): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502024-12-20T22:52:02.270ZINFOSledAgent (StorageManager): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512024-12-20T22:52:02.270ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4522024-12-20T22:52:02.285ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532024-12-20T22:52:02.285ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542024-12-20T22:52:02.285ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4552024-12-20T22:52:02.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562024-12-20T22:52:02.333ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572024-12-20T22:52:02.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4582024-12-20T22:52:02.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592024-12-20T22:52:02.380ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4602024-12-20T22:52:02.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone" } file = sled-storage/src/manager.rs:1431
4612024-12-20T22:52:02.407ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622024-12-20T22:52:02.407ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4632024-12-20T22:52:02.407ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone"), full_name: "oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone" } file = sled-storage/src/manager.rs:1431
4642024-12-20T22:52:02.436ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652024-12-20T22:52:02.436ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4662024-12-20T22:52:02.436ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/debug"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/debug" } file = sled-storage/src/manager.rs:1431
4672024-12-20T22:52:02.463ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682024-12-20T22:52:02.463ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692024-12-20T22:52:02.463ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4702024-12-20T22:52:02.508ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712024-12-20T22:52:02.509ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722024-12-20T22:52:02.509ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4732024-12-20T22:52:02.554ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742024-12-20T22:52:02.554ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752024-12-20T22:52:02.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone/oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone/oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34" } file = sled-storage/src/manager.rs:1431
4762024-12-20T22:52:02.611ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772024-12-20T22:52:02.611ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782024-12-20T22:52:02.611ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone/oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352"), full_name: "oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone/oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352" } file = sled-storage/src/manager.rs:1431
4792024-12-20T22:52:02.665ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802024-12-20T22:52:02.665ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4812024-12-20T22:52:02.665ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/debug"), full_name: "oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/debug" } file = sled-storage/src/manager.rs:1431
4822024-12-20T22:52:02.692ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832024-12-20T22:52:02.692ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842024-12-20T22:52:02.692ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044" } file = sled-storage/src/manager.rs:1431
4852024-12-20T22:52:02.746ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862024-12-20T22:52:02.746ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872024-12-20T22:52:02.746ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782" } file = sled-storage/src/manager.rs:1431
4882024-12-20T22:52:02.802ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892024-12-20T22:52:02.802ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902024-12-20T22:52:02.802ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365" } file = sled-storage/src/manager.rs:1431
4912024-12-20T22:52:02.858ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922024-12-20T22:52:02.858ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4932024-12-20T22:52:02.858ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/debug"), full_name: "oxp_091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/debug" } file = sled-storage/src/manager.rs:1431
4942024-12-20T22:52:02.885ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952024-12-20T22:52:02.885ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962024-12-20T22:52:02.885ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone/oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone/oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729" } file = sled-storage/src/manager.rs:1431
4972024-12-20T22:52:02.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982024-12-20T22:52:02.940ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4992024-12-20T22:52:02.940ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff" } file = sled-storage/src/manager.rs:1431
5002024-12-20T22:52:02.995ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012024-12-20T22:52:02.995ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022024-12-20T22:52:02.995ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5032024-12-20T22:52:03.043ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042024-12-20T22:52:03.043ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5052024-12-20T22:52:03.043ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/zone"), full_name: "oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/zone" } file = sled-storage/src/manager.rs:1431
5062024-12-20T22:52:03.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072024-12-20T22:52:03.072ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082024-12-20T22:52:03.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5092024-12-20T22:52:03.117ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102024-12-20T22:52:03.117ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5112024-12-20T22:52:03.117ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/zone"), full_name: "oxp_b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/zone" } file = sled-storage/src/manager.rs:1431
5122024-12-20T22:52:03.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132024-12-20T22:52:03.144ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142024-12-20T22:52:03.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5152024-12-20T22:52:03.190ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162024-12-20T22:52:03.190ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172024-12-20T22:52:03.190ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6" } file = sled-storage/src/manager.rs:1431
5182024-12-20T22:52:03.236ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
5192024-12-20T22:52:03.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202024-12-20T22:52:03.244ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212024-12-20T22:52:03.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/zone/oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03"), full_name: "oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/zone/oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03" } file = sled-storage/src/manager.rs:1431
5222024-12-20T22:52:03.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232024-12-20T22:52:03.299ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5242024-12-20T22:52:03.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/debug"), full_name: "oxp_b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/debug" } file = sled-storage/src/manager.rs:1431
5252024-12-20T22:52:03.326ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262024-12-20T22:52:03.326ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5272024-12-20T22:52:03.326ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5282024-12-20T22:52:03.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292024-12-20T22:52:03.352ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5302024-12-20T22:52:03.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone"), full_name: "oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone" } file = sled-storage/src/manager.rs:1431
5312024-12-20T22:52:03.379ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322024-12-20T22:52:03.379ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332024-12-20T22:52:03.379ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549" } file = sled-storage/src/manager.rs:1431
5342024-12-20T22:52:03.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352024-12-20T22:52:03.438ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362024-12-20T22:52:03.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae/crucible" } file = sled-storage/src/manager.rs:1431
5372024-12-20T22:52:03.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382024-12-20T22:52:03.485ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5392024-12-20T22:52:03.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone/oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/zone/oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a" } file = sled-storage/src/manager.rs:1431
5402024-12-20T22:52:03.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412024-12-20T22:52:03.544ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422024-12-20T22:52:03.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641" } file = sled-storage/src/manager.rs:1431
5432024-12-20T22:52:03.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442024-12-20T22:52:03.603ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5452024-12-20T22:52:03.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crucible" } file = sled-storage/src/manager.rs:1431
5462024-12-20T22:52:03.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472024-12-20T22:52:03.649ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5482024-12-20T22:52:03.649ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c" } file = sled-storage/src/manager.rs:1431
5492024-12-20T22:52:03.707ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502024-12-20T22:52:03.707ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512024-12-20T22:52:03.707ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone/oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4" } file = sled-storage/src/manager.rs:1431
5522024-12-20T22:52:03.766ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532024-12-20T22:52:03.766ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542024-12-20T22:52:03.766ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd" } file = sled-storage/src/manager.rs:1431
5552024-12-20T22:52:03.824ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562024-12-20T22:52:03.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5572024-12-20T22:52:03.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_091028cb-f478-4341-abae-5f1e6cecc3ba/crucible" } file = sled-storage/src/manager.rs:1431
5582024-12-20T22:52:03.871ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592024-12-20T22:52:03.871ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602024-12-20T22:52:03.871ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5612024-12-20T22:52:03.921ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622024-12-20T22:52:03.921ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632024-12-20T22:52:03.921ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone/oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317"), full_name: "oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone/oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317" } file = sled-storage/src/manager.rs:1431
5642024-12-20T22:52:03.982ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652024-12-20T22:52:03.982ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662024-12-20T22:52:03.982ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone/oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a"), full_name: "oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone/oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a" } file = sled-storage/src/manager.rs:1431
5672024-12-20T22:52:04.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682024-12-20T22:52:04.046ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692024-12-20T22:52:04.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b" } file = sled-storage/src/manager.rs:1431
5702024-12-20T22:52:04.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712024-12-20T22:52:04.106ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722024-12-20T22:52:04.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/debug"), full_name: "oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/debug" } file = sled-storage/src/manager.rs:1431
5732024-12-20T22:52:04.135ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742024-12-20T22:52:04.135ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752024-12-20T22:52:04.135ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5762024-12-20T22:52:04.184ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772024-12-20T22:52:04.184ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782024-12-20T22:52:04.184ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34" } file = sled-storage/src/manager.rs:1431
5792024-12-20T22:52:04.238ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
5802024-12-20T22:52:04.246ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5812024-12-20T22:52:04.246ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5822024-12-20T22:52:04.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/debug"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/debug" } file = sled-storage/src/manager.rs:1431
5832024-12-20T22:52:04.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842024-12-20T22:52:04.274ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852024-12-20T22:52:04.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6" } file = sled-storage/src/manager.rs:1431
5862024-12-20T22:52:04.334ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872024-12-20T22:52:04.334ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5882024-12-20T22:52:04.334ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/debug"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/debug" } file = sled-storage/src/manager.rs:1431
5892024-12-20T22:52:04.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902024-12-20T22:52:04.363ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5912024-12-20T22:52:04.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crucible" } file = sled-storage/src/manager.rs:1431
5922024-12-20T22:52:04.411ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932024-12-20T22:52:04.411ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942024-12-20T22:52:04.411ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5952024-12-20T22:52:04.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962024-12-20T22:52:04.460ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972024-12-20T22:52:04.460ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4" } file = sled-storage/src/manager.rs:1431
5982024-12-20T22:52:04.520ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992024-12-20T22:52:04.520ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002024-12-20T22:52:04.520ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone/oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516"), full_name: "oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/zone/oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516" } file = sled-storage/src/manager.rs:1431
6012024-12-20T22:52:04.577ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022024-12-20T22:52:04.577ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032024-12-20T22:52:04.577ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/zone"), full_name: "oxp_091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/zone" } file = sled-storage/src/manager.rs:1431
6042024-12-20T22:52:04.608ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052024-12-20T22:52:04.608ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6062024-12-20T22:52:04.608ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21" } file = sled-storage/src/manager.rs:1431
6072024-12-20T22:52:04.669ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082024-12-20T22:52:04.669ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092024-12-20T22:52:04.669ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b960ef68-fd77-411f-b5e4-77a645524bc5/crucible" } file = sled-storage/src/manager.rs:1431
6102024-12-20T22:52:04.717ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112024-12-20T22:52:04.717ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122024-12-20T22:52:04.717ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crucible" } file = sled-storage/src/manager.rs:1431
6132024-12-20T22:52:04.766ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142024-12-20T22:52:04.766ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152024-12-20T22:52:04.766ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/zone/oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5"), full_name: "oxp_b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/zone/oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5" } file = sled-storage/src/manager.rs:1431
6162024-12-20T22:52:04.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172024-12-20T22:52:04.826ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6182024-12-20T22:52:04.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone" } file = sled-storage/src/manager.rs:1431
6192024-12-20T22:52:04.855ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202024-12-20T22:52:04.855ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6212024-12-20T22:52:04.855ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crucible" } file = sled-storage/src/manager.rs:1431
6222024-12-20T22:52:04.903ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232024-12-20T22:52:04.903ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6242024-12-20T22:52:04.903ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6252024-12-20T22:52:04.952ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262024-12-20T22:52:04.952ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272024-12-20T22:52:04.952ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crucible" } file = sled-storage/src/manager.rs:1431
6282024-12-20T22:52:05.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292024-12-20T22:52:05.000ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6302024-12-20T22:52:05.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/debug"), full_name: "oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/debug" } file = sled-storage/src/manager.rs:1431
6312024-12-20T22:52:05.029ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322024-12-20T22:52:05.029ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6332024-12-20T22:52:05.029ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/debug"), full_name: "oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/debug" } file = sled-storage/src/manager.rs:1431
6342024-12-20T22:52:05.056ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352024-12-20T22:52:05.056ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362024-12-20T22:52:05.056ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_nexus_371fea12-332e-4334-902e-d2154e69e006"), full_name: "oxp_d31b2b69-efd5-461d-912c-5052088aed91/crypt/zone/oxz_nexus_371fea12-332e-4334-902e-d2154e69e006" } file = sled-storage/src/manager.rs:1431
6372024-12-20T22:52:05.117ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382024-12-20T22:52:05.117ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6392024-12-20T22:52:05.117ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/zone" } file = sled-storage/src/manager.rs:1431
6402024-12-20T22:52:05.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412024-12-20T22:52:05.147ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422024-12-20T22:52:05.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone/oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938"), full_name: "oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/zone/oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938" } file = sled-storage/src/manager.rs:1431
6432024-12-20T22:52:05.207ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442024-12-20T22:52:05.207ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452024-12-20T22:52:05.207ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef"), full_name: "oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/zone/oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef" } file = sled-storage/src/manager.rs:1431
6462024-12-20T22:52:05.243ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
6472024-12-20T22:52:05.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6482024-12-20T22:52:05.268ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6492024-12-20T22:52:05.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crucible" } file = sled-storage/src/manager.rs:1431
6502024-12-20T22:52:05.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6512024-12-20T22:52:05.314ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6522024-12-20T22:52:05.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/zone/oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c"), full_name: "oxp_091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/zone/oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c" } file = sled-storage/src/manager.rs:1431
6532024-12-20T22:52:05.355ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 22.535296184s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
6542024-12-20T22:52:05.374ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552024-12-20T22:52:05.374ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6562024-12-20T22:52:05.375ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
6572024-12-20T22:52:05.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3104851 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51068 req_id = 227879fd-4c9d-4e50-bcb7-85c7b70583ea response_code = 200 uri = /datasets
6582024-12-20T22:52:05.406ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: c9217e92-0af3-4930-acb2-aa82ded5b782 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b4615881-2f68-4c82-be17-071bf3ae3641 (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 616ce87c-1f39-49d9-ba35-ee63b2650ecd (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6592024-12-20T22:52:05.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61938
6602024-12-20T22:52:05.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612024-12-20T22:52:05.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-20T22:52:05.418ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632024-12-20T22:52:05.418ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642024-12-20T22:52:05.428ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6652024-12-20T22:52:05.428ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6662024-12-20T22:52:05.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672024-12-20T22:52:05.439ZINFOSledAgent (ServiceManager): No ledger in /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:188
6682024-12-20T22:52:05.439ZINFOSledAgent (ServiceManager): No ledger in /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:188
6692024-12-20T22:52:05.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-20T22:52:05.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-20T22:52:05.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722024-12-20T22:52:05.484ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732024-12-20T22:52:05.537ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641 file = illumos-utils/src/zone.rs:325
6742024-12-20T22:52:05.541ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd file = illumos-utils/src/zone.rs:325
6752024-12-20T22:52:05.545ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782 file = illumos-utils/src/zone.rs:325
6762024-12-20T22:52:05.557ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641 file = illumos-utils/src/zone.rs:363
6772024-12-20T22:52:05.562ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd file = illumos-utils/src/zone.rs:363
6782024-12-20T22:52:05.566ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782 file = illumos-utils/src/zone.rs:363
6792024-12-20T22:52:06.245ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/287d6774-d3e6-4b73-8c77-c90534d4a54d) file = sled-agent/src/probe_manager.rs:231 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
6802024-12-20T22:52:07.160ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812024-12-20T22:52:07.638ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822024-12-20T22:52:07.638ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832024-12-20T22:52:07.926ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10271283568418807171 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
6842024-12-20T22:52:07.927ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7443586724712670243 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
6852024-12-20T22:52:07.928ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6862024-12-20T22:52:07.928ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6872024-12-20T22:52:07.934ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6882024-12-20T22:52:07.934ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6892024-12-20T22:52:08.077ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6902024-12-20T22:52:08.077ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6912024-12-20T22:52:08.118ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6922024-12-20T22:52:08.118ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
6932024-12-20T22:52:08.121ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6942024-12-20T22:52:08.121ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952024-12-20T22:52:08.121ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6962024-12-20T22:52:08.121ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
6972024-12-20T22:52:08.126ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
6982024-12-20T22:52:08.132ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
6992024-12-20T22:52:08.175ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7002024-12-20T22:52:08.175ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7012024-12-20T22:52:08.200ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7022024-12-20T22:52:08.200ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7032024-12-20T22:52:08.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 59.027785ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7042024-12-20T22:52:08.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 59.907631ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7052024-12-20T22:52:08.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 39.830331ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7062024-12-20T22:52:08.278ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7072024-12-20T22:52:08.278ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7082024-12-20T22:52:08.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 65.194398ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7092024-12-20T22:52:08.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 141.327709ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7102024-12-20T22:52:08.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 134.180826ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7112024-12-20T22:52:08.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 178.962768ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7122024-12-20T22:52:08.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 260.724128ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7132024-12-20T22:52:08.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 238.081297ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7142024-12-20T22:52:08.639ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7152024-12-20T22:52:08.639ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7162024-12-20T22:52:08.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 565.069738ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7172024-12-20T22:52:08.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 210.14678ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7182024-12-20T22:52:08.854ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7192024-12-20T22:52:08.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 240.061865ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7202024-12-20T22:52:08.928ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7212024-12-20T22:52:08.928ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7222024-12-20T22:52:08.929ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7232024-12-20T22:52:08.929ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7242024-12-20T22:52:09.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7252024-12-20T22:52:09.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 1.157092914s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7262024-12-20T22:52:09.069ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7272024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7292024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7312024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7332024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7352024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7372024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7392024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7412024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7432024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7452024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7472024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-20T22:52:09.069ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7492024-12-20T22:52:09.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 910.548466ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7502024-12-20T22:52:09.148ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17594947564682583980 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
7512024-12-20T22:52:09.148ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15905602940983613339 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
7522024-12-20T22:52:09.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 1.192304413s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7532024-12-20T22:52:10.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 1.096803791s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7542024-12-20T22:52:10.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 826.132639ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7552024-12-20T22:52:10.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 932.791868ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7562024-12-20T22:52:11.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 741.417981ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7572024-12-20T22:52:11.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 1.075053761s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7582024-12-20T22:52:11.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 522.656126ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7592024-12-20T22:52:11.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 1.098951464s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7602024-12-20T22:52:11.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 613.880247ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7612024-12-20T22:52:12.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 719.377083ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7622024-12-20T22:52:12.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 741.038976ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7632024-12-20T22:52:12.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 575.244633ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7642024-12-20T22:52:12.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd") failed: Property not found. retry in 1.185266799s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7652024-12-20T22:52:13.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782") failed: Property not found. retry in 1.009022204s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7662024-12-20T22:52:13.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641") failed: Property not found. retry in 537.603082ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7672024-12-20T22:52:14.379ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_b4615881-2f68-4c82-be17-071bf3ae3641
7682024-12-20T22:52:14.379ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_616ce87c-1f39-49d9-ba35-ee63b2650ecd
7692024-12-20T22:52:14.379ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_c9217e92-0af3-4930-acb2-aa82ded5b782
7702024-12-20T22:52:14.379ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712024-12-20T22:52:14.379ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722024-12-20T22:52:14.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8972903 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61938 req_id = b32e7cb1-8158-49ea-99db-8bf27831b2ef response_code = 204 uri = /omicron-zones
7732024-12-20T22:52:14.381ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742024-12-20T22:52:14.605ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 135.334427ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7752024-12-20T22:52:14.760ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762024-12-20T22:52:14.808ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772024-12-20T22:52:14.856ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7782024-12-20T22:52:14.856ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7792024-12-20T22:52:14.889ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7802024-12-20T22:52:14.890ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7812024-12-20T22:52:14.890ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7822024-12-20T22:52:14.919ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: c9217e92-0af3-4930-acb2-aa82ded5b782 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b4615881-2f68-4c82-be17-071bf3ae3641 (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 616ce87c-1f39-49d9-ba35-ee63b2650ecd (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a1d65efc-8c5b-4054-ab83-86dc3912524b (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9a24d213-6f32-45df-8585-e2d30f4d0ac6, kind: Service { id: a1d65efc-8c5b-4054-ab83-86dc3912524b }, name: Name("ntp-a1d65efc-8c5b-4054-ab83-86dc3912524b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 87])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7832024-12-20T22:52:14.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64728
7842024-12-20T22:52:14.919ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-20T22:52:14.919ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-20T22:52:14.931ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872024-12-20T22:52:14.931ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882024-12-20T22:52:14.942ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7892024-12-20T22:52:14.942ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902024-12-20T22:52:14.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912024-12-20T22:52:14.951ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
7922024-12-20T22:52:14.951ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
7932024-12-20T22:52:14.951ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7942024-12-20T22:52:14.963ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7952024-12-20T22:52:14.995ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7962024-12-20T22:52:14.996ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7972024-12-20T22:52:14.996ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7982024-12-20T22:52:15.025ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 173, 87]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7992024-12-20T22:52:15.025ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8002024-12-20T22:52:15.025ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8012024-12-20T22:52:15.026ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8022024-12-20T22:52:15.026ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8032024-12-20T22:52:15.026ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8042024-12-20T22:52:15.052ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b file = illumos-utils/src/zone.rs:325
8052024-12-20T22:52:15.072ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b file = illumos-utils/src/zone.rs:363
8062024-12-20T22:52:15.696ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8072024-12-20T22:52:15.696ZINFOSledAgent (ServiceManager): Booting oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8082024-12-20T22:52:15.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 35.157983ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8092024-12-20T22:52:15.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 117.115991ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8102024-12-20T22:52:16.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 254.685876ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8112024-12-20T22:52:16.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 331.805178ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8122024-12-20T22:52:16.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 1.109520066s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8132024-12-20T22:52:17.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 505.931519ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8142024-12-20T22:52:17.928ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10271283568418807171 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8152024-12-20T22:52:17.928ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7443586724712670243 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8162024-12-20T22:52:18.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 727.452123ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8172024-12-20T22:52:18.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 609.798592ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8182024-12-20T22:52:19.150ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17594947564682583980 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8192024-12-20T22:52:19.150ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15905602940983613339 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8202024-12-20T22:52:19.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b") failed: Property not found. retry in 1.299795283s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8212024-12-20T22:52:20.928ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b
8222024-12-20T22:52:20.929ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232024-12-20T22:52:20.929ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8242024-12-20T22:52:20.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6009978 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64728 req_id = 2875a4c5-c9bb-484d-bc8e-88ccae644ac8 response_code = 204 uri = /omicron-zones
8252024-12-20T22:52:20.931ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8262024-12-20T22:52:20.961ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272024-12-20T22:52:20.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38752
8282024-12-20T22:52:20.970ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8292024-12-20T22:52:20.970ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8880 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38752 req_id = 3f3c2942-1272-4001-ad62-1dbd2f1bfd57 response_code = 500 uri = /timesync
8302024-12-20T22:52:20.972ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312024-12-20T22:52:21.147ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322024-12-20T22:52:21.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42336
8332024-12-20T22:52:24.055ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5692995288034464642 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8342024-12-20T22:52:24.192ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 319337326805842175 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8352024-12-20T22:52:24.381ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13505445751617812191 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8362024-12-20T22:52:25.155ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8372024-12-20T22:52:25.155ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42336 req_id = 5c6abe8d-a083-4045-9a4b-e34bd44deb27 response_code = 500 uri = /timesync
8382024-12-20T22:52:25.158ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392024-12-20T22:52:25.301ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402024-12-20T22:52:25.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42779
8412024-12-20T22:52:25.310ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8422024-12-20T22:52:25.310ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8723 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42779 req_id = f4327e58-3b24-46e0-afe8-18348a07ead1 response_code = 500 uri = /timesync
8432024-12-20T22:52:25.312ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442024-12-20T22:52:25.496ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8452024-12-20T22:52:25.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57076
8462024-12-20T22:52:28.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10271283568418807171 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8472024-12-20T22:52:28.224ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7443586724712670243 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8482024-12-20T22:52:29.446ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17594947564682583980 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8492024-12-20T22:52:29.446ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15905602940983613339 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8502024-12-20T22:52:29.799ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a1d65efc-8c5b-4054-ab83-86dc3912524b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8512024-12-20T22:52:29.799ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008649 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57076 req_id = a5eb973d-b236-453d-8328-18810e9ac380 response_code = 500 uri = /timesync
8522024-12-20T22:52:29.800ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532024-12-20T22:52:30.048ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542024-12-20T22:52:30.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60401
8552024-12-20T22:52:30.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8851 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60401 req_id = e64e44b9-ab30-4fb0-8ad8-8362800c0327 response_code = 200 uri = /timesync
8562024-12-20T22:52:30.059ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.044708911 } file = sled-agent/src/rack_setup/service.rs:743
8572024-12-20T22:52:30.059ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582024-12-20T22:52:30.289ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592024-12-20T22:52:30.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44213
8602024-12-20T22:52:30.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44213 req_id = b58ddaea-9d50-44ee-933f-7d1804cdf677 response_code = 200 uri = /timesync
8612024-12-20T22:52:30.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.044055637 } file = sled-agent/src/rack_setup/service.rs:743
8622024-12-20T22:52:30.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632024-12-20T22:52:30.691ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642024-12-20T22:52:30.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65138
8652024-12-20T22:52:30.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8075 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65138 req_id = cca512aa-3ede-4dbd-b7e8-fb77dae04c2e response_code = 200 uri = /timesync
8662024-12-20T22:52:30.701ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.044319406 } file = sled-agent/src/rack_setup/service.rs:743
8672024-12-20T22:52:30.701ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682024-12-20T22:52:31.075ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8692024-12-20T22:52:31.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45519
8702024-12-20T22:52:31.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7703 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45519 req_id = c6c2cf7c-b20b-47eb-92c1-fb54d131598e response_code = 200 uri = /timesync
8712024-12-20T22:52:31.084ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.043278497 } file = sled-agent/src/rack_setup/service.rs:743
8722024-12-20T22:52:31.084ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732024-12-20T22:52:31.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6019722881875211169 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8742024-12-20T22:52:31.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5657085563208417869 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
8752024-12-20T22:52:31.477ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762024-12-20T22:52:31.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41292
8772024-12-20T22:52:31.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8856 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41292 req_id = 1c68e431-321c-412c-93c1-bb7639ed11ed response_code = 200 uri = /timesync
8782024-12-20T22:52:31.488ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.042182188 } file = sled-agent/src/rack_setup/service.rs:743
8792024-12-20T22:52:31.488ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802024-12-20T22:52:32.116ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812024-12-20T22:52:32.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54525
8822024-12-20T22:52:32.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54525 req_id = e2c1b22d-e644-43c6-b714-ecc0e1290bdb response_code = 200 uri = /timesync
8832024-12-20T22:52:32.128ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.041214425 } file = sled-agent/src/rack_setup/service.rs:743
8842024-12-20T22:52:32.128ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852024-12-20T22:52:32.619ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8862024-12-20T22:52:32.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41433
8872024-12-20T22:52:32.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7421 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41433 req_id = 3316286a-9b8a-42f5-b0b5-967ce9333c94 response_code = 200 uri = /timesync
8882024-12-20T22:52:32.630ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.039849855 } file = sled-agent/src/rack_setup/service.rs:743
8892024-12-20T22:52:32.630ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8902024-12-20T22:52:32.973ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8912024-12-20T22:52:32.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55427
8922024-12-20T22:52:32.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21958 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55427 req_id = f4f0bd2e-4d61-45ff-848b-39ba7860d0f0 response_code = 200 uri = /timesync
8932024-12-20T22:52:33.000ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2180654074, ip_addr: 129.250.35.250, stratum: 3, ref_time: 1734735151.9941828, correction: -0.039104439 } file = sled-agent/src/rack_setup/service.rs:743
8942024-12-20T22:52:33.000ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8952024-12-20T22:52:33.031ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: c9217e92-0af3-4930-acb2-aa82ded5b782 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b4615881-2f68-4c82-be17-071bf3ae3641 (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 616ce87c-1f39-49d9-ba35-ee63b2650ecd (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a1d65efc-8c5b-4054-ab83-86dc3912524b (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9a24d213-6f32-45df-8585-e2d30f4d0ac6, kind: Service { id: a1d65efc-8c5b-4054-ab83-86dc3912524b }, name: Name("ntp-a1d65efc-8c5b-4054-ab83-86dc3912524b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 87])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: cef219f4-803f-44d1-825d-a03c397ee549 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } } } }, OmicronZoneConfig { id: e1881582-7379-49df-ba66-7fe840bc43e6 (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: cc8a4f81-b3e1-4d38-b0cd-dd95268f2044 (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8495c476-f0e2-42d8-8c07-30140d34050a (service), filesystem_pool: Some(ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8fb0b808-9a63-4ec6-89cb-be622f5f1516 (service), filesystem_pool: Some(ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8962024-12-20T22:52:33.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35631
8972024-12-20T22:52:33.031ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8982024-12-20T22:52:33.031ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
8992024-12-20T22:52:33.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9002024-12-20T22:52:33.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9012024-12-20T22:52:33.050ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9022024-12-20T22:52:33.050ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9032024-12-20T22:52:33.059ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9042024-12-20T22:52:33.059ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052024-12-20T22:52:33.067ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9062024-12-20T22:52:33.067ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072024-12-20T22:52:33.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9082024-12-20T22:52:33.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092024-12-20T22:52:33.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9102024-12-20T22:52:33.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9112024-12-20T22:52:33.096ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9122024-12-20T22:52:33.096ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9132024-12-20T22:52:33.104ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9142024-12-20T22:52:33.104ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
9152024-12-20T22:52:33.104ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
9162024-12-20T22:52:33.104ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172024-12-20T22:52:33.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9182024-12-20T22:52:33.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9192024-12-20T22:52:33.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202024-12-20T22:52:33.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212024-12-20T22:52:33.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9222024-12-20T22:52:33.278ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6 file = illumos-utils/src/zone.rs:325
9232024-12-20T22:52:33.282ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549 file = illumos-utils/src/zone.rs:325
9242024-12-20T22:52:33.286ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a file = illumos-utils/src/zone.rs:325
9252024-12-20T22:52:33.291ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516 file = illumos-utils/src/zone.rs:325
9262024-12-20T22:52:33.295ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044 file = illumos-utils/src/zone.rs:325
9272024-12-20T22:52:33.300ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6 file = illumos-utils/src/zone.rs:363
9282024-12-20T22:52:33.305ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549 file = illumos-utils/src/zone.rs:363
9292024-12-20T22:52:33.309ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a file = illumos-utils/src/zone.rs:363
9302024-12-20T22:52:33.314ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516 file = illumos-utils/src/zone.rs:363
9312024-12-20T22:52:33.319ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044 file = illumos-utils/src/zone.rs:363
9322024-12-20T22:52:37.403ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cc8a4f81-b3e1-4d38-b0cd-dd95268f2044'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9332024-12-20T22:52:37.404ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9342024-12-20T22:52:37.414ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cef219f4-803f-44d1-825d-a03c397ee549'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9352024-12-20T22:52:37.414ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9362024-12-20T22:52:37.469ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8fb0b808-9a63-4ec6-89cb-be622f5f1516'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9372024-12-20T22:52:37.469ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9382024-12-20T22:52:37.533ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8495c476-f0e2-42d8-8c07-30140d34050a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9392024-12-20T22:52:37.533ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9402024-12-20T22:52:37.558ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e1881582-7379-49df-ba66-7fe840bc43e6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9412024-12-20T22:52:37.558ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9422024-12-20T22:52:37.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 44.755563ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9432024-12-20T22:52:37.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 44.540773ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9442024-12-20T22:52:37.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 31.908662ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9452024-12-20T22:52:37.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 66.050706ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9462024-12-20T22:52:37.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 131.608622ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9472024-12-20T22:52:37.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 111.672075ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9482024-12-20T22:52:37.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 178.226677ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9492024-12-20T22:52:37.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 34.742465ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9502024-12-20T22:52:37.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 39.092146ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9512024-12-20T22:52:37.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 144.097278ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9522024-12-20T22:52:37.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 135.540772ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9532024-12-20T22:52:37.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 213.683749ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9542024-12-20T22:52:37.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 116.9821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9552024-12-20T22:52:37.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 484.915631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9562024-12-20T22:52:37.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 132.63762ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9572024-12-20T22:52:37.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 443.209931ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9582024-12-20T22:52:37.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 252.503514ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9592024-12-20T22:52:38.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 585.866175ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9602024-12-20T22:52:38.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 317.22021ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9612024-12-20T22:52:38.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 597.364314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9622024-12-20T22:52:38.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 729.630786ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9632024-12-20T22:52:38.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 870.35395ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9642024-12-20T22:52:38.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.056282696s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9652024-12-20T22:52:38.471ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36095
9662024-12-20T22:52:38.471ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36095 req_id = f4fe5f5d-00a9-45cf-aa84-736ba53e0d16 response_code = 200 uri = /baseboard
9672024-12-20T22:52:38.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 645.90181ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9682024-12-20T22:52:38.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 472.783335ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9692024-12-20T22:52:39.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 1.181900767s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9702024-12-20T22:52:39.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 1.098090842s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9712024-12-20T22:52:39.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 621.412927ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9722024-12-20T22:52:39.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 1.41936381s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9732024-12-20T22:52:39.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.25895679s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9742024-12-20T22:52:39.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 1.021431779s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9752024-12-20T22:52:40.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 666.343944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9762024-12-20T22:52:40.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 1.048140848s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9772024-12-20T22:52:40.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 904.264434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9782024-12-20T22:52:40.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 951.530679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9792024-12-20T22:52:40.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 628.027774ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9802024-12-20T22:52:41.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 808.69507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9812024-12-20T22:52:41.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516") failed: Property not found. retry in 1.48439967s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
9822024-12-20T22:52:41.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 638.009085ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9832024-12-20T22:52:41.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.404891344s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9842024-12-20T22:52:41.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a") failed: Property not found. retry in 1.28417481s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
9852024-12-20T22:52:41.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549") failed: Property not found. retry in 1.154276228s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
9862024-12-20T22:52:42.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6") failed: Property not found. retry in 752.025664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
9872024-12-20T22:52:43.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 824.549954ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9882024-12-20T22:52:43.186ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 300.315936ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
9892024-12-20T22:52:43.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 606.231016ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9902024-12-20T22:52:44.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 955.862054ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9912024-12-20T22:52:45.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.216156513s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9922024-12-20T22:52:47.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.056452972s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9932024-12-20T22:52:48.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.331778414s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9942024-12-20T22:52:50.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 545.024143ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9952024-12-20T22:52:50.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 539.435625ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9962024-12-20T22:52:51.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 527.742051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9972024-12-20T22:52:52.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 708.745085ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9982024-12-20T22:52:52.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 684.090824ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
9992024-12-20T22:52:53.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 608.610493ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
10002024-12-20T22:52:54.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044") failed: Property not found. retry in 1.470413814s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
10012024-12-20T22:52:55.614ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_e1881582-7379-49df-ba66-7fe840bc43e6
10022024-12-20T22:52:55.614ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_cef219f4-803f-44d1-825d-a03c397ee549
10032024-12-20T22:52:55.614ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_8495c476-f0e2-42d8-8c07-30140d34050a
10042024-12-20T22:52:55.614ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_8fb0b808-9a63-4ec6-89cb-be622f5f1516
10052024-12-20T22:52:55.614ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_cc8a4f81-b3e1-4d38-b0cd-dd95268f2044
10062024-12-20T22:52:55.614ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10072024-12-20T22:52:55.617ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10082024-12-20T22:52:55.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22625340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35631 req_id = 7203daf5-9576-4399-bb9b-962957cf4f9d response_code = 204 uri = /omicron-zones
10092024-12-20T22:52:55.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38149
10102024-12-20T22:52:55.685ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3758
10112024-12-20T22:52:58.045ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10122024-12-20T22:52:58.520ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 418.224614ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
10132024-12-20T22:53:08.491ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46774
10142024-12-20T22:53:08.491ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46774 req_id = 002a0355-d490-4eea-b279-212b6a163df0 response_code = 200 uri = /baseboard
10152024-12-20T22:53:13.973ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.235399156s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
10162024-12-20T22:53:21.603ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10172024-12-20T22:53:21.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25948971 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:38149 req_id = 18954574-4754-4872-b7ba-56db9eed452d response_code = 204 uri = /cockroachdb
10182024-12-20T22:53:21.636ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: c9217e92-0af3-4930-acb2-aa82ded5b782 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b4615881-2f68-4c82-be17-071bf3ae3641 (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 616ce87c-1f39-49d9-ba35-ee63b2650ecd (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a1d65efc-8c5b-4054-ab83-86dc3912524b (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9a24d213-6f32-45df-8585-e2d30f4d0ac6, kind: Service { id: a1d65efc-8c5b-4054-ab83-86dc3912524b }, name: Name("ntp-a1d65efc-8c5b-4054-ab83-86dc3912524b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 87])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: cef219f4-803f-44d1-825d-a03c397ee549 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } } } }, OmicronZoneConfig { id: e1881582-7379-49df-ba66-7fe840bc43e6 (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: cc8a4f81-b3e1-4d38-b0cd-dd95268f2044 (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8495c476-f0e2-42d8-8c07-30140d34050a (service), filesystem_pool: Some(ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8fb0b808-9a63-4ec6-89cb-be622f5f1516 (service), filesystem_pool: Some(ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External } } } }, OmicronZoneConfig { id: ace0592c-7755-46f8-b47a-c9b6444fe64c (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 1e296b8d-6800-4056-8034-a1ec2d005fff (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 371fea12-332e-4334-902e-d2154e69e006 (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a67567ae-7026-453e-acd2-e1780994c729 (service), filesystem_pool: Some(ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 103fc383-10f6-4327-a1b1-dabac4e1e365 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 7f0f4a2d-f857-40c5-aabe-af9850ced3f6 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 6e207eac-547b-47ae-9fa3-298ca9e1fe21 (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: fbe11d1c-f2ff-4d5f-b511-b39c30520317 (service), filesystem_pool: Some(ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 3234088c-f708-4f9e-82e2-a977e0a60938 (service), filesystem_pool: Some(ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: a04d400c-5deb-499b-ad4f-6c4c1c5839d4 (service), filesystem_pool: Some(ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 833bc893-b854-453c-823c-2d1c814a99ef (service), filesystem_pool: Some(ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6f8c15e0-3bd6-49d4-ac46-62138824d5f4 (service), filesystem_pool: Some(ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External } } } }, OmicronZoneConfig { id: 236200ed-69ea-40b1-9864-080ffa271a34 (service), filesystem_pool: Some(ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External } } } }, OmicronZoneConfig { id: d152ce13-e26d-4528-854c-f36302a4159a (service), filesystem_pool: Some(ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External } } } }, OmicronZoneConfig { id: 358ade7e-7d00-40b3-a890-cdc08dcb0352 (service), filesystem_pool: Some(ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External } } } }, OmicronZoneConfig { id: ecaec90f-a64d-4293-8468-6ad99b8c3e2c (service), filesystem_pool: Some(ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External } } } }, OmicronZoneConfig { id: e8e005e1-9ef0-4928-800f-624ba83e2bc5 (service), filesystem_pool: Some(ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External } } } }, OmicronZoneConfig { id: de2736f0-9cb4-49a5-9541-e86eb4dd1a03 (service), filesystem_pool: Some(ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10192024-12-20T22:53:21.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43210
10202024-12-20T22:53:21.638ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10212024-12-20T22:53:21.638ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
10222024-12-20T22:53:21.650ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10232024-12-20T22:53:21.650ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10242024-12-20T22:53:21.661ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10252024-12-20T22:53:21.661ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10262024-12-20T22:53:21.672ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10272024-12-20T22:53:21.672ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Cockroach }, responder: ... }
10282024-12-20T22:53:21.682ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10292024-12-20T22:53:21.682ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10302024-12-20T22:53:21.693ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10312024-12-20T22:53:21.693ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10322024-12-20T22:53:21.702ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10332024-12-20T22:53:21.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10342024-12-20T22:53:21.712ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10352024-12-20T22:53:21.712ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10362024-12-20T22:53:21.721ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10372024-12-20T22:53:21.721ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10382024-12-20T22:53:21.733ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10392024-12-20T22:53:21.733ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10402024-12-20T22:53:21.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10412024-12-20T22:53:21.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10422024-12-20T22:53:21.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10432024-12-20T22:53:21.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, kind: Crucible }, responder: ... }
10442024-12-20T22:53:21.779ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10452024-12-20T22:53:21.779ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10462024-12-20T22:53:21.789ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10472024-12-20T22:53:21.789ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, kind: Crucible }, responder: ... }
10482024-12-20T22:53:21.808ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10492024-12-20T22:53:21.808ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, kind: Crucible }, responder: ... }
10502024-12-20T22:53:21.826ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10512024-12-20T22:53:21.827ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, kind: Crucible }, responder: ... }
10522024-12-20T22:53:21.838ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10532024-12-20T22:53:21.838ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10542024-12-20T22:53:21.856ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10552024-12-20T22:53:21.856ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, kind: Crucible }, responder: ... }
10562024-12-20T22:53:21.871ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10572024-12-20T22:53:21.871ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, kind: Crucible }, responder: ... }
10582024-12-20T22:53:21.887ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10592024-12-20T22:53:21.887ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, kind: Crucible }, responder: ... }
10602024-12-20T22:53:21.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10612024-12-20T22:53:21.900ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
10622024-12-20T22:53:21.901ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
10632024-12-20T22:53:21.901ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10642024-12-20T22:53:22.089ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10652024-12-20T22:53:22.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10662024-12-20T22:53:22.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10672024-12-20T22:53:22.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10682024-12-20T22:53:22.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10692024-12-20T22:53:22.090ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10702024-12-20T22:53:22.091ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10712024-12-20T22:53:22.105ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10722024-12-20T22:53:22.105ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10732024-12-20T22:53:22.106ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10742024-12-20T22:53:22.119ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10752024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10762024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10772024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10792024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10802024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10812024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10822024-12-20T22:53:22.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832024-12-20T22:53:22.314ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365 file = illumos-utils/src/zone.rs:325
10842024-12-20T22:53:22.319ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4 file = illumos-utils/src/zone.rs:325
10852024-12-20T22:53:22.324ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6 file = illumos-utils/src/zone.rs:325
10862024-12-20T22:53:22.329ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef file = illumos-utils/src/zone.rs:325
10872024-12-20T22:53:22.335ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34 file = illumos-utils/src/zone.rs:325
10882024-12-20T22:53:22.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a file = illumos-utils/src/zone.rs:325
10892024-12-20T22:53:22.505ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365 file = illumos-utils/src/zone.rs:363
10902024-12-20T22:53:22.510ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4 file = illumos-utils/src/zone.rs:363
10912024-12-20T22:53:22.514ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6 file = illumos-utils/src/zone.rs:363
10922024-12-20T22:53:22.518ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef file = illumos-utils/src/zone.rs:363
10932024-12-20T22:53:22.523ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34 file = illumos-utils/src/zone.rs:363
10942024-12-20T22:53:22.528ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a file = illumos-utils/src/zone.rs:363
10952024-12-20T22:53:22.534ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21 file = illumos-utils/src/zone.rs:325
10962024-12-20T22:53:22.539ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317 file = illumos-utils/src/zone.rs:325
10972024-12-20T22:53:22.544ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4 file = illumos-utils/src/zone.rs:325
10982024-12-20T22:53:22.549ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c file = illumos-utils/src/zone.rs:325
10992024-12-20T22:53:22.554ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352 file = illumos-utils/src/zone.rs:325
11002024-12-20T22:53:22.559ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5 file = illumos-utils/src/zone.rs:325
11012024-12-20T22:53:22.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938 file = illumos-utils/src/zone.rs:325
11022024-12-20T22:53:22.571ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03 file = illumos-utils/src/zone.rs:325
11032024-12-20T22:53:22.578ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21 file = illumos-utils/src/zone.rs:363
11042024-12-20T22:53:22.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317 file = illumos-utils/src/zone.rs:363
11052024-12-20T22:53:22.594ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4 file = illumos-utils/src/zone.rs:363
11062024-12-20T22:53:22.602ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c file = illumos-utils/src/zone.rs:363
11072024-12-20T22:53:22.609ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352 file = illumos-utils/src/zone.rs:363
11082024-12-20T22:53:22.623ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5 file = illumos-utils/src/zone.rs:363
11092024-12-20T22:53:22.632ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938 file = illumos-utils/src/zone.rs:363
11102024-12-20T22:53:22.646ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03 file = illumos-utils/src/zone.rs:363
11112024-12-20T22:53:22.784ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11122024-12-20T22:53:22.851ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11132024-12-20T22:53:22.911ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11142024-12-20T22:53:22.981ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11152024-12-20T22:53:23.044ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11162024-12-20T22:53:23.047ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11172024-12-20T22:53:23.047ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11182024-12-20T22:53:23.105ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 150, 100]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11192024-12-20T22:53:23.105ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11202024-12-20T22:53:23.107ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11212024-12-20T22:53:23.107ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11222024-12-20T22:53:23.164ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 188, 28]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11232024-12-20T22:53:23.164ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11242024-12-20T22:53:23.165ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11252024-12-20T22:53:23.166ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11262024-12-20T22:53:23.222ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 142, 244]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11272024-12-20T22:53:23.222ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11282024-12-20T22:53:23.224ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11292024-12-20T22:53:23.224ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11302024-12-20T22:53:23.280ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 157, 244]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11312024-12-20T22:53:23.280ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11322024-12-20T22:53:23.282ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11332024-12-20T22:53:23.282ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11342024-12-20T22:53:23.338ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 142, 57]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11352024-12-20T22:53:23.338ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11362024-12-20T22:53:23.345ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11372024-12-20T22:53:23.345ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11382024-12-20T22:53:23.348ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11392024-12-20T22:53:23.348ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11402024-12-20T22:53:23.348ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11412024-12-20T22:53:23.348ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11422024-12-20T22:53:23.349ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11432024-12-20T22:53:23.349ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11442024-12-20T22:53:23.349ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11452024-12-20T22:53:23.349ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11462024-12-20T22:53:23.362ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11472024-12-20T22:53:23.364ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11482024-12-20T22:53:23.407ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11492024-12-20T22:53:23.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11502024-12-20T22:53:23.411ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11512024-12-20T22:53:23.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11522024-12-20T22:53:23.415ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11532024-12-20T22:53:23.419ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11542024-12-20T22:53:23.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11552024-12-20T22:53:23.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11562024-12-20T22:53:23.561ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_371fea12-332e-4334-902e-d2154e69e006 file = illumos-utils/src/zone.rs:325
11572024-12-20T22:53:23.568ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729 file = illumos-utils/src/zone.rs:325
11582024-12-20T22:53:23.577ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c file = illumos-utils/src/zone.rs:325
11592024-12-20T22:53:23.583ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff file = illumos-utils/src/zone.rs:325
11602024-12-20T22:53:23.590ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34 file = illumos-utils/src/zone.rs:325
11612024-12-20T22:53:23.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_371fea12-332e-4334-902e-d2154e69e006 file = illumos-utils/src/zone.rs:363
11622024-12-20T22:53:23.601ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729 file = illumos-utils/src/zone.rs:363
11632024-12-20T22:53:23.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c file = illumos-utils/src/zone.rs:363
11642024-12-20T22:53:23.613ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff file = illumos-utils/src/zone.rs:363
11652024-12-20T22:53:23.618ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34 file = illumos-utils/src/zone.rs:363
11662024-12-20T22:53:32.446ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.680142739s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
11672024-12-20T22:53:33.075ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_091028cb-f478-4341-abae-5f1e6cecc3ba/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='92076ddf-b669-487c-a056-eded408f6570'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-12-20T22:53:33.076ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b960ef68-fd77-411f-b5e4-77a645524bc5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bbc65531-5cf3-46b3-b9e2-3eea239bf1a6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11692024-12-20T22:53:33.076ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a9d1aba2-2e45-4df1-ac9f-65b644441b1f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702024-12-20T22:53:33.076ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
11712024-12-20T22:53:33.087ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
11722024-12-20T22:53:33.095ZINFOSledAgent (ServiceManager): Booting oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
11732024-12-20T22:53:33.102ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b930cb0c-4dba-41c9-94ce-447618d4e4ec'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11742024-12-20T22:53:33.102ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='734e5c08-9ce2-46ff-90e5-b2af2e7b60c7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11752024-12-20T22:53:33.103ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d84ca4af-5ad6-47d7-846c-83de4270596d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11762024-12-20T22:53:33.103ZINFOSledAgent (ServiceManager): Booting oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
11772024-12-20T22:53:33.115ZINFOSledAgent (ServiceManager): Booting oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
11782024-12-20T22:53:33.122ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
11792024-12-20T22:53:33.415ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802024-12-20T22:53:33.415ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
11812024-12-20T22:53:33.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 54.331157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
11822024-12-20T22:53:33.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 72.688186ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
11832024-12-20T22:53:33.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 66.278942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
11842024-12-20T22:53:33.558ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d31b2b69-efd5-461d-912c-5052088aed91/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1f899cad-d3be-4e8d-b088-ae9ed4364b19'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11852024-12-20T22:53:33.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 45.075971ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
11862024-12-20T22:53:33.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 74.827078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
11872024-12-20T22:53:33.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 25.818754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
11882024-12-20T22:53:33.594ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
11892024-12-20T22:53:33.601ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1bebbc47-252a-4b92-8d16-64a505e777ec/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1bddfaf2-c247-42d8-8386-e6f44bc805ba'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-12-20T22:53:33.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 144.24266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
11912024-12-20T22:53:33.613ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
11922024-12-20T22:53:33.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 90.976548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
11932024-12-20T22:53:33.667ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942024-12-20T22:53:33.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 64.981643ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
11952024-12-20T22:53:33.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 105.383333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
11962024-12-20T22:53:33.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 130.797994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
11972024-12-20T22:53:33.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 108.681239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
11982024-12-20T22:53:33.715ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
11992024-12-20T22:53:33.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 30.828446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12002024-12-20T22:53:33.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 158.070968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12012024-12-20T22:53:33.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 139.977221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
12022024-12-20T22:53:33.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 153.372607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12032024-12-20T22:53:33.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 128.670109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12042024-12-20T22:53:33.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 256.655911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
12052024-12-20T22:53:33.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 241.349712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
12062024-12-20T22:53:33.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 37.253679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12072024-12-20T22:53:33.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 243.911262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
12082024-12-20T22:53:33.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 42.437806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12092024-12-20T22:53:33.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 124.097227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12102024-12-20T22:53:33.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 377.774176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
12112024-12-20T22:53:33.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 574.941995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12122024-12-20T22:53:33.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 369.191943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12132024-12-20T22:53:33.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 240.337233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12142024-12-20T22:53:34.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 63.685566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12152024-12-20T22:53:34.009ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='103fc383-10f6-4327-a1b1-dabac4e1e365'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12162024-12-20T22:53:34.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 59.96023ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12172024-12-20T22:53:34.034ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12182024-12-20T22:53:34.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 126.922428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12192024-12-20T22:53:34.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 426.898316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
12202024-12-20T22:53:34.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 275.457867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12212024-12-20T22:53:34.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 383.816773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
12222024-12-20T22:53:34.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 99.191968ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12232024-12-20T22:53:34.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 415.119864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
12242024-12-20T22:53:34.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 519.287914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12252024-12-20T22:53:34.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 294.831225ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12262024-12-20T22:53:34.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 581.85223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12272024-12-20T22:53:34.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 48.853322ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12282024-12-20T22:53:34.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 774.035791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
12292024-12-20T22:53:34.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 789.489034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12302024-12-20T22:53:34.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 64.292053ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12312024-12-20T22:53:34.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 461.388514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12322024-12-20T22:53:34.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 101.813463ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12332024-12-20T22:53:34.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 909.170547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
12342024-12-20T22:53:34.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 731.43013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
12352024-12-20T22:53:34.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 275.216635ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12362024-12-20T22:53:34.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 716.596911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12372024-12-20T22:53:34.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 403.038645ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12382024-12-20T22:53:34.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 919.900203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
12392024-12-20T22:53:34.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 822.258999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12402024-12-20T22:53:34.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 759.901128ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12412024-12-20T22:53:34.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 525.061816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12422024-12-20T22:53:34.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 880.615082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12432024-12-20T22:53:35.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 736.734662ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12442024-12-20T22:53:35.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.435577434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
12452024-12-20T22:53:35.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 506.779591ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12462024-12-20T22:53:35.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.004189499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
12472024-12-20T22:53:35.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 1.112291372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12482024-12-20T22:53:35.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 520.01727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12492024-12-20T22:53:35.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.025716359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
12502024-12-20T22:53:35.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 701.545845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
12512024-12-20T22:53:35.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 953.22945ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12522024-12-20T22:53:35.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.154112523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12532024-12-20T22:53:35.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.355533481s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12542024-12-20T22:53:35.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.203705098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12552024-12-20T22:53:35.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 538.674732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12562024-12-20T22:53:36.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.379795182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12572024-12-20T22:53:36.108ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582024-12-20T22:53:36.109ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12592024-12-20T22:53:36.109ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12602024-12-20T22:53:36.117ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
12612024-12-20T22:53:36.283ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5f09a8f-6121-4348-9961-a5179860c549'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12622024-12-20T22:53:36.291ZINFOSledAgent (ServiceManager): Booting oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12632024-12-20T22:53:36.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 58.263608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12642024-12-20T22:53:36.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 62.390693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
12652024-12-20T22:53:36.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 109.630366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12662024-12-20T22:53:36.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 730.817755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
12672024-12-20T22:53:36.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 101.381929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
12682024-12-20T22:53:36.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.471424602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12692024-12-20T22:53:36.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.32323074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
12702024-12-20T22:53:36.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 255.518273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12712024-12-20T22:53:36.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 298.755683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
12722024-12-20T22:53:36.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 61.429126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12732024-12-20T22:53:36.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 737.928827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12742024-12-20T22:53:36.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.492180623s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
12752024-12-20T22:53:36.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 84.477954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12762024-12-20T22:53:36.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 138.423876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12772024-12-20T22:53:36.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 1.081767567s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12782024-12-20T22:53:36.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 664.791341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
12792024-12-20T22:53:36.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 361.652602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12802024-12-20T22:53:36.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 341.297134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
12812024-12-20T22:53:36.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 529.343682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12822024-12-20T22:53:36.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 799.326123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12832024-12-20T22:53:37.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 876.044663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
12842024-12-20T22:53:37.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.429766569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
12852024-12-20T22:53:37.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 626.103701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12862024-12-20T22:53:37.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.24058094s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
12872024-12-20T22:53:37.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 850.072764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
12882024-12-20T22:53:37.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 553.309629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12892024-12-20T22:53:37.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 506.765585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12902024-12-20T22:53:37.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.194824915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
12912024-12-20T22:53:37.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.02099593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
12922024-12-20T22:53:37.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 732.744345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
12932024-12-20T22:53:37.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 1.131032186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
12942024-12-20T22:53:37.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.137856718s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
12952024-12-20T22:53:37.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 1.221929501s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
12962024-12-20T22:53:37.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 671.448685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
12972024-12-20T22:53:37.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.417435439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
12982024-12-20T22:53:37.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.221294717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
12992024-12-20T22:53:37.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.101190693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
13002024-12-20T22:53:38.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 826.114043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
13012024-12-20T22:53:38.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.395599057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
13022024-12-20T22:53:38.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 841.856022ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
13032024-12-20T22:53:38.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 610.33996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
13042024-12-20T22:53:38.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 658.042278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
13052024-12-20T22:53:38.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 799.791605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
13062024-12-20T22:53:38.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.460736944s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
13072024-12-20T22:53:38.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 692.991534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
13082024-12-20T22:53:38.834ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092024-12-20T22:53:38.876ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13102024-12-20T22:53:38.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 1.478125573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
13112024-12-20T22:53:38.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 1.186659459s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
13122024-12-20T22:53:38.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 845.397328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
13132024-12-20T22:53:38.979ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42226
13142024-12-20T22:53:38.994ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2898 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42226 req_id = b524b377-0ad1-41b9-b6a8-46a95fa93f55 response_code = 200 uri = /baseboard
13152024-12-20T22:53:39.000ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13162024-12-20T22:53:39.000ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13172024-12-20T22:53:39.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 652.825083ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
13182024-12-20T22:53:39.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.321192049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
13192024-12-20T22:53:39.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 41.907276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13202024-12-20T22:53:39.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.374715437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
13212024-12-20T22:53:39.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 102.546886ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13222024-12-20T22:53:39.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.225362856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
13232024-12-20T22:53:39.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 770.031005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
13242024-12-20T22:53:39.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 65.240354ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13252024-12-20T22:53:39.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 282.974062ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13262024-12-20T22:53:39.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.151649519s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
13272024-12-20T22:53:39.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 135.750469ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13282024-12-20T22:53:39.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.274936642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
13292024-12-20T22:53:39.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 505.445785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
13302024-12-20T22:53:39.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 299.942216ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13312024-12-20T22:53:39.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 704.278375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
13322024-12-20T22:53:39.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 769.05294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
13332024-12-20T22:53:39.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 573.847321ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13342024-12-20T22:53:39.587ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_371fea12-332e-4334-902e-d2154e69e006: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352024-12-20T22:53:39.587ZINFOSledAgent (ServiceManager): Booting oxz_nexus_371fea12-332e-4334-902e-d2154e69e006 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13362024-12-20T22:53:39.594ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372024-12-20T22:53:39.594ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13382024-12-20T22:53:39.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 753.090722ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
13392024-12-20T22:53:39.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 46.779291ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13402024-12-20T22:53:39.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 36.609857ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13412024-12-20T22:53:39.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 253.484954ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13422024-12-20T22:53:39.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 66.370395ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13432024-12-20T22:53:39.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 138.495855ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13442024-12-20T22:53:39.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.048316494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
13452024-12-20T22:53:39.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 252.634411ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13462024-12-20T22:53:39.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 1.328295864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
13472024-12-20T22:53:39.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 113.377487ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13482024-12-20T22:53:40.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.129919695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
13492024-12-20T22:53:40.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 1.092262187s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13502024-12-20T22:53:40.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 285.52592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13512024-12-20T22:53:40.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 428.608581ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13522024-12-20T22:53:40.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 683.959184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
13532024-12-20T22:53:40.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 559.558079ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13542024-12-20T22:53:40.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 607.615212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
13552024-12-20T22:53:40.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.469712118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
13562024-12-20T22:53:40.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.230528549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
13572024-12-20T22:53:40.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.160006766s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13582024-12-20T22:53:40.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 540.309886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
13592024-12-20T22:53:40.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 683.645467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
13602024-12-20T22:53:40.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 920.997114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
13612024-12-20T22:53:40.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 718.098418ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
13622024-12-20T22:53:40.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 1.473112312s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
13632024-12-20T22:53:40.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.384882547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
13642024-12-20T22:53:40.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 582.873274ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13652024-12-20T22:53:40.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.242413971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
13662024-12-20T22:53:40.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 891.467227ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13672024-12-20T22:53:40.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 889.412256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
13682024-12-20T22:53:40.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 503.258505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
13692024-12-20T22:53:40.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.444185116s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
13702024-12-20T22:53:40.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 1.248521536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
13712024-12-20T22:53:41.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.170577573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
13722024-12-20T22:53:41.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 542.218829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
13732024-12-20T22:53:41.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 820.225137ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13742024-12-20T22:53:41.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 894.265383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13752024-12-20T22:53:41.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 912.880244ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
13762024-12-20T22:53:41.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 1.295894478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
13772024-12-20T22:53:41.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.214069814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
13782024-12-20T22:53:41.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.44687634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
13792024-12-20T22:53:41.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.171704157s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13802024-12-20T22:53:41.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.238253099s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
13812024-12-20T22:53:41.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 1.288400852s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
13822024-12-20T22:53:41.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.089616773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
13832024-12-20T22:53:41.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 1.138478922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
13842024-12-20T22:53:41.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 995.000237ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
13852024-12-20T22:53:41.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 977.624965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
13862024-12-20T22:53:41.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.404054171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
13872024-12-20T22:53:41.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 1.340011477s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
13882024-12-20T22:53:41.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 757.337225ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13892024-12-20T22:53:42.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 922.379205ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
13902024-12-20T22:53:42.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.22834905s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
13912024-12-20T22:53:42.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 1.22803337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
13922024-12-20T22:53:42.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.038087398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
13932024-12-20T22:53:42.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 649.626512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
13942024-12-20T22:53:42.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 840.198143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
13952024-12-20T22:53:42.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 1.415211422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
13962024-12-20T22:53:42.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.415829661s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
13972024-12-20T22:53:42.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 751.670545ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
13982024-12-20T22:53:42.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.395475612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
13992024-12-20T22:53:42.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 993.319442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
14002024-12-20T22:53:42.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.201038123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
14012024-12-20T22:53:42.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.242028889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14022024-12-20T22:53:42.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.039051013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
14032024-12-20T22:53:42.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 1.332169105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
14042024-12-20T22:53:42.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 926.066704ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
14052024-12-20T22:53:43.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.254561399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
14062024-12-20T22:53:43.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 1.006814143s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
14072024-12-20T22:53:43.282ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14082024-12-20T22:53:43.282ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14092024-12-20T22:53:43.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 713.692751ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
14102024-12-20T22:53:43.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 813.657986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
14112024-12-20T22:53:43.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 658.159238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
14122024-12-20T22:53:43.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 670.384235ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
14132024-12-20T22:53:43.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.29321465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
14142024-12-20T22:53:43.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 1.016402214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
14152024-12-20T22:53:43.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 1.046738552s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
14162024-12-20T22:53:43.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 74.554364ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14172024-12-20T22:53:43.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 52.57747ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14182024-12-20T22:53:43.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 132.907282ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14192024-12-20T22:53:43.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.386634568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
14202024-12-20T22:53:43.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 899.97634ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
14212024-12-20T22:53:44.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 588.875577ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14222024-12-20T22:53:44.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 629.346764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14232024-12-20T22:53:44.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 803.070286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
14242024-12-20T22:53:44.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.362009834s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
14252024-12-20T22:53:44.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 709.565851ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
14262024-12-20T22:53:44.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.191362427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
14272024-12-20T22:53:44.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.045155894s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
14282024-12-20T22:53:44.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.005286612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
14292024-12-20T22:53:44.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.15248622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
14302024-12-20T22:53:44.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.301913759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
14312024-12-20T22:53:44.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.412277992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
14322024-12-20T22:53:44.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 783.475218ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
14332024-12-20T22:53:44.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 768.490479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
14342024-12-20T22:53:44.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.33000928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
14352024-12-20T22:53:44.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 903.244688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
14362024-12-20T22:53:44.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 1.274316458s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
14372024-12-20T22:53:44.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 993.893891ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14382024-12-20T22:53:44.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 940.456107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
14392024-12-20T22:53:44.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 865.445856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14402024-12-20T22:53:44.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 1.049748233s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
14412024-12-20T22:53:44.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 1.272529906s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
14422024-12-20T22:53:44.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 857.162079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
14432024-12-20T22:53:45.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 833.7757ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
14442024-12-20T22:53:45.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 1.102490193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
14452024-12-20T22:53:45.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.081471123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
14462024-12-20T22:53:45.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.296053441s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
14472024-12-20T22:53:45.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 763.553403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
14482024-12-20T22:53:45.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.376319896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
14492024-12-20T22:53:45.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.181509204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
14502024-12-20T22:53:45.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 1.113453123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
14512024-12-20T22:53:45.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 609.738798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
14522024-12-20T22:53:45.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.112611797s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
14532024-12-20T22:53:45.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.027340265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
14542024-12-20T22:53:45.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 732.2478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
14552024-12-20T22:53:45.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 554.09104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14562024-12-20T22:53:45.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.229244336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
14572024-12-20T22:53:45.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 635.629504ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14582024-12-20T22:53:45.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 1.331600268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
14592024-12-20T22:53:45.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 1.051699636s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
14602024-12-20T22:53:45.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 1.164381305s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
14612024-12-20T22:53:45.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 790.581587ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
14622024-12-20T22:53:46.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 999.221654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
14632024-12-20T22:53:46.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 580.750416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
14642024-12-20T22:53:46.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 1.31297681s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
14652024-12-20T22:53:46.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 993.854901ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
14662024-12-20T22:53:46.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.19389243s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14672024-12-20T22:53:46.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 929.87466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
14682024-12-20T22:53:46.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 734.416171ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14692024-12-20T22:53:46.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 1.444417633s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
14702024-12-20T22:53:46.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 789.646765ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
14712024-12-20T22:53:46.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.008276285s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
14722024-12-20T22:53:46.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.096303s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
14732024-12-20T22:53:46.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.122265904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
14742024-12-20T22:53:46.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 527.43542ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
14752024-12-20T22:53:46.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 1.293473856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
14762024-12-20T22:53:46.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 700.714404ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
14772024-12-20T22:53:46.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 840.943648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
14782024-12-20T22:53:46.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.159969408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
14792024-12-20T22:53:46.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365") failed: Property not found. retry in 1.485567491s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
14802024-12-20T22:53:47.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 756.85274ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
14812024-12-20T22:53:47.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.482856809s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
14822024-12-20T22:53:47.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 1.181572553s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
14832024-12-20T22:53:47.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 843.832058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
14842024-12-20T22:53:47.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 1.223574701s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
14852024-12-20T22:53:47.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff") failed: Property not found. retry in 1.184296151s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
14862024-12-20T22:53:47.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21") failed: Property not found. retry in 1.29739691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
14872024-12-20T22:53:47.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317") failed: Property not found. retry in 1.133917972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
14882024-12-20T22:53:47.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 563.335306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14892024-12-20T22:53:47.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 912.278145ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
14902024-12-20T22:53:47.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 531.335792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
14912024-12-20T22:53:47.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 1.096725581s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
14922024-12-20T22:53:47.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 621.583155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
14932024-12-20T22:53:47.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a") failed: Property not found. retry in 1.084340781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
14942024-12-20T22:53:47.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03") failed: Property not found. retry in 1.041480885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
14952024-12-20T22:53:47.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 1.438409553s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
14962024-12-20T22:53:47.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 615.021966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
14972024-12-20T22:53:48.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 597.696253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
14982024-12-20T22:53:48.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 852.781228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
14992024-12-20T22:53:48.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938") failed: Property not found. retry in 765.836375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
15002024-12-20T22:53:48.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 608.90525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
15012024-12-20T22:53:48.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352") failed: Property not found. retry in 1.350454028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
15022024-12-20T22:53:48.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4") failed: Property not found. retry in 1.499941005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
15032024-12-20T22:53:48.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 501.308977ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15042024-12-20T22:53:48.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 1.197468613s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
15052024-12-20T22:53:48.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 872.046432ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
15062024-12-20T22:53:48.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5") failed: Property not found. retry in 986.464196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
15072024-12-20T22:53:48.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.119829085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
15082024-12-20T22:53:48.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef") failed: Property not found. retry in 1.249057295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
15092024-12-20T22:53:48.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_371fea12-332e-4334-902e-d2154e69e006") failed: Property not found. retry in 645.723313ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
15102024-12-20T22:53:48.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 675.963078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
15112024-12-20T22:53:48.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 911.592155ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15122024-12-20T22:53:48.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 656.060585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
15132024-12-20T22:53:49.267ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.578712984s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
15142024-12-20T22:53:49.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c") failed: Property not found. retry in 1.431962833s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
15152024-12-20T22:53:49.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729") failed: Property not found. retry in 1.48988693s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
15162024-12-20T22:53:49.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c") failed: Property not found. retry in 557.673578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
15172024-12-20T22:53:49.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34") failed: Property not found. retry in 573.718805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
15182024-12-20T22:53:49.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34") failed: Property not found. retry in 674.995945ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
15192024-12-20T22:53:49.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4") failed: Property not found. retry in 1.499540566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
15202024-12-20T22:53:49.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 1.029085807s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15212024-12-20T22:53:50.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 638.630468ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15222024-12-20T22:53:51.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 957.790968ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15232024-12-20T22:53:52.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6") failed: Property not found. retry in 1.38205328s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15242024-12-20T22:53:53.044ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.224747687s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
15252024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_103fc383-10f6-4327-a1b1-dabac4e1e365
15262024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a04d400c-5deb-499b-ad4f-6c4c1c5839d4
15272024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_7f0f4a2d-f857-40c5-aabe-af9850ced3f6
15282024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_833bc893-b854-453c-823c-2d1c814a99ef
15292024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_236200ed-69ea-40b1-9864-080ffa271a34
15302024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_1e296b8d-6800-4056-8034-a1ec2d005fff
15312024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_f3b60bd3-6e34-4140-a755-57f26dbc5b34
15322024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_d152ce13-e26d-4528-854c-f36302a4159a
15332024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_371fea12-332e-4334-902e-d2154e69e006
15342024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_a67567ae-7026-453e-acd2-e1780994c729
15352024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_ace0592c-7755-46f8-b47a-c9b6444fe64c
15362024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_6e207eac-547b-47ae-9fa3-298ca9e1fe21
15372024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_fbe11d1c-f2ff-4d5f-b511-b39c30520317
15382024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_6f8c15e0-3bd6-49d4-ac46-62138824d5f4
15392024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_ecaec90f-a64d-4293-8468-6ad99b8c3e2c
15402024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_358ade7e-7d00-40b3-a890-cdc08dcb0352
15412024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_e8e005e1-9ef0-4928-800f-624ba83e2bc5
15422024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_3234088c-f708-4f9e-82e2-a977e0a60938
15432024-12-20T22:53:53.941ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_de2736f0-9cb4-49a5-9541-e86eb4dd1a03
15442024-12-20T22:53:53.945ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15452024-12-20T22:53:53.958ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15462024-12-20T22:53:53.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32337471 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43210 req_id = 9e59e851-4aa4-4336-a497-3d8ba7953a2d response_code = 204 uri = /omicron-zones
15472024-12-20T22:53:54.042ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
15482024-12-20T22:53:54.056ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15492024-12-20T22:53:54.070ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
15502024-12-20T22:53:54.106ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
15512024-12-20T22:53:54.117ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15522024-12-20T22:53:54.207ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15532024-12-20T22:53:54.353ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15542024-12-20T22:53:54.447ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15552024-12-20T22:53:54.632ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15562024-12-20T22:53:54.787ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15572024-12-20T22:53:54.922ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15582024-12-20T22:53:55.355ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15592024-12-20T22:53:55.788ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15602024-12-20T22:53:56.287ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15612024-12-20T22:53:56.842ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/b394d0c6-19a8-4136-9148-af6c47c1f8e0/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15622024-12-20T22:53:57.767ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 12.198302949s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"10b46276-d3bb-4059-bb7a-48e157ea3a32\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Fri, 20 Dec 2024 22:53:57 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"10b46276-d3bb-4059-bb7a-48e157ea3a32\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
15632024-12-20T22:53:59.147ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cb77192d-039f-4758-8b25-8da7f57d5186", "content-length": "173", "date": "Fri, 20 Dec 2024 22:53:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b394d0c6-19a8-4136-9148-af6c47c1f8e0\"", request_id: "cb77192d-039f-4758-8b25-8da7f57d5186" } file = sled-agent/src/rack_setup/service.rs:1078
15642024-12-20T22:54:00.871ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "732c803a-5131-4bca-b92d-7254a199aafd", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b394d0c6-19a8-4136-9148-af6c47c1f8e0\"", request_id: "732c803a-5131-4bca-b92d-7254a199aafd" } file = sled-agent/src/rack_setup/service.rs:1078
15652024-12-20T22:54:02.158ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a5310f84-09f7-418f-9c4f-5562bb502ca5", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"b394d0c6-19a8-4136-9148-af6c47c1f8e0\"", request_id: "a5310f84-09f7-418f-9c4f-5562bb502ca5" } file = sled-agent/src/rack_setup/service.rs:1078
15662024-12-20T22:54:04.606ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0257d7f9-d1df-401d-b1a8-62c87b227fbf", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "0257d7f9-d1df-401d-b1a8-62c87b227fbf" } file = sled-agent/src/rack_setup/service.rs:1078
15672024-12-20T22:54:06.810ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b065ec9b-a382-40c8-a2c3-2bcfceb1a0db", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "b065ec9b-a382-40c8-a2c3-2bcfceb1a0db" } file = sled-agent/src/rack_setup/service.rs:1078
15682024-12-20T22:54:09.037ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d4e25fb2-8eb8-4470-aa74-83fef7d183bd", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "d4e25fb2-8eb8-4470-aa74-83fef7d183bd" } file = sled-agent/src/rack_setup/service.rs:1078
15692024-12-20T22:54:09.045ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50392
15702024-12-20T22:54:09.046ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50392 req_id = 7d670799-460b-40df-b4cc-3f25cfbcd1e5 response_code = 200 uri = /baseboard
15712024-12-20T22:54:10.524ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a21acccc-522f-4143-9f5b-d23e8ec61faa", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "a21acccc-522f-4143-9f5b-d23e8ec61faa" } file = sled-agent/src/rack_setup/service.rs:1078
15722024-12-20T22:54:12.950ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0e23ceca-bc42-42b8-ae2c-6c271a96c01a", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "0e23ceca-bc42-42b8-ae2c-6c271a96c01a" } file = sled-agent/src/rack_setup/service.rs:1078
15732024-12-20T22:54:15.755ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fa69562d-0afd-42da-b078-75251109a1cf", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "fa69562d-0afd-42da-b078-75251109a1cf" } file = sled-agent/src/rack_setup/service.rs:1078
15742024-12-20T22:54:20.191ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8627d995-9870-404b-ba0d-6bea40c2799b", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "8627d995-9870-404b-ba0d-6bea40c2799b" } file = sled-agent/src/rack_setup/service.rs:1078
15752024-12-20T22:54:26.387ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "78db04bc-e403-4750-8dce-b580eb324be2", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:25 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "78db04bc-e403-4750-8dce-b580eb324be2" } file = sled-agent/src/rack_setup/service.rs:1078
15762024-12-20T22:54:30.712ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "03830b2a-51ab-4fcf-b082-1f1f2500c74d", "content-length": "173", "date": "Fri, 20 Dec 2024 22:54:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"287d6774-d3e6-4b73-8c77-c90534d4a54d\"", request_id: "03830b2a-51ab-4fcf-b082-1f1f2500c74d" } file = sled-agent/src/rack_setup/service.rs:1078
15772024-12-20T22:54:34.488ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
15782024-12-20T22:54:34.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61987
15792024-12-20T22:54:34.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15802024-12-20T22:54:34.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15812024-12-20T22:54:34.581ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
15822024-12-20T22:54:34.585ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
15832024-12-20T22:54:34.598ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15842024-12-20T22:54:34.599ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1bebbc47-252a-4b92-8d16-64a505e777ec
15852024-12-20T22:54:34.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15862024-12-20T22:54:34.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2
15872024-12-20T22:54:34.651ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15882024-12-20T22:54:34.651ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b2b69-efd5-461d-912c-5052088aed91
15892024-12-20T22:54:34.676ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15902024-12-20T22:54:34.676ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1
15912024-12-20T22:54:34.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15922024-12-20T22:54:34.697ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27
15932024-12-20T22:54:34.719ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15942024-12-20T22:54:34.719ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4
15952024-12-20T22:54:34.737ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15962024-12-20T22:54:34.737ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_091028cb-f478-4341-abae-5f1e6cecc3ba
15972024-12-20T22:54:34.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15982024-12-20T22:54:34.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b960ef68-fd77-411f-b5e4-77a645524bc5
15992024-12-20T22:54:34.782ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16002024-12-20T22:54:34.782ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae
16012024-12-20T22:54:34.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61987 req_id = 73240bc8-3f98-4cb6-8791-e3caa48cf9da response_code = 200 uri = /inventory
16022024-12-20T22:54:39.080ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40449
16032024-12-20T22:54:39.080ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40449 req_id = fb72b76a-2a45-4187-bc34-9d34e6d17c4a response_code = 200 uri = /baseboard
16042024-12-20T22:54:40.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41289
16052024-12-20T22:54:40.436ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16062024-12-20T22:54:40.436ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16072024-12-20T22:54:40.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16082024-12-20T22:54:40.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16092024-12-20T22:54:40.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16102024-12-20T22:54:40.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16112024-12-20T22:54:40.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16122024-12-20T22:54:40.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41289 req_id = 9c871a49-401a-4c22-a054-1d1980221819 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16132024-12-20T22:54:40.438ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
16142024-12-20T22:54:40.443ZINFOSledAgent (RSS): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16152024-12-20T22:54:40.443ZINFOSledAgent (RSS): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16162024-12-20T22:54:40.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41465
16172024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16182024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16192024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16202024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16212024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16222024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16232024-12-20T22:54:40.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16242024-12-20T22:54:40.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41465 req_id = 34b31da9-8f4c-4b65-885f-bc6863c3e25d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16252024-12-20T22:54:40.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61366
16262024-12-20T22:54:40.721ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16272024-12-20T22:54:40.721ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16282024-12-20T22:54:40.721ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
16292024-12-20T22:54:40.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
16302024-12-20T22:54:40.735ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16312024-12-20T22:54:40.735ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1bebbc47-252a-4b92-8d16-64a505e777ec
16322024-12-20T22:54:40.761ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16332024-12-20T22:54:40.761ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2
16342024-12-20T22:54:40.784ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16352024-12-20T22:54:40.784ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b2b69-efd5-461d-912c-5052088aed91
16362024-12-20T22:54:40.810ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16372024-12-20T22:54:40.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1
16382024-12-20T22:54:40.831ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16392024-12-20T22:54:40.831ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27
16402024-12-20T22:54:40.854ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16412024-12-20T22:54:40.854ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4
16422024-12-20T22:54:40.877ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16432024-12-20T22:54:40.877ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_091028cb-f478-4341-abae-5f1e6cecc3ba
16442024-12-20T22:54:40.899ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16452024-12-20T22:54:40.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b960ef68-fd77-411f-b5e4-77a645524bc5
16462024-12-20T22:54:40.919ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16472024-12-20T22:54:40.919ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae
16482024-12-20T22:54:40.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61366 req_id = 3b820c2a-7692-45bc-b852-393f27556d32 response_code = 200 uri = /inventory
16492024-12-20T22:54:41.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37519
16502024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16512024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16522024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16532024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16542024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16552024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16562024-12-20T22:54:41.640ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16572024-12-20T22:54:41.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37519 req_id = cad4479e-bdbd-4871-b788-9e142a2c8e9d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16582024-12-20T22:54:42.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43298
16592024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16602024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16612024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16622024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16632024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16642024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16652024-12-20T22:54:42.104ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16662024-12-20T22:54:42.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43298 req_id = b9b8d849-d3d4-4b86-8d55-013867192177 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16672024-12-20T22:54:43.156ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:54328 remote_addr = [fd00:1122:3344:101::d]:51440 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
16682024-12-20T22:54:43.197ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40085 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = b97921ff-e330-4b59-a2ef-08096c5f6c5e response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
16692024-12-20T22:54:48.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43368
16702024-12-20T22:54:48.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43368 req_id = 03cc28b8-ec90-4ae9-8ffb-4caf7903e076 response_code = 200 uri = /vpc-routes
16712024-12-20T22:54:48.677ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
16722024-12-20T22:54:48.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43368 req_id = 5688aafb-9f1c-4c90-8df4-74c45fffc608 response_code = 204 uri = /eip-gateways
16732024-12-20T22:54:48.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43368 req_id = d4b80f8e-200c-40d9-a9a2-02ecb56e7114 response_code = 204 uri = /vpc-routes
16742024-12-20T22:55:02.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49662
16752024-12-20T22:55:02.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49662 req_id = 9ae4e82d-41a7-4df6-9919-dd7d25b4b84b response_code = 200 uri = /vpc-routes
16762024-12-20T22:55:02.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
16772024-12-20T22:55:02.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49662 req_id = 410b9a6f-0283-416c-9f66-754d31fb6c04 response_code = 204 uri = /eip-gateways
16782024-12-20T22:55:02.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46745
16792024-12-20T22:55:02.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 725 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46745 req_id = f84a9bfd-275b-4022-b73c-51a556d6bf81 response_code = 200 uri = /v2p
16802024-12-20T22:55:02.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49662 req_id = 8eb1cfb4-a8f1-419a-9271-402c31ffb908 response_code = 204 uri = /vpc-routes
16812024-12-20T22:55:02.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51026
16822024-12-20T22:55:02.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51026 req_id = 7d6fa26e-eb62-4e8d-96eb-eb121110aa1d response_code = 200 uri = /vpc-routes
16832024-12-20T22:55:02.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
16842024-12-20T22:55:02.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51026 req_id = f7596fe3-7d55-4c93-81fa-15cb940fbfba response_code = 204 uri = /eip-gateways
16852024-12-20T22:55:02.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51026 req_id = b3706e9d-80f9-4c9c-93e2-725b6a8e9a44 response_code = 204 uri = /vpc-routes
16862024-12-20T22:55:02.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45251
16872024-12-20T22:55:02.799ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
16882024-12-20T22:55:02.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
16892024-12-20T22:55:02.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45251 req_id = 2b966d48-22c7-45c1-8e50-a9769ad64eef response_code = 204 uri = /switch-ports
16902024-12-20T22:55:02.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58768
16912024-12-20T22:55:02.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58676
16922024-12-20T22:55:02.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58676 req_id = 2677d84e-78c2-47c7-b506-233929c2b31a response_code = 200 uri = /vpc-routes
16932024-12-20T22:55:02.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58768 req_id = 0660c63d-2600-44d2-aa29-b6332bff61cb response_code = 200 uri = /v2p
16942024-12-20T22:55:02.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45251 req_id = 880297ef-cbb9-4b80-88be-48588632f60a response_code = 200 uri = /network-bootstore-config
16952024-12-20T22:55:03.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59241
16962024-12-20T22:55:03.012ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
16972024-12-20T22:55:03.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
16982024-12-20T22:55:03.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59241 req_id = d458e72a-bc91-47d8-9dee-170526215ecb response_code = 204 uri = /switch-ports
16992024-12-20T22:55:03.152ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17002024-12-20T22:55:03.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58676 req_id = 3a6b4eff-cbf8-492b-95e0-cd367d6a02d5 response_code = 204 uri = /eip-gateways
17012024-12-20T22:55:03.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59241 req_id = 26f11355-ff2c-4b44-8bb5-de6f24c4fc55 response_code = 200 uri = /network-bootstore-config
17022024-12-20T22:55:03.153ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17032024-12-20T22:55:03.154ZINFOSledAgent (bootstore): Writing ledger to /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17042024-12-20T22:55:03.156ZINFOSledAgent (bootstore): Writing ledger to /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17052024-12-20T22:55:03.157ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17062024-12-20T22:55:03.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45251 req_id = 955d5427-dc26-44a8-8cb9-58d1db86a5a0 response_code = 204 uri = /network-bootstore-config
17072024-12-20T22:55:03.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43082
17082024-12-20T22:55:03.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43082 req_id = 73967288-ef9a-4a1d-8815-75cf0eba3479 response_code = 200 uri = /v2p
17092024-12-20T22:55:03.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58676 req_id = 7610639d-65a2-4dc4-a138-1dd356e0645b response_code = 204 uri = /vpc-routes
17102024-12-20T22:55:03.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57919
17112024-12-20T22:55:03.454ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17122024-12-20T22:55:03.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17132024-12-20T22:55:03.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96766 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57919 req_id = 7caf2bce-d3dc-48fb-9a79-d2252531dd7e response_code = 204 uri = /switch-ports
17142024-12-20T22:55:03.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57919 req_id = 92589141-6c24-403b-8c4f-2f9a1119a5c4 response_code = 200 uri = /network-bootstore-config
17152024-12-20T22:55:09.112ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47818
17162024-12-20T22:55:09.113ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47818 req_id = da9876de-e6f5-4ace-8c99-9c01c5ae0e85 response_code = 200 uri = /baseboard
17172024-12-20T22:55:13.163ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8162 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 2aeb6058-0d0f-47bc-b16c-83244735987a response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
17182024-12-20T22:55:32.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32774
17192024-12-20T22:55:32.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32774 req_id = 1594d66d-fb6d-4ead-ac23-1a9473818e26 response_code = 200 uri = /vpc-routes
17202024-12-20T22:55:32.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17212024-12-20T22:55:32.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32774 req_id = dda272eb-cb7c-4d05-a84f-40439df802cd response_code = 204 uri = /eip-gateways
17222024-12-20T22:55:32.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32774 req_id = 6aa725b2-8a09-4648-a96d-556c5a77857d response_code = 204 uri = /vpc-routes
17232024-12-20T22:55:32.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37635
17242024-12-20T22:55:32.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37635 req_id = d44454b4-ce59-41f9-811e-c6352ba21901 response_code = 200 uri = /v2p
17252024-12-20T22:55:32.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37339
17262024-12-20T22:55:32.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17272024-12-20T22:55:32.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17282024-12-20T22:55:32.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114378 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37339 req_id = 33610064-4d5d-4d49-8569-c3c0e9af8487 response_code = 204 uri = /switch-ports
17292024-12-20T22:55:32.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37339 req_id = 1122d521-748c-4659-9f85-aeb555571222 response_code = 200 uri = /network-bootstore-config
17302024-12-20T22:55:32.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61361
17312024-12-20T22:55:32.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61361 req_id = 24bce54f-fdfe-4d93-8c00-e9529f0c67d7 response_code = 200 uri = /vpc-routes
17322024-12-20T22:55:32.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44145
17332024-12-20T22:55:32.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44145 req_id = ce14026f-6608-4614-baeb-f0683e1e94f9 response_code = 200 uri = /v2p
17342024-12-20T22:55:32.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17352024-12-20T22:55:32.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61361 req_id = 9aa39054-51ae-46dd-aaf5-f5a26300f0ca response_code = 204 uri = /eip-gateways
17362024-12-20T22:55:32.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 794 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61361 req_id = 3e659567-9011-473b-83d8-093ad04227b2 response_code = 204 uri = /vpc-routes
17372024-12-20T22:55:32.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64609
17382024-12-20T22:55:32.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17392024-12-20T22:55:32.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17402024-12-20T22:55:33.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64609 req_id = 8fd2b40f-210e-4abf-8125-8e2d7c1c17e2 response_code = 204 uri = /switch-ports
17412024-12-20T22:55:33.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63899
17422024-12-20T22:55:33.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63899 req_id = 91582bba-ee78-46af-9c46-420c05a3947f response_code = 200 uri = /vpc-routes
17432024-12-20T22:55:33.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64609 req_id = 8098011c-0b28-4596-ac35-1524d24f6c1a response_code = 200 uri = /network-bootstore-config
17442024-12-20T22:55:33.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47076
17452024-12-20T22:55:33.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47076 req_id = bdf60b60-36f1-4497-bae1-26f10d5d0988 response_code = 200 uri = /v2p
17462024-12-20T22:55:33.182ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17472024-12-20T22:55:33.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63899 req_id = 4c0489d6-3eb2-4a72-a1ef-39d4bf5b3e52 response_code = 204 uri = /eip-gateways
17482024-12-20T22:55:33.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63899 req_id = f64f9368-87b9-4cd5-9c89-58256707947c response_code = 204 uri = /vpc-routes
17492024-12-20T22:55:33.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63618
17502024-12-20T22:55:33.284ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17512024-12-20T22:55:33.327ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17522024-12-20T22:55:33.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107673 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63618 req_id = c5641119-0112-41b1-b822-c70e062e6d13 response_code = 204 uri = /switch-ports
17532024-12-20T22:55:33.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63618 req_id = 4dfe1f3b-5aa6-4c75-aa7b-be0e802b8ca7 response_code = 200 uri = /network-bootstore-config
17542024-12-20T22:55:39.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39456
17552024-12-20T22:55:39.146ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39456 req_id = 83b9eead-7ed9-403c-97c7-ce407bd8604b response_code = 200 uri = /baseboard
17562024-12-20T22:55:43.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8523 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 5a4c576b-a8da-411a-869f-c35340fa5837 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
17572024-12-20T22:56:02.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47007
17582024-12-20T22:56:02.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47007 req_id = 489248e3-73f2-4a48-8ef1-df8deb10eeb5 response_code = 200 uri = /vpc-routes
17592024-12-20T22:56:02.481ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17602024-12-20T22:56:02.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47007 req_id = da44c570-0ee1-48f3-9197-f8d1d9b04587 response_code = 204 uri = /eip-gateways
17612024-12-20T22:56:02.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39845
17622024-12-20T22:56:02.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39845 req_id = aead1b92-b965-46e4-8823-ff016fa98cce response_code = 200 uri = /vpc-routes
17632024-12-20T22:56:02.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47007 req_id = 1e68cffe-1220-4f2f-9fb4-9da68406b29e response_code = 204 uri = /vpc-routes
17642024-12-20T22:56:02.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17652024-12-20T22:56:02.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39845 req_id = adab52df-fab5-4877-b334-af3f42990c2e response_code = 204 uri = /eip-gateways
17662024-12-20T22:56:02.639ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44096
17672024-12-20T22:56:02.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44096 req_id = 865903fe-d494-4359-b17a-dd1b341ec560 response_code = 200 uri = /v2p
17682024-12-20T22:56:02.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39845 req_id = 3b92d7b0-7cb3-486c-8603-e7c8d8c7f243 response_code = 204 uri = /vpc-routes
17692024-12-20T22:56:02.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43846
17702024-12-20T22:56:02.750ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17712024-12-20T22:56:02.805ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17722024-12-20T22:56:02.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43846 req_id = f9124c1d-147c-4820-ada4-c531b133a208 response_code = 204 uri = /switch-ports
17732024-12-20T22:56:02.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36589
17742024-12-20T22:56:02.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36589 req_id = 0cc8aa90-e653-4825-806b-b3b078d4cf2a response_code = 200 uri = /v2p
17752024-12-20T22:56:02.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43846 req_id = e9220871-1b28-4dff-8262-c02574faed6c response_code = 200 uri = /network-bootstore-config
17762024-12-20T22:56:03.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62232
17772024-12-20T22:56:03.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62232 req_id = a87e8201-a0ea-4c23-ae7e-0a0d2a337ae8 response_code = 200 uri = /vpc-routes
17782024-12-20T22:56:03.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49510
17792024-12-20T22:56:03.120ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17802024-12-20T22:56:03.159ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17812024-12-20T22:56:03.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49510 req_id = 6c451ba2-3e2b-443c-8126-f3af53076896 response_code = 204 uri = /switch-ports
17822024-12-20T22:56:03.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38259
17832024-12-20T22:56:03.226ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17842024-12-20T22:56:03.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62232 req_id = e2a03b1f-5d5b-44f0-b464-3533cd66ae97 response_code = 204 uri = /eip-gateways
17852024-12-20T22:56:03.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49510 req_id = 4453339d-1d37-4994-b193-96e0073b0583 response_code = 200 uri = /network-bootstore-config
17862024-12-20T22:56:03.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38259 req_id = f25ed256-d812-42a5-ad42-0a1dcbf08132 response_code = 200 uri = /v2p
17872024-12-20T22:56:03.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62232 req_id = 581702c7-ef1b-49f8-b969-04413d2435d7 response_code = 204 uri = /vpc-routes
17882024-12-20T22:56:03.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39831
17892024-12-20T22:56:03.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17902024-12-20T22:56:03.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17912024-12-20T22:56:03.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39831 req_id = 39b6f1a3-cc77-4179-b652-99028fe5fa72 response_code = 204 uri = /switch-ports
17922024-12-20T22:56:03.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39831 req_id = ecca1c46-845f-4d30-a6ac-9472d8392fee response_code = 200 uri = /network-bootstore-config
17932024-12-20T22:56:09.179ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40146
17942024-12-20T22:56:09.180ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40146 req_id = 3e07f056-936f-49c6-acf6-f46f2cb81de7 response_code = 200 uri = /baseboard
17952024-12-20T22:56:13.162ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5892 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 8edb3f29-4a49-4b77-89fb-2ace21c3f37e response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
17962024-12-20T22:56:32.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54618
17972024-12-20T22:56:32.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54618 req_id = fddf8718-eee0-4ed0-a19c-cca4f5f0b0ed response_code = 200 uri = /vpc-routes
17982024-12-20T22:56:32.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
17992024-12-20T22:56:32.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54618 req_id = 40da4b0e-c18d-4220-8718-d4ef303c3aaa response_code = 204 uri = /eip-gateways
18002024-12-20T22:56:32.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54618 req_id = 87d5696d-ae51-4639-b74b-19a2643e6046 response_code = 204 uri = /vpc-routes
18012024-12-20T22:56:32.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56626
18022024-12-20T22:56:32.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56626 req_id = a4df5310-2644-4f28-862c-4116dd0a392d response_code = 200 uri = /v2p
18032024-12-20T22:56:32.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45150
18042024-12-20T22:56:32.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18052024-12-20T22:56:32.502ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18062024-12-20T22:56:32.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45150 req_id = 2acd9e00-9cbd-4278-884f-868c44ccdfbe response_code = 204 uri = /switch-ports
18072024-12-20T22:56:32.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45150 req_id = b24492e7-75ae-4ccf-90e1-0dcbb723599e response_code = 200 uri = /network-bootstore-config
18082024-12-20T22:56:32.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57135
18092024-12-20T22:56:32.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57135 req_id = 76cd57cf-b4e7-4ea0-b405-9ac154b79509 response_code = 200 uri = /vpc-routes
18102024-12-20T22:56:32.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38131
18112024-12-20T22:56:32.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38131 req_id = 658ea0a5-6e15-496f-9f90-33a1de91bfc4 response_code = 200 uri = /v2p
18122024-12-20T22:56:32.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18132024-12-20T22:56:32.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57135 req_id = c0926fed-b016-4580-a155-6522ea132947 response_code = 204 uri = /eip-gateways
18142024-12-20T22:56:32.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57135 req_id = 6e4f67c9-797a-481c-baa9-de6a9af38a34 response_code = 204 uri = /vpc-routes
18152024-12-20T22:56:32.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65473
18162024-12-20T22:56:32.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65473 req_id = 32b083a7-995b-4d88-aa1a-afc428f1cee8 response_code = 200 uri = /vpc-routes
18172024-12-20T22:56:32.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18182024-12-20T22:56:32.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65473 req_id = 14ad468c-7b3b-4dc9-8412-072584d232f3 response_code = 204 uri = /eip-gateways
18192024-12-20T22:56:32.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65473 req_id = b8cf1211-205b-4b6f-9d36-e2da4e24c110 response_code = 204 uri = /vpc-routes
18202024-12-20T22:56:32.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46391
18212024-12-20T22:56:32.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18222024-12-20T22:56:32.944ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18232024-12-20T22:56:33.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46391 req_id = 948668d4-d879-498d-9286-031ea43d8508 response_code = 204 uri = /switch-ports
18242024-12-20T22:56:33.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46391 req_id = c5002deb-2c66-4a47-b691-feb8c8c96dd5 response_code = 200 uri = /network-bootstore-config
18252024-12-20T22:56:33.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55746
18262024-12-20T22:56:33.062ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18272024-12-20T22:56:33.102ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18282024-12-20T22:56:33.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104550 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55746 req_id = 7920522d-a077-4b87-9d2b-98a758d4912b response_code = 204 uri = /switch-ports
18292024-12-20T22:56:33.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59120
18302024-12-20T22:56:33.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55746 req_id = 68cd515a-3952-437a-a6e3-7059b1932712 response_code = 200 uri = /network-bootstore-config
18312024-12-20T22:56:33.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59120 req_id = 6bd7cade-5fd1-4b5b-9735-abdd98fe2f1d response_code = 200 uri = /v2p
18322024-12-20T22:56:39.213ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37650
18332024-12-20T22:56:39.213ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37650 req_id = bcd7bdcd-6226-4df6-9beb-767403240800 response_code = 200 uri = /baseboard
18342024-12-20T22:56:43.162ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7129 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = c45c5fce-3c2f-4fea-bed3-7fdb38353e45 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
18352024-12-20T22:57:02.317ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35762
18362024-12-20T22:57:02.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35762 req_id = 10768d4f-3f7e-4046-b92d-c27a42b5a7fe response_code = 200 uri = /vpc-routes
18372024-12-20T22:57:02.488ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18382024-12-20T22:57:02.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18392024-12-20T22:57:02.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35762 req_id = 72ef266d-014b-4261-9d41-ed47f373caec response_code = 204 uri = /eip-gateways
18402024-12-20T22:57:02.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35762 req_id = e5f567db-d75c-4e14-b4d7-0a89512d7421 response_code = 204 uri = /vpc-routes
18412024-12-20T22:57:02.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53895
18422024-12-20T22:57:02.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53895 req_id = b169f06b-9976-42f9-95d4-32e610ca766e response_code = 200 uri = /v2p
18432024-12-20T22:57:02.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56063
18442024-12-20T22:57:02.924ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18452024-12-20T22:57:02.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18462024-12-20T22:57:03.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119194 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56063 req_id = 81e5dd7b-2851-43b3-81cf-e67e93654d4e response_code = 204 uri = /switch-ports
18472024-12-20T22:57:03.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34841
18482024-12-20T22:57:03.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56063 req_id = 04276bed-d311-4f1f-a888-6189d6718a73 response_code = 200 uri = /network-bootstore-config
18492024-12-20T22:57:03.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34841 req_id = 1c12675b-62f3-4334-9736-52253c7e62f6 response_code = 200 uri = /vpc-routes
18502024-12-20T22:57:03.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62163
18512024-12-20T22:57:03.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62163 req_id = 76b48786-b3cd-4f62-adbf-6c21bd9479f8 response_code = 200 uri = /v2p
18522024-12-20T22:57:03.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65138
18532024-12-20T22:57:03.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65138 req_id = 94db64c7-1390-404f-be06-6ae88c1e0876 response_code = 200 uri = /vpc-routes
18542024-12-20T22:57:03.089ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18552024-12-20T22:57:03.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34841 req_id = c7beda3e-b85a-4962-84a7-73e9fc6880dc response_code = 204 uri = /eip-gateways
18562024-12-20T22:57:03.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34841 req_id = 6ad85aa9-af48-4fd1-981f-29e288fbdd58 response_code = 204 uri = /vpc-routes
18572024-12-20T22:57:03.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18582024-12-20T22:57:03.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65138 req_id = d368c14f-47cc-45d8-b3a6-80eadbf0f898 response_code = 204 uri = /eip-gateways
18592024-12-20T22:57:03.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57387
18602024-12-20T22:57:03.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18612024-12-20T22:57:03.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18622024-12-20T22:57:03.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98145 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57387 req_id = 86dcb227-cf02-4933-994d-9f41d3fe62af response_code = 204 uri = /switch-ports
18632024-12-20T22:57:03.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57387 req_id = 37fc75bf-fa64-433a-a268-e2739454f134 response_code = 200 uri = /network-bootstore-config
18642024-12-20T22:57:03.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65190
18652024-12-20T22:57:03.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65190 req_id = e283b55a-5b75-471f-af7d-9498804daa71 response_code = 200 uri = /v2p
18662024-12-20T22:57:03.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45511
18672024-12-20T22:57:03.372ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18682024-12-20T22:57:03.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18692024-12-20T22:57:03.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45511 req_id = 1b944be6-a4e4-4dc4-bf86-2b920842bc6e response_code = 204 uri = /switch-ports
18702024-12-20T22:57:03.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65138 req_id = 25ae5f1d-dca6-4bf8-b364-cd21d32c5ebe response_code = 204 uri = /vpc-routes
18712024-12-20T22:57:03.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45511 req_id = 8fdb09bc-5005-416c-b769-1845bd53b4bd response_code = 200 uri = /network-bootstore-config
18722024-12-20T22:57:09.246ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40502
18732024-12-20T22:57:09.246ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40502 req_id = 78280096-edff-40a1-8207-0b0606898879 response_code = 200 uri = /baseboard
18742024-12-20T22:57:13.161ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5264 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 686e746d-53a6-40f2-9f68-99ef76463a05 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
18752024-12-20T22:57:32.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39552
18762024-12-20T22:57:32.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39552 req_id = 37647a0e-d2dc-48bf-844a-a9b3415fb686 response_code = 200 uri = /vpc-routes
18772024-12-20T22:57:32.236ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18782024-12-20T22:57:32.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39552 req_id = b3d037ac-7c57-4c9c-bd84-51df72f8cede response_code = 204 uri = /eip-gateways
18792024-12-20T22:57:32.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39552 req_id = f57279c3-7147-4943-8305-6cdda29b780a response_code = 204 uri = /vpc-routes
18802024-12-20T22:57:32.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57090
18812024-12-20T22:57:32.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57090 req_id = f2a1734e-e5c9-4e5c-8c8c-53fba1bab0d0 response_code = 200 uri = /v2p
18822024-12-20T22:57:32.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51124
18832024-12-20T22:57:32.472ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18842024-12-20T22:57:32.517ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18852024-12-20T22:57:32.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51124 req_id = 763205ca-bcf2-4e48-85e9-c44f15c85902 response_code = 204 uri = /switch-ports
18862024-12-20T22:57:32.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51124 req_id = ee492a87-828b-4c28-82c7-4170de27382a response_code = 200 uri = /network-bootstore-config
18872024-12-20T22:57:32.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34436
18882024-12-20T22:57:32.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34436 req_id = fe9e3591-fb3e-450c-b1ea-87a994fe1f76 response_code = 200 uri = /vpc-routes
18892024-12-20T22:57:32.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
18902024-12-20T22:57:32.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34436 req_id = a36d8687-5fb8-4f78-92c9-8dab007cdb27 response_code = 204 uri = /eip-gateways
18912024-12-20T22:57:32.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34436 req_id = cc65eedf-80a7-42bd-82d4-21e54625554c response_code = 204 uri = /vpc-routes
18922024-12-20T22:57:32.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61693
18932024-12-20T22:57:32.673ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18942024-12-20T22:57:32.712ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18952024-12-20T22:57:32.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61693 req_id = 7be8a512-77f0-4902-a94b-5bab2d0a7283 response_code = 204 uri = /switch-ports
18962024-12-20T22:57:32.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35525
18972024-12-20T22:57:32.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61693 req_id = 14b29741-e5e5-4504-97a5-ecd5cfdc45a0 response_code = 200 uri = /network-bootstore-config
18982024-12-20T22:57:32.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35525 req_id = 91a8074f-7dd6-4a2b-bc67-1dc700ffc647 response_code = 200 uri = /v2p
18992024-12-20T22:57:32.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54526
19002024-12-20T22:57:32.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54526 req_id = 2a974f7a-5c49-464a-9453-502152b0763e response_code = 200 uri = /vpc-routes
19012024-12-20T22:57:32.955ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19022024-12-20T22:57:32.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54526 req_id = cadcc9c7-7760-409f-8aa7-635142b4fd76 response_code = 204 uri = /eip-gateways
19032024-12-20T22:57:32.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54526 req_id = df2b61e1-2052-4681-ad55-2bcaecdb6d14 response_code = 204 uri = /vpc-routes
19042024-12-20T22:57:33.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46245
19052024-12-20T22:57:33.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46245 req_id = 7d21db6f-f79d-4bec-a4ff-8e6b5417c8dc response_code = 200 uri = /v2p
19062024-12-20T22:57:33.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43840
19072024-12-20T22:57:33.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19082024-12-20T22:57:33.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19092024-12-20T22:57:33.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43840 req_id = 09272b1c-9862-4ef0-a665-44d83e45fbe0 response_code = 204 uri = /switch-ports
19102024-12-20T22:57:33.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43840 req_id = 19a6048f-6cad-490c-9e59-c8c3a02a56aa response_code = 200 uri = /network-bootstore-config
19112024-12-20T22:57:39.278ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45181
19122024-12-20T22:57:39.278ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45181 req_id = 08d93b35-eefb-469c-9614-a4d672b2a1d4 response_code = 200 uri = /baseboard
19132024-12-20T22:57:43.163ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6580 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 7e569ca4-31ff-4966-b6fd-1c7577e06ce4 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
19142024-12-20T22:58:02.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43772
19152024-12-20T22:58:02.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43772 req_id = 9b291718-992d-449b-be40-4f4c539babf5 response_code = 200 uri = /vpc-routes
19162024-12-20T22:58:02.490ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19172024-12-20T22:58:02.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43772 req_id = cc743b40-6a2e-4c82-9996-8c007cfd541e response_code = 204 uri = /eip-gateways
19182024-12-20T22:58:02.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36952
19192024-12-20T22:58:02.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36952 req_id = a1b03e18-442a-4fcf-99ad-589b0b1edc30 response_code = 200 uri = /v2p
19202024-12-20T22:58:02.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43772 req_id = 1d8d8948-867f-415c-87d4-0d4e525ad68a response_code = 204 uri = /vpc-routes
19212024-12-20T22:58:02.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65345
19222024-12-20T22:58:02.593ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19232024-12-20T22:58:02.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19242024-12-20T22:58:02.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90549 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65345 req_id = 51cf327c-51bd-4ac2-98fd-199c70524b3f response_code = 204 uri = /switch-ports
19252024-12-20T22:58:02.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65345 req_id = 130e9fd4-6bbf-40f0-89f7-cb69ad96b551 response_code = 200 uri = /network-bootstore-config
19262024-12-20T22:58:02.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60153
19272024-12-20T22:58:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60153 req_id = 230ad73a-52ff-4531-b09a-6738e3ec0002 response_code = 200 uri = /vpc-routes
19282024-12-20T22:58:02.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19292024-12-20T22:58:02.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60153 req_id = ec5a860d-676f-4a7c-aa30-184400504e36 response_code = 204 uri = /eip-gateways
19302024-12-20T22:58:02.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60153 req_id = 08b4b6bb-9549-46ad-a551-2fe7261982ed response_code = 204 uri = /vpc-routes
19312024-12-20T22:58:02.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62389
19322024-12-20T22:58:02.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62389 req_id = 810fdf5a-e59e-4eb1-8935-cfc50f98f1b1 response_code = 200 uri = /v2p
19332024-12-20T22:58:03.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32967
19342024-12-20T22:58:03.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19352024-12-20T22:58:03.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19362024-12-20T22:58:03.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96172 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32967 req_id = ff9c8e3c-2c7c-48e6-893a-e538884a26da response_code = 204 uri = /switch-ports
19372024-12-20T22:58:03.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61080
19382024-12-20T22:58:03.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61080 req_id = 01f57655-29f5-4ee9-8573-33dd32e1824f response_code = 200 uri = /vpc-routes
19392024-12-20T22:58:03.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32967 req_id = b5cfaeb7-ab0d-4bcd-b47d-aa4e45d5b316 response_code = 200 uri = /network-bootstore-config
19402024-12-20T22:58:03.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35524
19412024-12-20T22:58:03.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35524 req_id = 5349c481-76e5-4def-b651-2656387453a9 response_code = 200 uri = /v2p
19422024-12-20T22:58:03.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19432024-12-20T22:58:03.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61080 req_id = e30d8a40-7b93-49f2-bcf0-1f613e031074 response_code = 204 uri = /eip-gateways
19442024-12-20T22:58:03.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61080 req_id = 9db99695-4c83-401a-859c-f686f34d788a response_code = 204 uri = /vpc-routes
19452024-12-20T22:58:03.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52047
19462024-12-20T22:58:03.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19472024-12-20T22:58:03.344ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19482024-12-20T22:58:03.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97925 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52047 req_id = 303d4105-e8ac-4641-b7fb-fc9e9fea387e response_code = 204 uri = /switch-ports
19492024-12-20T22:58:03.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52047 req_id = 0fd5bd03-4938-4012-9714-6abe3d80cded response_code = 200 uri = /network-bootstore-config
19502024-12-20T22:58:09.312ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65292
19512024-12-20T22:58:09.312ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65292 req_id = 272b581d-c452-4300-9ede-49c1fbf78f40 response_code = 200 uri = /baseboard
19522024-12-20T22:58:13.162ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6535 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = b5dc1115-db6c-4f42-a58a-9a52fbeb42b0 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
19532024-12-20T22:58:32.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53140
19542024-12-20T22:58:32.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53140 req_id = b5351201-c579-4a3b-b4cf-c9cd69fde887 response_code = 200 uri = /vpc-routes
19552024-12-20T22:58:32.240ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19562024-12-20T22:58:32.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53140 req_id = 8273937f-f901-4839-853b-8d61342bd512 response_code = 204 uri = /eip-gateways
19572024-12-20T22:58:32.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53164
19582024-12-20T22:58:32.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53164 req_id = 6cb5a2d3-223e-4f49-a17b-f428d84cda67 response_code = 200 uri = /v2p
19592024-12-20T22:58:32.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53140 req_id = 879ff3f2-fd7f-4b67-a8b3-b022864957d3 response_code = 204 uri = /vpc-routes
19602024-12-20T22:58:32.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44776
19612024-12-20T22:58:32.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19622024-12-20T22:58:32.450ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19632024-12-20T22:58:32.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44776 req_id = 62ad0755-1a40-4fda-b7f3-5e82483f8bba response_code = 204 uri = /switch-ports
19642024-12-20T22:58:32.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44776 req_id = a5e2ee01-827f-41c2-934e-80af25847295 response_code = 200 uri = /network-bootstore-config
19652024-12-20T22:58:32.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35120
19662024-12-20T22:58:32.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35120 req_id = 7b591311-8912-484e-8c6c-22e2dfb67ba2 response_code = 200 uri = /vpc-routes
19672024-12-20T22:58:32.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64791
19682024-12-20T22:58:32.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64791 req_id = bad1e657-a3b1-420f-8851-80a2a325a898 response_code = 200 uri = /v2p
19692024-12-20T22:58:32.686ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19702024-12-20T22:58:32.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35120 req_id = 8f7f85a2-ffe5-451d-a6c0-c5bf57c8f522 response_code = 204 uri = /eip-gateways
19712024-12-20T22:58:32.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35120 req_id = 051bbbc7-ac7f-42ce-8bc2-35b2872605e1 response_code = 204 uri = /vpc-routes
19722024-12-20T22:58:32.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54234
19732024-12-20T22:58:32.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19742024-12-20T22:58:32.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19752024-12-20T22:58:32.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54234 req_id = 00f30b98-0ad4-4acb-b656-958cf08db84d response_code = 204 uri = /switch-ports
19762024-12-20T22:58:32.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54234 req_id = 9cebf7dc-ca59-4603-89ca-b3036448ba35 response_code = 200 uri = /network-bootstore-config
19772024-12-20T22:58:32.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33221
19782024-12-20T22:58:32.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33221 req_id = 74f49dfa-0c45-4dee-a649-80e9c63cccc6 response_code = 200 uri = /vpc-routes
19792024-12-20T22:58:33.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19802024-12-20T22:58:33.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33221 req_id = f6e21409-e227-41b9-995f-dbd51b8e315d response_code = 204 uri = /eip-gateways
19812024-12-20T22:58:33.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44275
19822024-12-20T22:58:33.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44275 req_id = bf3c0fda-ffe4-459c-89f7-e81a801521de response_code = 200 uri = /v2p
19832024-12-20T22:58:33.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33221 req_id = 1626524b-db57-4b04-9968-d0a0fb0e2c42 response_code = 204 uri = /vpc-routes
19842024-12-20T22:58:33.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59980
19852024-12-20T22:58:33.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19862024-12-20T22:58:33.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19872024-12-20T22:58:33.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59980 req_id = b4a71dec-5a0d-4aec-9acf-f00cf27cef50 response_code = 204 uri = /switch-ports
19882024-12-20T22:58:33.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59980 req_id = ce57b367-b068-4c00-8ac2-11d1db2454fc response_code = 200 uri = /network-bootstore-config
19892024-12-20T22:58:39.345ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59378
19902024-12-20T22:58:39.345ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59378 req_id = 2ff533f6-f10f-465d-bdc6-6a2916d1f578 response_code = 200 uri = /baseboard
19912024-12-20T22:58:43.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7531 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 8856a71b-6934-439f-9901-5731a06cd2c8 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
19922024-12-20T22:59:02.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56201
19932024-12-20T22:59:02.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56201 req_id = 4aec0bbb-6913-4bcf-85f4-8b82152f00f4 response_code = 200 uri = /vpc-routes
19942024-12-20T22:59:02.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65206
19952024-12-20T22:59:02.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65206 req_id = 241b8b86-d5c4-4a92-b7dc-fdb3cb288c7c response_code = 200 uri = /v2p
19962024-12-20T22:59:02.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
19972024-12-20T22:59:02.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56201 req_id = 6a57960f-c89a-456f-8dc2-7c64610d247b response_code = 204 uri = /eip-gateways
19982024-12-20T22:59:02.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56201 req_id = ef947c0a-b6bb-48d3-afb9-7e357055bec5 response_code = 204 uri = /vpc-routes
19992024-12-20T22:59:02.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54276
20002024-12-20T22:59:02.498ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20012024-12-20T22:59:02.547ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20022024-12-20T22:59:02.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54276 req_id = 1f67d84a-8516-4e0c-a89d-e175f4c8d030 response_code = 204 uri = /switch-ports
20032024-12-20T22:59:02.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62873
20042024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20052024-12-20T22:59:02.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54276 req_id = 6e4d4d1a-4597-44e1-9512-2ec3560ddf75 response_code = 200 uri = /network-bootstore-config
20062024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20072024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20082024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20092024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20102024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20112024-12-20T22:59:02.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20122024-12-20T22:59:02.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 462 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62873 req_id = 67d64f5b-7ad9-4b61-a6f2-eb5cc92f230e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20132024-12-20T22:59:02.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35108
20142024-12-20T22:59:02.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35108 req_id = 54bd4333-303d-4a31-a2af-293505a1b361 response_code = 200 uri = /vpc-routes
20152024-12-20T22:59:02.728ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
20162024-12-20T22:59:02.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35108 req_id = 63c0c295-fa67-4fc4-9bfb-24b5b52a2693 response_code = 204 uri = /eip-gateways
20172024-12-20T22:59:02.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35108 req_id = 632bab7e-367f-43b1-a2e8-8d50d21aac17 response_code = 204 uri = /vpc-routes
20182024-12-20T22:59:02.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52988
20192024-12-20T22:59:02.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52988 req_id = 8cbdc15d-30b7-40f5-a5e2-7401c286b384 response_code = 200 uri = /v2p
20202024-12-20T22:59:02.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54153
20212024-12-20T22:59:02.846ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20222024-12-20T22:59:02.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20232024-12-20T22:59:02.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102548 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54153 req_id = 620e3a3a-f40e-4438-bd46-c76bc6604b9a response_code = 204 uri = /switch-ports
20242024-12-20T22:59:02.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54153 req_id = accc2894-ed00-46a5-9c81-ec1ad131a3ef response_code = 200 uri = /network-bootstore-config
20252024-12-20T22:59:03.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58671
20262024-12-20T22:59:03.090ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20272024-12-20T22:59:03.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20282024-12-20T22:59:03.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20292024-12-20T22:59:03.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20302024-12-20T22:59:03.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20312024-12-20T22:59:03.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20322024-12-20T22:59:03.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20332024-12-20T22:59:03.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58671 req_id = df69a2ec-b307-4ecc-baf9-4241ce16a3d4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20342024-12-20T22:59:03.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52041
20352024-12-20T22:59:03.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52041 req_id = 5d4ccc34-801b-42ac-a814-385a0e4b724b response_code = 200 uri = /vpc-routes
20362024-12-20T22:59:03.183ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
20372024-12-20T22:59:03.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52041 req_id = 30d7855b-a51c-4c9c-a814-a2fe70af77c3 response_code = 204 uri = /eip-gateways
20382024-12-20T22:59:03.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52041 req_id = 37067544-bcb2-4d49-9162-f6a1771176d7 response_code = 204 uri = /vpc-routes
20392024-12-20T22:59:03.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39743
20402024-12-20T22:59:03.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20412024-12-20T22:59:03.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20422024-12-20T22:59:03.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39743 req_id = 32990ad7-d280-4b61-99be-5dd6fb5dd6f2 response_code = 204 uri = /switch-ports
20432024-12-20T22:59:03.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56306
20442024-12-20T22:59:03.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39743 req_id = 7c424217-9fff-405c-a5a8-1c4c39255fb1 response_code = 200 uri = /network-bootstore-config
20452024-12-20T22:59:03.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56306 req_id = 400884a5-c17e-4d52-a015-191b12eccde8 response_code = 200 uri = /v2p
20462024-12-20T22:59:03.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64023
20472024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20482024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20492024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20502024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20512024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20522024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20532024-12-20T22:59:03.350ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20542024-12-20T22:59:03.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64023 req_id = ac953c68-4965-444d-93e4-520769f38e3c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20552024-12-20T22:59:09.378ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42404
20562024-12-20T22:59:09.379ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42404 req_id = e22d8945-07d9-41d1-b63f-4d5dcaa0dac0 response_code = 200 uri = /baseboard
20572024-12-20T22:59:13.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8176 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 3c61cb65-fb10-4c01-b621-1b4b53cc71c4 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
20582024-12-20T22:59:32.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58428
20592024-12-20T22:59:32.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58428 req_id = c662cc3a-8dd8-4408-80f0-309da76cb546 response_code = 200 uri = /vpc-routes
20602024-12-20T22:59:32.200ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
20612024-12-20T22:59:32.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58428 req_id = fd6c5a4c-5ee3-4f89-a4ca-a9adbf7bba25 response_code = 204 uri = /eip-gateways
20622024-12-20T22:59:32.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58428 req_id = 708c3b6a-28d3-473c-9d64-e47691524442 response_code = 204 uri = /vpc-routes
20632024-12-20T22:59:32.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53764
20642024-12-20T22:59:32.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53764 req_id = 39701242-2410-45c9-9301-60e5d5d9ad22 response_code = 200 uri = /v2p
20652024-12-20T22:59:32.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41926
20662024-12-20T22:59:32.335ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20672024-12-20T22:59:32.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20682024-12-20T22:59:32.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41926 req_id = ffa732a3-deff-4638-87f2-35627229ff99 response_code = 204 uri = /switch-ports
20692024-12-20T22:59:32.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41926 req_id = a4a38221-4ea9-4a10-ba6c-0147c82aef23 response_code = 200 uri = /network-bootstore-config
20702024-12-20T22:59:32.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59501
20712024-12-20T22:59:32.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59501 req_id = 45257e87-40a1-4865-bd3e-93dc0a0fce14 response_code = 200 uri = /vpc-routes
20722024-12-20T22:59:32.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
20732024-12-20T22:59:32.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59501 req_id = 42b79eb7-a3b5-4ce9-a3e7-f30ab4145dbd response_code = 204 uri = /eip-gateways
20742024-12-20T22:59:32.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56694
20752024-12-20T22:59:32.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56694 req_id = 71833193-3422-4678-8507-d47668105b5d response_code = 200 uri = /v2p
20762024-12-20T22:59:32.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59501 req_id = c3aed2e6-c1eb-4136-9609-f5d202cf80ee response_code = 204 uri = /vpc-routes
20772024-12-20T22:59:32.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43143
20782024-12-20T22:59:32.854ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20792024-12-20T22:59:32.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20802024-12-20T22:59:32.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43143 req_id = 531ff1e2-86d8-496d-9963-330c85977bed response_code = 204 uri = /switch-ports
20812024-12-20T22:59:32.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43143 req_id = 03879d5a-95db-4a25-968b-6066e378b8a4 response_code = 200 uri = /network-bootstore-config
20822024-12-20T22:59:32.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53077
20832024-12-20T22:59:32.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53077 req_id = 9b78dff0-82fa-4f14-9cfd-9ac4733e9700 response_code = 200 uri = /vpc-routes
20842024-12-20T22:59:32.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
20852024-12-20T22:59:32.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53077 req_id = 485dbef7-b2a7-4a5d-8c30-1fabba6b7b38 response_code = 204 uri = /eip-gateways
20862024-12-20T22:59:33.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50236
20872024-12-20T22:59:33.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50236 req_id = a4f605ec-ec2f-474a-9fdf-03fbfcd7f620 response_code = 200 uri = /v2p
20882024-12-20T22:59:33.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53077 req_id = 2fe269b4-a55b-4122-b973-ed10800095ee response_code = 204 uri = /vpc-routes
20892024-12-20T22:59:33.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61025
20902024-12-20T22:59:33.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20912024-12-20T22:59:33.200ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20922024-12-20T22:59:33.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 9951f943-15d0-45ce-b5d7-9f61b7da82a2 response_code = 204 uri = /switch-ports
20932024-12-20T22:59:33.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61025 req_id = f02d8cb6-d402-4e9c-a256-bf3a2473dc5d response_code = 200 uri = /network-bootstore-config
20942024-12-20T22:59:39.411ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41556
20952024-12-20T22:59:39.411ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41556 req_id = d968c0ef-c488-4c45-a8cd-b980d2c91d3d response_code = 200 uri = /baseboard
20962024-12-20T22:59:43.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7646 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = e5b2145e-6506-4154-9927-2122fe1e70e3 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
20972024-12-20T23:00:02.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33182
20982024-12-20T23:00:02.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33182 req_id = a444bc78-2d99-4dda-8668-b89c5e41ce44 response_code = 200 uri = /v2p
20992024-12-20T23:00:02.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39401
21002024-12-20T23:00:02.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39401 req_id = 5e711a01-e997-48ae-a7c1-7e8bf13fdc8f response_code = 200 uri = /vpc-routes
21012024-12-20T23:00:02.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21022024-12-20T23:00:02.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39401 req_id = 17c59fb9-27fb-4afb-bafa-d8cabd969b41 response_code = 204 uri = /eip-gateways
21032024-12-20T23:00:02.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39401 req_id = ec184807-7d80-4261-a339-a7e6b5990a9f response_code = 204 uri = /vpc-routes
21042024-12-20T23:00:02.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58037
21052024-12-20T23:00:02.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21062024-12-20T23:00:02.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21072024-12-20T23:00:02.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58037 req_id = 85eebe3e-16b4-4200-863a-d00b194f0eda response_code = 204 uri = /switch-ports
21082024-12-20T23:00:02.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44033
21092024-12-20T23:00:02.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44033 req_id = a3d1b345-f837-4719-a851-c6ee08ed4f59 response_code = 200 uri = /vpc-routes
21102024-12-20T23:00:02.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58037 req_id = 87a315f5-5e3f-4ced-9406-df2301c214e8 response_code = 200 uri = /network-bootstore-config
21112024-12-20T23:00:02.959ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21122024-12-20T23:00:02.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44033 req_id = f360ed91-4ec3-48e2-b8e2-3004d35e9a96 response_code = 204 uri = /eip-gateways
21132024-12-20T23:00:02.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44033 req_id = 87ad62f4-0338-4652-9fc9-20899693f093 response_code = 204 uri = /vpc-routes
21142024-12-20T23:00:02.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65271
21152024-12-20T23:00:02.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65271 req_id = 92ddc4f5-cbc7-45f6-b09d-c1ff676a8ba1 response_code = 200 uri = /v2p
21162024-12-20T23:00:03.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42937
21172024-12-20T23:00:03.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42937 req_id = d4b99403-c8b2-4190-948b-4f36438c164a response_code = 200 uri = /vpc-routes
21182024-12-20T23:00:03.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53997
21192024-12-20T23:00:03.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21202024-12-20T23:00:03.128ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21212024-12-20T23:00:03.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105333 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53997 req_id = eb6a511b-f1fc-4c98-a22e-e32174615593 response_code = 204 uri = /switch-ports
21222024-12-20T23:00:03.196ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21232024-12-20T23:00:03.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42937 req_id = ba3a5aef-79f3-44de-b781-43ab4312d7c8 response_code = 204 uri = /eip-gateways
21242024-12-20T23:00:03.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53997 req_id = bed96585-93e2-48f3-ab6d-20fa18c5973d response_code = 200 uri = /network-bootstore-config
21252024-12-20T23:00:03.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56062
21262024-12-20T23:00:03.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56062 req_id = e199750f-ffce-4938-b30d-2d9e486232cd response_code = 200 uri = /v2p
21272024-12-20T23:00:03.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42937 req_id = ea064725-33a8-4eb3-94ef-4b9c655e4320 response_code = 204 uri = /vpc-routes
21282024-12-20T23:00:03.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46454
21292024-12-20T23:00:03.409ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21302024-12-20T23:00:03.446ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21312024-12-20T23:00:03.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46454 req_id = 6bfac40a-2e12-4f2a-be88-beac1ac55145 response_code = 204 uri = /switch-ports
21322024-12-20T23:00:03.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46454 req_id = 1037938d-1f52-4f7a-a657-0ace9ccfcacb response_code = 200 uri = /network-bootstore-config
21332024-12-20T23:00:09.444ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59231
21342024-12-20T23:00:09.444ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59231 req_id = ea0a4dcb-a132-41ed-ac00-56e4ff8d6ae1 response_code = 200 uri = /baseboard
21352024-12-20T23:00:13.163ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6306 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = b03b1968-8d0f-4f0c-b433-5ea0202403e5 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
21362024-12-20T23:00:32.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51071
21372024-12-20T23:00:32.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51071 req_id = 060b97e6-7530-4c24-b740-17474db45001 response_code = 200 uri = /vpc-routes
21382024-12-20T23:00:32.179ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21392024-12-20T23:00:32.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51071 req_id = 7749b3bc-df10-4f74-a18e-d2fbf3265333 response_code = 204 uri = /eip-gateways
21402024-12-20T23:00:32.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51071 req_id = 4ef3cfb1-892e-400d-9ad8-4a0d068c96b8 response_code = 204 uri = /vpc-routes
21412024-12-20T23:00:32.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34010
21422024-12-20T23:00:32.338ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21432024-12-20T23:00:32.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21442024-12-20T23:00:32.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34010 req_id = 094f075e-f22e-478c-aacb-68c4ca65733a response_code = 204 uri = /switch-ports
21452024-12-20T23:00:32.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51977
21462024-12-20T23:00:32.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51977 req_id = 1d37e886-f819-4fb5-ae00-6737796e8e61 response_code = 200 uri = /v2p
21472024-12-20T23:00:32.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34010 req_id = 7b33fc9d-fe61-4a5a-a601-82002be7a8e5 response_code = 200 uri = /network-bootstore-config
21482024-12-20T23:00:32.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41394
21492024-12-20T23:00:32.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41394 req_id = 62859f15-5910-49bd-9dfc-32d2905f0b32 response_code = 200 uri = /vpc-routes
21502024-12-20T23:00:32.664ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21512024-12-20T23:00:32.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41394 req_id = 3265d55d-cf9a-4182-8112-33a223a7398e response_code = 204 uri = /eip-gateways
21522024-12-20T23:00:32.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52900
21532024-12-20T23:00:32.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52900 req_id = b1d23918-c944-4fe7-95ce-693903f48610 response_code = 200 uri = /v2p
21542024-12-20T23:00:32.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41394 req_id = eb3d22a2-bbb8-49f7-8fea-4b5874c2a0a2 response_code = 204 uri = /vpc-routes
21552024-12-20T23:00:32.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55328
21562024-12-20T23:00:32.794ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21572024-12-20T23:00:32.839ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21582024-12-20T23:00:32.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103289 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55328 req_id = 9438a909-dcc5-498f-9760-d6bfe1386f31 response_code = 204 uri = /switch-ports
21592024-12-20T23:00:32.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55328 req_id = d11935ae-73cd-4996-bc03-23167a75fcff response_code = 200 uri = /network-bootstore-config
21602024-12-20T23:00:32.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57268
21612024-12-20T23:00:32.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57268 req_id = 4162e6e1-eeba-4460-a84c-ec5b00b027e0 response_code = 200 uri = /vpc-routes
21622024-12-20T23:00:32.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21632024-12-20T23:00:32.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57268 req_id = c32a1ea8-2186-48b6-939a-be82ddb7d4e7 response_code = 204 uri = /eip-gateways
21642024-12-20T23:00:33.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50145
21652024-12-20T23:00:33.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50145 req_id = ec9849ef-b512-4a42-837b-fcdfa586ff05 response_code = 200 uri = /v2p
21662024-12-20T23:00:33.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57268 req_id = 40239302-c0be-460f-a9c7-58b1f04b437c response_code = 204 uri = /vpc-routes
21672024-12-20T23:00:33.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52763
21682024-12-20T23:00:33.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21692024-12-20T23:00:33.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21702024-12-20T23:00:33.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99661 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52763 req_id = 082dc3c9-456b-4648-b6ca-6e363e89c5b9 response_code = 204 uri = /switch-ports
21712024-12-20T23:00:33.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52763 req_id = 5001b719-a0f4-4da5-8909-b7ff8008c1d2 response_code = 200 uri = /network-bootstore-config
21722024-12-20T23:00:39.477ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33532
21732024-12-20T23:00:39.478ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33532 req_id = 3c7bb445-0adf-4e89-9b25-9c98fdf9f17d response_code = 200 uri = /baseboard
21742024-12-20T23:00:43.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7331 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = c912f16b-72e9-40db-b38c-93d523cc98c1 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
21752024-12-20T23:01:02.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56527
21762024-12-20T23:01:02.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56527 req_id = cded61fe-4ec8-4518-bd5b-886c41ebdafd response_code = 200 uri = /vpc-routes
21772024-12-20T23:01:02.324ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21782024-12-20T23:01:02.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56527 req_id = 219f3661-7d9e-4030-8068-2756170609b5 response_code = 204 uri = /eip-gateways
21792024-12-20T23:01:02.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56527 req_id = 0c4e6917-e763-447e-9a3d-c1e2feb0df23 response_code = 204 uri = /vpc-routes
21802024-12-20T23:01:02.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34811
21812024-12-20T23:01:02.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34811 req_id = 4b86de01-272c-44ae-8fab-51d099ac0b6d response_code = 200 uri = /v2p
21822024-12-20T23:01:02.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40201
21832024-12-20T23:01:02.634ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21842024-12-20T23:01:02.676ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21852024-12-20T23:01:02.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40201 req_id = 1b57ea5f-8095-40f9-9773-78dc507e8c05 response_code = 204 uri = /switch-ports
21862024-12-20T23:01:02.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65481
21872024-12-20T23:01:02.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65481 req_id = 2a878e0f-f862-4d8f-ac10-350a78dfd4dc response_code = 200 uri = /vpc-routes
21882024-12-20T23:01:02.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40201 req_id = a0f9d1dd-68ae-41c5-937f-81cff75b18d3 response_code = 200 uri = /network-bootstore-config
21892024-12-20T23:01:02.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55006
21902024-12-20T23:01:02.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55006 req_id = 78bdfc62-b520-4fa6-9abf-78b5a0dc40c8 response_code = 200 uri = /v2p
21912024-12-20T23:01:02.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
21922024-12-20T23:01:02.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65481 req_id = 90c69f35-daf2-4293-b47c-1c4e90178e1a response_code = 204 uri = /eip-gateways
21932024-12-20T23:01:02.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65481 req_id = 296ac51c-e177-4dd8-836d-8d8cf47a9233 response_code = 204 uri = /vpc-routes
21942024-12-20T23:01:02.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61404
21952024-12-20T23:01:02.980ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21962024-12-20T23:01:03.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21972024-12-20T23:01:03.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61404 req_id = 1ba83e8b-95d3-4633-9080-61de9518f02c response_code = 204 uri = /switch-ports
21982024-12-20T23:01:03.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61404 req_id = 7404c5d8-1b17-4116-a6e6-858da6aa27da response_code = 200 uri = /network-bootstore-config
21992024-12-20T23:01:03.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42454
22002024-12-20T23:01:03.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42454 req_id = 374098eb-c5bb-4b63-b612-9654b7751ac1 response_code = 200 uri = /vpc-routes
22012024-12-20T23:01:03.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22022024-12-20T23:01:03.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42454 req_id = 7ab1621c-8ed1-4569-bd10-01b4b88ad4e0 response_code = 204 uri = /eip-gateways
22032024-12-20T23:01:03.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42454 req_id = dc2a0c11-4d31-444f-a359-9cd192ca102a response_code = 204 uri = /vpc-routes
22042024-12-20T23:01:03.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44568
22052024-12-20T23:01:03.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44568 req_id = ffe8c762-948e-4299-84e4-5398016a1c96 response_code = 200 uri = /v2p
22062024-12-20T23:01:03.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44127
22072024-12-20T23:01:03.362ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22082024-12-20T23:01:03.403ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22092024-12-20T23:01:03.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44127 req_id = d4beee02-2d8d-4a42-8bb8-ae91f5e8233c response_code = 204 uri = /switch-ports
22102024-12-20T23:01:03.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44127 req_id = 29cfd5b0-f9f8-490c-8cff-da6b095d0559 response_code = 200 uri = /network-bootstore-config
22112024-12-20T23:01:09.510ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42003
22122024-12-20T23:01:09.510ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42003 req_id = 3f5d1207-6e1a-44e9-960f-eadbdc6741ef response_code = 200 uri = /baseboard
22132024-12-20T23:01:13.163ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7073 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 8b039db7-52dd-4399-86a9-c7c1fec4bab1 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
22142024-12-20T23:01:32.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47640
22152024-12-20T23:01:32.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47640 req_id = 8d259b91-f614-465f-9d51-5e4fc0ec0f8e response_code = 200 uri = /vpc-routes
22162024-12-20T23:01:32.206ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22172024-12-20T23:01:32.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47640 req_id = 8bb465a3-6637-483c-be85-9fe49bfd5e79 response_code = 204 uri = /eip-gateways
22182024-12-20T23:01:32.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47640 req_id = c46e2baf-c76f-4fe3-bb5e-6045d66ab6f6 response_code = 204 uri = /vpc-routes
22192024-12-20T23:01:32.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57896
22202024-12-20T23:01:32.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57896 req_id = a5ff5817-f3e8-4f43-b829-cc0f80500a2e response_code = 200 uri = /v2p
22212024-12-20T23:01:32.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54311
22222024-12-20T23:01:32.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22232024-12-20T23:01:32.384ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22242024-12-20T23:01:32.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54311 req_id = 76fc9b31-36ab-4893-b50f-a9f23f4a1510 response_code = 204 uri = /switch-ports
22252024-12-20T23:01:32.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54311 req_id = 25c5c131-9b0d-4942-b2f3-0a5e214d5ffc response_code = 200 uri = /network-bootstore-config
22262024-12-20T23:01:32.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44732
22272024-12-20T23:01:32.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44732 req_id = a18068e1-8378-4dd7-8f77-8729a46e8e3b response_code = 200 uri = /vpc-routes
22282024-12-20T23:01:32.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22292024-12-20T23:01:32.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44732 req_id = 199b3a9b-82ff-42af-b310-a9ce9348982c response_code = 204 uri = /eip-gateways
22302024-12-20T23:01:32.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39187
22312024-12-20T23:01:32.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39187 req_id = a2a148f7-bfea-4aa6-b031-87b296f15915 response_code = 200 uri = /v2p
22322024-12-20T23:01:32.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44732 req_id = 10c60ab3-e486-4385-8f5d-8b6eaa3a8f11 response_code = 204 uri = /vpc-routes
22332024-12-20T23:01:32.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48327
22342024-12-20T23:01:32.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48327 req_id = d2bfb9c7-bc70-45bb-828e-8c60d1d800ad response_code = 200 uri = /vpc-routes
22352024-12-20T23:01:32.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43492
22362024-12-20T23:01:32.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22372024-12-20T23:01:32.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22382024-12-20T23:01:32.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111860 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43492 req_id = 65a70271-aa7d-45e9-91ca-5fc705212354 response_code = 204 uri = /switch-ports
22392024-12-20T23:01:32.972ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22402024-12-20T23:01:32.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48327 req_id = d4345dcf-70fb-41a2-982f-07d1cedfb6f3 response_code = 204 uri = /eip-gateways
22412024-12-20T23:01:32.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43492 req_id = d19a57fa-f0a4-4ed9-9d9e-8b5b902c14d5 response_code = 200 uri = /network-bootstore-config
22422024-12-20T23:01:33.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48491
22432024-12-20T23:01:33.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48491 req_id = 84d7b875-7826-4bd3-8bee-a381bbf01c88 response_code = 200 uri = /v2p
22442024-12-20T23:01:33.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48327 req_id = 8b384059-061d-4766-9956-5f3ecf786465 response_code = 204 uri = /vpc-routes
22452024-12-20T23:01:33.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36865
22462024-12-20T23:01:33.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22472024-12-20T23:01:33.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22482024-12-20T23:01:33.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88304 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36865 req_id = dfd1537c-f44c-4bda-916a-07e629fa6b40 response_code = 204 uri = /switch-ports
22492024-12-20T23:01:33.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36865 req_id = 57f3fd51-92f2-4d80-8790-56c3679fe17a response_code = 200 uri = /network-bootstore-config
22502024-12-20T23:01:39.544ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41985
22512024-12-20T23:01:39.544ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41985 req_id = 3d398e59-b773-4719-bffd-6393e53ea9b6 response_code = 200 uri = /baseboard
22522024-12-20T23:01:43.162ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6676 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = a2480717-483a-4806-b758-4fb08d5c94bf response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
22532024-12-20T23:01:48.043ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22542024-12-20T23:01:48.043ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22552024-12-20T23:01:48.077ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1723, tv_nsec: 466965345 } time_to_next_cleanup = 599.99999576s
22562024-12-20T23:02:02.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62988
22572024-12-20T23:02:02.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62988 req_id = daefe081-9077-4b27-8144-0058437f83d6 response_code = 200 uri = /vpc-routes
22582024-12-20T23:02:02.475ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22592024-12-20T23:02:02.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62988 req_id = 044d3216-2590-4463-bcab-3a0ef1936872 response_code = 204 uri = /eip-gateways
22602024-12-20T23:02:02.489ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22612024-12-20T23:02:02.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33657
22622024-12-20T23:02:02.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33657 req_id = 45d56f4a-a3be-48d0-b95e-b900b4230c1c response_code = 200 uri = /v2p
22632024-12-20T23:02:02.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62988 req_id = 76061688-fcbb-416c-b216-bb8b6abad0b3 response_code = 204 uri = /vpc-routes
22642024-12-20T23:02:02.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38497
22652024-12-20T23:02:02.542ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22662024-12-20T23:02:02.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22672024-12-20T23:02:02.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38497 req_id = d36f21a9-f988-4dd0-9305-4a38c565d1c1 response_code = 204 uri = /switch-ports
22682024-12-20T23:02:02.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41929
22692024-12-20T23:02:02.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41929 req_id = 4afe4950-7b01-4c09-bd78-810cc92ab79d response_code = 200 uri = /vpc-routes
22702024-12-20T23:02:02.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38497 req_id = 0b097eac-bc18-437e-b36c-f28276f4b5b7 response_code = 200 uri = /network-bootstore-config
22712024-12-20T23:02:02.707ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22722024-12-20T23:02:02.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41929 req_id = 1ca4740e-891d-45c1-bf8f-642af2a508ee response_code = 204 uri = /eip-gateways
22732024-12-20T23:02:02.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41314
22742024-12-20T23:02:02.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41314 req_id = 0a2a75e7-5c34-4977-8e0c-c34c09d3d677 response_code = 200 uri = /v2p
22752024-12-20T23:02:02.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41929 req_id = 031cf404-80e9-4db9-913a-140efb8baf71 response_code = 204 uri = /vpc-routes
22762024-12-20T23:02:02.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52011
22772024-12-20T23:02:02.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22782024-12-20T23:02:02.989ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22792024-12-20T23:02:03.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52011 req_id = a4ab746a-a08e-4927-bdfa-bec9d5148bca response_code = 204 uri = /switch-ports
22802024-12-20T23:02:03.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52011 req_id = ef590ffc-8122-4a27-90c8-ac859d03354f response_code = 200 uri = /network-bootstore-config
22812024-12-20T23:02:03.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57310
22822024-12-20T23:02:03.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57310 req_id = 176fd2cf-92bc-42c0-97df-c19f95a7ddc7 response_code = 200 uri = /vpc-routes
22832024-12-20T23:02:03.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22842024-12-20T23:02:03.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57310 req_id = 27025153-21be-4db5-93e4-5e3805774034 response_code = 204 uri = /eip-gateways
22852024-12-20T23:02:03.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57310 req_id = 5bcd3202-328f-44d2-9ebc-8988b26cbe5f response_code = 204 uri = /vpc-routes
22862024-12-20T23:02:03.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61797
22872024-12-20T23:02:03.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22882024-12-20T23:02:03.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22892024-12-20T23:02:03.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61797 req_id = 035f93c2-6b0b-4c0b-bfc9-d387e6f95046 response_code = 204 uri = /switch-ports
22902024-12-20T23:02:03.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35357
22912024-12-20T23:02:03.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35357 req_id = c898246a-0681-4e4b-a631-4cceaa2b9acb response_code = 200 uri = /v2p
22922024-12-20T23:02:03.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61797 req_id = 78d9adfd-1236-4f91-9534-7ef14321c06e response_code = 200 uri = /network-bootstore-config
22932024-12-20T23:02:09.578ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37817
22942024-12-20T23:02:09.578ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37817 req_id = 32e3b657-c962-4f4a-a79f-1719a5d8ba54 response_code = 200 uri = /baseboard
22952024-12-20T23:02:13.163ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6944 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 2e26beac-1faa-4a55-980f-a909c1ea1f2f response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
22962024-12-20T23:02:32.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36749
22972024-12-20T23:02:32.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36749 req_id = ffb71ad4-0d0a-4129-a5e9-b679bb7cd927 response_code = 200 uri = /vpc-routes
22982024-12-20T23:02:32.207ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
22992024-12-20T23:02:32.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36749 req_id = 0e826519-29dd-4635-add8-97a8cd9d486f response_code = 204 uri = /eip-gateways
23002024-12-20T23:02:32.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36749 req_id = 35395fb0-be29-4e77-ae46-e6dfeec0da5f response_code = 204 uri = /vpc-routes
23012024-12-20T23:02:32.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34869
23022024-12-20T23:02:32.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34869 req_id = 0d6f4a3c-edea-41a6-9fa5-3138ed15dc4e response_code = 200 uri = /v2p
23032024-12-20T23:02:32.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38383
23042024-12-20T23:02:32.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23052024-12-20T23:02:32.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23062024-12-20T23:02:32.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93076 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38383 req_id = 04287f8f-9ebd-432f-b3e6-532c172250a0 response_code = 204 uri = /switch-ports
23072024-12-20T23:02:32.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38383 req_id = b16dfaef-1ad1-4579-9da4-e9e316db24d2 response_code = 200 uri = /network-bootstore-config
23082024-12-20T23:02:32.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35815
23092024-12-20T23:02:32.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35815 req_id = cd364cb1-ec45-46f4-a621-3f175782ec6c response_code = 200 uri = /vpc-routes
23102024-12-20T23:02:32.599ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23112024-12-20T23:02:32.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35815 req_id = bd03d842-eae8-4c7f-83df-e7335746ae18 response_code = 204 uri = /eip-gateways
23122024-12-20T23:02:32.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35815 req_id = c57f0581-18ec-44db-975a-d1cbc1b13d66 response_code = 204 uri = /vpc-routes
23132024-12-20T23:02:32.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52545
23142024-12-20T23:02:32.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52545 req_id = 155c6141-90b0-4f59-bce3-3ecd9f2f3515 response_code = 200 uri = /v2p
23152024-12-20T23:02:32.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61365
23162024-12-20T23:02:32.711ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23172024-12-20T23:02:32.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23182024-12-20T23:02:32.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61365 req_id = 1a269bde-96fb-4a2b-977c-da6f943a39ae response_code = 204 uri = /switch-ports
23192024-12-20T23:02:32.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61365 req_id = b7c44660-b382-4407-bc1d-9336d89f95bf response_code = 200 uri = /network-bootstore-config
23202024-12-20T23:02:32.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57132
23212024-12-20T23:02:32.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57132 req_id = 8cee9349-00d8-417c-b359-5b94bb11f89f response_code = 200 uri = /vpc-routes
23222024-12-20T23:02:32.949ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23232024-12-20T23:02:32.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57132 req_id = 3fe7529a-404d-4b26-ad81-f3f2e7326e1d response_code = 204 uri = /eip-gateways
23242024-12-20T23:02:32.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57132 req_id = 5296d2a5-41a2-44d0-8ca1-a86bb2d34e26 response_code = 204 uri = /vpc-routes
23252024-12-20T23:02:33.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55491
23262024-12-20T23:02:33.006ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23272024-12-20T23:02:33.048ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23282024-12-20T23:02:33.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99365 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55491 req_id = 61da75b0-9db2-4818-9736-165e2500de01 response_code = 204 uri = /switch-ports
23292024-12-20T23:02:33.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42674
23302024-12-20T23:02:33.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42674 req_id = 4d168ca7-c4e8-48c2-bd65-390b7ce8649e response_code = 200 uri = /v2p
23312024-12-20T23:02:33.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55491 req_id = 335ba26e-c492-41c5-9b56-4772222e50cf response_code = 200 uri = /network-bootstore-config
23322024-12-20T23:02:39.610ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35846
23332024-12-20T23:02:39.610ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35846 req_id = 2b4e5dc7-b6db-4f56-84ea-6c57c14f083a response_code = 200 uri = /baseboard
23342024-12-20T23:02:43.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7861 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = f9a18e2d-46a6-4ae7-b429-f6af4cadbee8 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
23352024-12-20T23:03:02.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58731
23362024-12-20T23:03:02.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58731 req_id = eeba95b1-53f7-47ca-a5be-2db8556afef6 response_code = 200 uri = /v2p
23372024-12-20T23:03:02.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36206
23382024-12-20T23:03:02.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36206 req_id = c5dbc308-b2a2-412e-9a6d-2b2e28d5b424 response_code = 200 uri = /vpc-routes
23392024-12-20T23:03:02.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23402024-12-20T23:03:02.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36206 req_id = 85f14b44-68d5-4edc-bb37-dbeb09d0271b response_code = 204 uri = /eip-gateways
23412024-12-20T23:03:02.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36206 req_id = 02f87038-77ea-458a-aff6-81a18b3d75c6 response_code = 204 uri = /vpc-routes
23422024-12-20T23:03:02.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45367
23432024-12-20T23:03:02.587ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23442024-12-20T23:03:02.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23452024-12-20T23:03:02.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45367 req_id = 80cbddd1-c2a5-47b3-b9de-e7f2332bf4da response_code = 204 uri = /switch-ports
23462024-12-20T23:03:02.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45367 req_id = 230acac3-0331-4e0e-b8db-2ad7dfff7830 response_code = 200 uri = /network-bootstore-config
23472024-12-20T23:03:02.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48428
23482024-12-20T23:03:02.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48428 req_id = 7f6687b3-5381-41af-a277-274b1c583b4c response_code = 200 uri = /vpc-routes
23492024-12-20T23:03:02.768ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23502024-12-20T23:03:02.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48428 req_id = 5a18cbc3-3288-4411-93a8-c102d1be4735 response_code = 204 uri = /eip-gateways
23512024-12-20T23:03:02.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48428 req_id = 984620cf-baf4-4063-aad2-2a60bd3fa1f1 response_code = 204 uri = /vpc-routes
23522024-12-20T23:03:02.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63865
23532024-12-20T23:03:02.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63865 req_id = 33a4f4f9-1eb1-487d-9996-17677de9c2bb response_code = 200 uri = /v2p
23542024-12-20T23:03:02.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58436
23552024-12-20T23:03:02.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23562024-12-20T23:03:02.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23572024-12-20T23:03:03.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58436 req_id = 4a08801f-aafb-4451-979b-22f14e41febb response_code = 204 uri = /switch-ports
23582024-12-20T23:03:03.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58436 req_id = 95a9f289-d12b-4223-b9c9-c7e652993bc2 response_code = 200 uri = /network-bootstore-config
23592024-12-20T23:03:03.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59572
23602024-12-20T23:03:03.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59572 req_id = b2a8e262-8b62-4b53-808c-87473df41060 response_code = 200 uri = /vpc-routes
23612024-12-20T23:03:03.144ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23622024-12-20T23:03:03.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59572 req_id = e1385bf6-f615-4046-b31d-af3359be5832 response_code = 204 uri = /eip-gateways
23632024-12-20T23:03:03.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59572 req_id = e1a11d1f-193c-4668-80d5-bdeace555da7 response_code = 204 uri = /vpc-routes
23642024-12-20T23:03:03.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65108
23652024-12-20T23:03:03.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65108 req_id = b9c61b1b-fd70-4223-887a-3ad58eb41c1f response_code = 200 uri = /v2p
23662024-12-20T23:03:03.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58578
23672024-12-20T23:03:03.277ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23682024-12-20T23:03:03.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23692024-12-20T23:03:03.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58578 req_id = 81c704d4-26c7-4058-b03a-f68a9a5437b9 response_code = 204 uri = /switch-ports
23702024-12-20T23:03:03.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58578 req_id = 755f1e62-f384-415c-81a5-1dd7fd74db9d response_code = 200 uri = /network-bootstore-config
23712024-12-20T23:03:09.642ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35944
23722024-12-20T23:03:09.642ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35944 req_id = 9b83f99c-8175-4063-abec-b7f85e6b597e response_code = 200 uri = /baseboard
23732024-12-20T23:03:13.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7455 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 34153b51-9d13-4d5f-b1f2-de4d121cc9fa response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
23742024-12-20T23:03:32.171ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56641
23752024-12-20T23:03:32.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56641 req_id = bfb6b8e1-6e22-4651-8b74-db0ea495b9c2 response_code = 200 uri = /vpc-routes
23762024-12-20T23:03:32.187ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23772024-12-20T23:03:32.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56641 req_id = ed8ff762-3de5-4141-aa83-e464bf539a74 response_code = 204 uri = /eip-gateways
23782024-12-20T23:03:32.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56641 req_id = c77e24f6-fefb-46d5-801e-854363360d42 response_code = 204 uri = /vpc-routes
23792024-12-20T23:03:32.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63529
23802024-12-20T23:03:32.257ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23812024-12-20T23:03:32.298ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23822024-12-20T23:03:32.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99782 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63529 req_id = e77256d9-7898-4198-97ef-08304ddc4a9d response_code = 204 uri = /switch-ports
23832024-12-20T23:03:32.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48577
23842024-12-20T23:03:32.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48577 req_id = 35ccf572-85c1-467e-ae0d-23dd70f01e0a response_code = 200 uri = /v2p
23852024-12-20T23:03:32.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63529 req_id = d6f72367-a8ba-448c-9969-7e1bb91237b8 response_code = 200 uri = /network-bootstore-config
23862024-12-20T23:03:32.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36715
23872024-12-20T23:03:32.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36715 req_id = 9262397a-98c5-4805-9638-a9194f0c5bbd response_code = 200 uri = /vpc-routes
23882024-12-20T23:03:32.531ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
23892024-12-20T23:03:32.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36715 req_id = 35feb0c2-a8cd-400a-8a7b-8c0078e6328e response_code = 204 uri = /eip-gateways
23902024-12-20T23:03:32.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36715 req_id = e321549f-4f90-4cfc-8ef1-c958b4dc4d68 response_code = 204 uri = /vpc-routes
23912024-12-20T23:03:32.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64494
23922024-12-20T23:03:32.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64494 req_id = c39283d8-61d7-4212-b888-15acf71d0a25 response_code = 200 uri = /v2p
23932024-12-20T23:03:32.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59967
23942024-12-20T23:03:32.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23952024-12-20T23:03:32.725ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23962024-12-20T23:03:32.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59967 req_id = 2ec2fd05-c867-418a-b2ed-36d55749be0b response_code = 204 uri = /switch-ports
23972024-12-20T23:03:32.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59967 req_id = b282ddb4-4ce8-4f0f-a5ce-abb44a17f0d3 response_code = 200 uri = /network-bootstore-config
23982024-12-20T23:03:32.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53629
23992024-12-20T23:03:32.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53629 req_id = b2af4ee0-692c-4a60-a5f7-43d0973ebd4f response_code = 200 uri = /vpc-routes
24002024-12-20T23:03:32.914ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
24012024-12-20T23:03:32.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53629 req_id = ef78314e-d294-4cb7-9563-ecd4c6f2e2ae response_code = 204 uri = /eip-gateways
24022024-12-20T23:03:32.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53629 req_id = 91b614b4-605e-4dbc-9f83-619d0b87ab29 response_code = 204 uri = /vpc-routes
24032024-12-20T23:03:32.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41169
24042024-12-20T23:03:32.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41169 req_id = a7a4709b-2484-4005-8516-783e526d9ba8 response_code = 200 uri = /v2p
24052024-12-20T23:03:33.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33789
24062024-12-20T23:03:33.007ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24072024-12-20T23:03:33.049ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24082024-12-20T23:03:33.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33789 req_id = 61bb2ee4-3a11-4eec-b728-feed9874b5c2 response_code = 204 uri = /switch-ports
24092024-12-20T23:03:33.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33789 req_id = 63368077-a760-4bb4-977d-4dd4adfdda1c response_code = 200 uri = /network-bootstore-config
24102024-12-20T23:03:39.675ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64286
24112024-12-20T23:03:39.675ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64286 req_id = acd3dab7-f53e-4f2d-aea6-b069980df037 response_code = 200 uri = /baseboard
24122024-12-20T23:03:43.165ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8233 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = d7f5f210-97e2-419e-b9b9-60112be02c99 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
24132024-12-20T23:04:02.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64533
24142024-12-20T23:04:02.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64533 req_id = 344a9ac6-b3a4-40de-b810-f8469a03721d response_code = 200 uri = /v2p
24152024-12-20T23:04:02.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61571
24162024-12-20T23:04:02.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 684cdb08-527f-4c76-85e1-e551fd418560 response_code = 200 uri = /vpc-routes
24172024-12-20T23:04:02.565ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
24182024-12-20T23:04:02.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61571 req_id = 9a219211-3108-4d65-97ca-4227b82afdef response_code = 204 uri = /eip-gateways
24192024-12-20T23:04:02.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61571 req_id = af4483c0-e84f-49b5-8f22-9770efb005dc response_code = 204 uri = /vpc-routes
24202024-12-20T23:04:02.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53053
24212024-12-20T23:04:02.582ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24222024-12-20T23:04:02.620ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24232024-12-20T23:04:02.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89456 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53053 req_id = bacf3025-4c2b-4d12-83ce-368799cc0b40 response_code = 204 uri = /switch-ports
24242024-12-20T23:04:02.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60269
24252024-12-20T23:04:02.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24262024-12-20T23:04:02.672ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24272024-12-20T23:04:02.672ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
24282024-12-20T23:04:02.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53053 req_id = bd9697e4-894f-4971-9440-5401b8d6ba6a response_code = 200 uri = /network-bootstore-config
24292024-12-20T23:04:02.673ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
24302024-12-20T23:04:02.688ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24312024-12-20T23:04:02.688ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1bebbc47-252a-4b92-8d16-64a505e777ec
24322024-12-20T23:04:02.717ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24332024-12-20T23:04:02.717ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2
24342024-12-20T23:04:02.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46579
24352024-12-20T23:04:02.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46579 req_id = 5e3c2b51-c7da-44a3-8db7-79179b7ef26b response_code = 200 uri = /vpc-routes
24362024-12-20T23:04:02.753ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24372024-12-20T23:04:02.753ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b2b69-efd5-461d-912c-5052088aed91
24382024-12-20T23:04:02.794ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24392024-12-20T23:04:02.795ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1
24402024-12-20T23:04:02.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
24412024-12-20T23:04:02.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 453 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46579 req_id = 77e2ffcb-c6de-4c87-84ee-dd950adf31da response_code = 204 uri = /eip-gateways
24422024-12-20T23:04:02.842ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24432024-12-20T23:04:02.843ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27
24442024-12-20T23:04:02.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47592
24452024-12-20T23:04:02.860ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24462024-12-20T23:04:02.860ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24472024-12-20T23:04:02.860ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
24482024-12-20T23:04:02.866ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
24492024-12-20T23:04:02.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1042 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46579 req_id = b924e2f4-5c2a-4f06-ba03-59b3158a62ef response_code = 204 uri = /vpc-routes
24502024-12-20T23:04:02.876ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24512024-12-20T23:04:02.876ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4
24522024-12-20T23:04:02.892ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24532024-12-20T23:04:02.892ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1bebbc47-252a-4b92-8d16-64a505e777ec
24542024-12-20T23:04:02.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62988
24552024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24562024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24572024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24582024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24592024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24602024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24612024-12-20T23:04:02.903ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24622024-12-20T23:04:02.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62988 req_id = 7165721f-e679-489d-85da-ffe55fee29b0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24632024-12-20T23:04:02.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61457
24642024-12-20T23:04:02.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24652024-12-20T23:04:02.926ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24662024-12-20T23:04:02.926ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2
24672024-12-20T23:04:02.942ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24682024-12-20T23:04:02.942ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_091028cb-f478-4341-abae-5f1e6cecc3ba
24692024-12-20T23:04:02.961ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24702024-12-20T23:04:02.961ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b2b69-efd5-461d-912c-5052088aed91
24712024-12-20T23:04:02.966ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24722024-12-20T23:04:02.977ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24732024-12-20T23:04:02.977ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b960ef68-fd77-411f-b5e4-77a645524bc5
24742024-12-20T23:04:03.006ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24752024-12-20T23:04:03.006ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae
24762024-12-20T23:04:03.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43725
24772024-12-20T23:04:03.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43725 req_id = 5606fb34-a559-49fc-ae7b-bb59bc6143ee response_code = 200 uri = /v2p
24782024-12-20T23:04:03.022ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24792024-12-20T23:04:03.022ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1
24802024-12-20T23:04:03.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359565 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60269 req_id = 25755eef-323b-4548-9f2a-0007d6a4496c response_code = 200 uri = /inventory
24812024-12-20T23:04:03.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61457 req_id = 59263832-8af6-4e20-b0f3-333aea86c505 response_code = 204 uri = /switch-ports
24822024-12-20T23:04:03.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61457 req_id = 77710bff-cd49-4f8d-8c23-99ccd840bcbe response_code = 200 uri = /network-bootstore-config
24832024-12-20T23:04:03.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47997
24842024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24852024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24862024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24872024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24882024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24892024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24902024-12-20T23:04:03.043ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24912024-12-20T23:04:03.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47997 req_id = 1086256c-c873-4192-baf4-23086fe1e469 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24922024-12-20T23:04:03.048ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24932024-12-20T23:04:03.048ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27
24942024-12-20T23:04:03.074ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24952024-12-20T23:04:03.074ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4
24962024-12-20T23:04:03.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24972024-12-20T23:04:03.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_091028cb-f478-4341-abae-5f1e6cecc3ba
24982024-12-20T23:04:03.117ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24992024-12-20T23:04:03.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b960ef68-fd77-411f-b5e4-77a645524bc5
25002024-12-20T23:04:03.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50948
25012024-12-20T23:04:03.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50948 req_id = 6df90cbe-c5be-4fed-baee-c8429c262901 response_code = 200 uri = /vpc-routes
25022024-12-20T23:04:03.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25032024-12-20T23:04:03.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae
25042024-12-20T23:04:03.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299583 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47592 req_id = 197612f6-92f1-4399-beec-898f9298c97c response_code = 200 uri = /inventory
25052024-12-20T23:04:03.190ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
25062024-12-20T23:04:03.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50948 req_id = 8d9319e9-e0b0-402f-9fa8-c51ff9cec914 response_code = 204 uri = /eip-gateways
25072024-12-20T23:04:03.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50948 req_id = a039e2c8-84b3-4a45-9a69-ff1fff9e03e4 response_code = 204 uri = /vpc-routes
25082024-12-20T23:04:03.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32885
25092024-12-20T23:04:03.403ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25102024-12-20T23:04:03.403ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25112024-12-20T23:04:03.403ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/config/omicron-zones.json file = common/src/ledger.rs:177
25122024-12-20T23:04:03.403ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/config/omicron-zones.json file = common/src/ledger.rs:177
25132024-12-20T23:04:03.418ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1bebbc47-252a-4b92-8d16-64a505e777ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25142024-12-20T23:04:03.418ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1bebbc47-252a-4b92-8d16-64a505e777ec
25152024-12-20T23:04:03.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57759
25162024-12-20T23:04:03.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57759 req_id = 3c71e560-4dbd-4e5a-8ef6-f26b36fe8b24 response_code = 200 uri = /v2p
25172024-12-20T23:04:03.445ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 701c8ea1-345c-4075-ace9-faafb7eddcd2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25182024-12-20T23:04:03.446ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_701c8ea1-345c-4075-ace9-faafb7eddcd2
25192024-12-20T23:04:03.473ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d31b2b69-efd5-461d-912c-5052088aed91 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25202024-12-20T23:04:03.473ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d31b2b69-efd5-461d-912c-5052088aed91
25212024-12-20T23:04:03.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2b0333c0-c6c1-4cff-a03f-fd082c50dea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25222024-12-20T23:04:03.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2b0333c0-c6c1-4cff-a03f-fd082c50dea1
25232024-12-20T23:04:03.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64361
25242024-12-20T23:04:03.513ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25252024-12-20T23:04:03.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 166c0ffc-1620-468b-944c-cc02dcfd2e27 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25262024-12-20T23:04:03.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_166c0ffc-1620-468b-944c-cc02dcfd2e27
25272024-12-20T23:04:03.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25282024-12-20T23:04:03.559ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7b572d7f-8e45-4fb2-b3eb-bd3394a846b4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25292024-12-20T23:04:03.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7b572d7f-8e45-4fb2-b3eb-bd3394a846b4
25302024-12-20T23:04:03.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61449
25312024-12-20T23:04:03.577ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 9b5312da-a277-4244-baaa-33815f0464e4, kind: Service { id: ace0592c-7755-46f8-b47a-c9b6444fe64c }, name: Name("external-dns-ace0592c-7755-46f8-b47a-c9b6444fe64c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b6a4ac58-71fd-4271-af9e-04ea5fb7455a, kind: Service { id: 1e296b8d-6800-4056-8034-a1ec2d005fff }, name: Name("external-dns-1e296b8d-6800-4056-8034-a1ec2d005fff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1e21a6ac-6d39-461b-a43a-59a0e5d45557, kind: Service { id: a67567ae-7026-453e-acd2-e1780994c729 }, name: Name("nexus-a67567ae-7026-453e-acd2-e1780994c729"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 28])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2351e16d-ccc3-42df-b594-9d3a6ec23973, kind: Service { id: f3b60bd3-6e34-4140-a755-57f26dbc5b34 }, name: Name("nexus-f3b60bd3-6e34-4140-a755-57f26dbc5b34"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8be612fb-34b6-43da-9363-17ad360f283a, kind: Service { id: 371fea12-332e-4334-902e-d2154e69e006 }, name: Name("nexus-371fea12-332e-4334-902e-d2154e69e006"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 100])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25322024-12-20T23:04:03.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25332024-12-20T23:04:03.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25342024-12-20T23:04:03.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25352024-12-20T23:04:03.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25362024-12-20T23:04:03.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25372024-12-20T23:04:03.578ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25382024-12-20T23:04:03.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4834 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61449 req_id = f280c7a9-6482-43e2-a3fe-8054c69eaf03 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25392024-12-20T23:04:03.585ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 091028cb-f478-4341-abae-5f1e6cecc3ba (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25402024-12-20T23:04:03.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_091028cb-f478-4341-abae-5f1e6cecc3ba
25412024-12-20T23:04:03.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b960ef68-fd77-411f-b5e4-77a645524bc5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25422024-12-20T23:04:03.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b960ef68-fd77-411f-b5e4-77a645524bc5
25432024-12-20T23:04:03.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64361 req_id = fa65fbbe-b797-4656-9af1-71704e1d4acf response_code = 204 uri = /switch-ports
25442024-12-20T23:04:03.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64361 req_id = 46e7bbdc-1e38-4e50-87fe-c9c97a6124af response_code = 200 uri = /network-bootstore-config
25452024-12-20T23:04:03.636ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38fd6a55-6517-4c3e-af4d-ade80ff38aae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25462024-12-20T23:04:03.636ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_38fd6a55-6517-4c3e-af4d-ade80ff38aae
25472024-12-20T23:04:03.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248043 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32885 req_id = 99cbf703-09ba-4950-af51-688fb299103a response_code = 200 uri = /inventory
25482024-12-20T23:04:09.710ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58659
25492024-12-20T23:04:09.710ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58659 req_id = 6cf51f03-28e0-4c54-8dd9-68924e0b78d9 response_code = 200 uri = /baseboard
25502024-12-20T23:04:13.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7957 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = f8903877-a87a-491c-95a8-76fc6da1a44a response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
25512024-12-20T23:04:32.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42038
25522024-12-20T23:04:32.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42038 req_id = 5ec1ad29-dfe7-4f94-b524-5458fb544fa4 response_code = 200 uri = /vpc-routes
25532024-12-20T23:04:32.216ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
25542024-12-20T23:04:32.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42038 req_id = 10583036-bfaa-46a6-9269-b4994750b4e9 response_code = 204 uri = /eip-gateways
25552024-12-20T23:04:32.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42038 req_id = ca154773-3845-4a9d-a30b-5a26bcee5c4f response_code = 204 uri = /vpc-routes
25562024-12-20T23:04:32.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65267
25572024-12-20T23:04:32.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65267 req_id = 046d700f-275c-441b-a751-bf4aad2bb503 response_code = 200 uri = /v2p
25582024-12-20T23:04:32.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47706
25592024-12-20T23:04:32.284ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25602024-12-20T23:04:32.323ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25612024-12-20T23:04:32.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47706 req_id = 2c5aa391-2041-48db-88c2-6770f269b11f response_code = 204 uri = /switch-ports
25622024-12-20T23:04:32.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47706 req_id = 2d08ef6d-c4e7-4a1e-b465-299f78eefa1b response_code = 200 uri = /network-bootstore-config
25632024-12-20T23:04:32.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60701
25642024-12-20T23:04:32.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60701 req_id = 4c6b7fe0-c404-429e-8a16-98f37d08c72a response_code = 200 uri = /vpc-routes
25652024-12-20T23:04:32.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
25662024-12-20T23:04:32.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60701 req_id = b18541dc-e0cc-4cf9-b864-0bd4ddd81d63 response_code = 204 uri = /eip-gateways
25672024-12-20T23:04:32.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60701 req_id = 4c3366c8-c6a9-4713-a02c-d8a46122982f response_code = 204 uri = /vpc-routes
25682024-12-20T23:04:32.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41098
25692024-12-20T23:04:32.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25702024-12-20T23:04:32.722ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25712024-12-20T23:04:32.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41098 req_id = 960697b9-dd97-4968-b327-51a4dc079fdd response_code = 204 uri = /switch-ports
25722024-12-20T23:04:32.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45609
25732024-12-20T23:04:32.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45609 req_id = e1b049e3-4026-463c-b5aa-0fe13ad48c05 response_code = 200 uri = /v2p
25742024-12-20T23:04:32.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41098 req_id = 51a150b5-b305-435f-9045-5d5dc8d34ba0 response_code = 200 uri = /network-bootstore-config
25752024-12-20T23:04:32.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54496
25762024-12-20T23:04:32.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54496 req_id = 53b93c21-325b-4d62-bcb6-65658c13e296 response_code = 200 uri = /vpc-routes
25772024-12-20T23:04:32.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
25782024-12-20T23:04:32.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54496 req_id = c69b14e6-99a2-4975-9b6a-ea204eabc904 response_code = 204 uri = /eip-gateways
25792024-12-20T23:04:32.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54496 req_id = ca571bd2-fa23-4b0a-b3fd-710c8a418112 response_code = 204 uri = /vpc-routes
25802024-12-20T23:04:32.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56617
25812024-12-20T23:04:32.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25822024-12-20T23:04:33.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25832024-12-20T23:04:33.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56617 req_id = f34c3b50-3162-4ab7-a64f-7393528d94c6 response_code = 204 uri = /switch-ports
25842024-12-20T23:04:33.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59456
25852024-12-20T23:04:33.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59456 req_id = f5700f72-d257-4f7c-a390-1d6638e36759 response_code = 200 uri = /v2p
25862024-12-20T23:04:33.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56617 req_id = f30a0a5b-c2a1-4753-b659-ce73ce87e302 response_code = 200 uri = /network-bootstore-config
25872024-12-20T23:04:39.744ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38575
25882024-12-20T23:04:39.745ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38575 req_id = 74e9fb40-9fb2-4760-92fe-e209b0b1d737 response_code = 200 uri = /baseboard
25892024-12-20T23:04:43.163ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6749 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 9304daf3-67a9-488d-b7b2-f4cc6ae8e5b2 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
25902024-12-20T23:05:02.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54895
25912024-12-20T23:05:02.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54895 req_id = 5c5fd53f-02f2-4c92-a84e-ce76a91814cd response_code = 200 uri = /vpc-routes
25922024-12-20T23:05:02.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
25932024-12-20T23:05:02.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54895 req_id = 5674e57c-0f9e-4643-8ff9-f32dfbe9a0df response_code = 204 uri = /eip-gateways
25942024-12-20T23:05:02.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35209
25952024-12-20T23:05:02.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35209 req_id = d3626bc6-18f7-440f-82b3-da88c89e9a74 response_code = 200 uri = /v2p
25962024-12-20T23:05:02.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54895 req_id = d0e596df-7834-424e-bb45-bb052084da0f response_code = 204 uri = /vpc-routes
25972024-12-20T23:05:02.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52111
25982024-12-20T23:05:02.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25992024-12-20T23:05:02.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26002024-12-20T23:05:02.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97121 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52111 req_id = 8e54c8bd-40f4-41bb-9d76-4af529b562c6 response_code = 204 uri = /switch-ports
26012024-12-20T23:05:02.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52111 req_id = 5271c545-043a-4a38-9d8f-43234b101bc5 response_code = 200 uri = /network-bootstore-config
26022024-12-20T23:05:02.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53954
26032024-12-20T23:05:02.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53954 req_id = c19baa2b-be6c-4e11-b5b7-5483f229898b response_code = 200 uri = /vpc-routes
26042024-12-20T23:05:02.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
26052024-12-20T23:05:02.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53954 req_id = 9fa3bc33-8bb9-4525-9f4d-3d1bd5636e79 response_code = 204 uri = /eip-gateways
26062024-12-20T23:05:02.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53954 req_id = 09a153f6-3c78-4192-9867-24af9e7689c7 response_code = 204 uri = /vpc-routes
26072024-12-20T23:05:02.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48872
26082024-12-20T23:05:02.941ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26092024-12-20T23:05:02.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26102024-12-20T23:05:03.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108319 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48872 req_id = 607bc971-bb12-43a8-a9ad-344936b7d9db response_code = 204 uri = /switch-ports
26112024-12-20T23:05:03.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60558
26122024-12-20T23:05:03.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50563
26132024-12-20T23:05:03.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50563 req_id = f3fd05d2-6a61-41c1-9237-0e454fd89acd response_code = 200 uri = /vpc-routes
26142024-12-20T23:05:03.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60558 req_id = 3487148c-da70-4654-80af-17e6a3c6db16 response_code = 200 uri = /v2p
26152024-12-20T23:05:03.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48872 req_id = 7356683d-11ea-4392-a79d-0d16a617dd8b response_code = 200 uri = /network-bootstore-config
26162024-12-20T23:05:03.107ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
26172024-12-20T23:05:03.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50563 req_id = ef87bcaf-1abf-4c7f-83d8-c27707900736 response_code = 204 uri = /eip-gateways
26182024-12-20T23:05:03.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50563 req_id = db720f94-27a9-46ac-8ef9-e4b24834425b response_code = 204 uri = /vpc-routes
26192024-12-20T23:05:03.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54753
26202024-12-20T23:05:03.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54753 req_id = 8a9148d2-6152-4e6c-bcc1-364ce14f745a response_code = 200 uri = /v2p
26212024-12-20T23:05:03.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33787
26222024-12-20T23:05:03.294ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26232024-12-20T23:05:03.332ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26242024-12-20T23:05:03.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93672 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33787 req_id = 9e9a249c-7845-4ddb-8762-67104c45acb7 response_code = 204 uri = /switch-ports
26252024-12-20T23:05:03.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33787 req_id = 74f47173-6abd-4a84-b42b-1eba77078655 response_code = 200 uri = /network-bootstore-config
26262024-12-20T23:05:09.777ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46831
26272024-12-20T23:05:09.778ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46831 req_id = a5d4650e-5828-42fc-ae01-73d2e5f22c81 response_code = 200 uri = /baseboard
26282024-12-20T23:05:13.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7256 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = 31e464b4-a118-4445-abfb-b84b1125d54f response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
26292024-12-20T23:05:32.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55306
26302024-12-20T23:05:32.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55306 req_id = 0ad36d02-0362-4767-a2dc-c2bacee810f4 response_code = 200 uri = /v2p
26312024-12-20T23:05:32.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36057
26322024-12-20T23:05:32.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36057 req_id = d9d8ffa0-9b53-4744-94e2-e363e9615a8b response_code = 200 uri = /vpc-routes
26332024-12-20T23:05:32.353ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {7af95d5c-cc00-4843-9aab-7ae751cf8054: {10.151.1.175: {b9f0e957-0765-4023-bc13-350c229e799c}, 10.151.1.176: {b9f0e957-0765-4023-bc13-350c229e799c}}} }
26342024-12-20T23:05:32.354ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
26352024-12-20T23:05:32.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36057 req_id = a613a207-8380-4e99-a6e1-7da4dec4a2da response_code = 204 uri = /eip-gateways
26362024-12-20T23:05:32.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 484 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36057 req_id = 1968dc1e-1207-4082-bd7f-de3907f190a2 response_code = 204 uri = /vpc-routes
26372024-12-20T23:05:32.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58002
26382024-12-20T23:05:32.445ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26392024-12-20T23:05:32.500ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26402024-12-20T23:05:32.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58002 req_id = ee2eca13-ff87-4d3e-9741-02685a8c4955 response_code = 204 uri = /switch-ports
26412024-12-20T23:05:32.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54462
26422024-12-20T23:05:32.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54462 req_id = b9967ab4-963c-4b9d-bc1f-452e4cffcfa2 response_code = 200 uri = /v2p
26432024-12-20T23:05:32.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58002 req_id = 51fe8cae-b830-45ce-9022-ec09af4b069c response_code = 200 uri = /network-bootstore-config
26442024-12-20T23:05:32.569ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9502392) }
26452024-12-20T23:05:32.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1068 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54462 req_id = 8a339247-cdb0-4de8-b6ce-28041aeb0611 response_code = 204 uri = /v2p
26462024-12-20T23:05:32.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58574
26472024-12-20T23:05:32.610ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9502392))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4a0479f880d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 4740d9db-7966-4110-96fa-28dd4c6047e7, read_only_parent: Some(Volume { block_size: 512, id: ae7f3df2-622d-410b-9b6d-19c8cd398443, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a82a4cb0-5f6a-454d-b509-4eb67fc08d56, key: Some("wwVZPtNVljV778TxlJQpU+nk3TBcbDz7kQ+mvOt+MRk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4740d9db-7966-4110-96fa-28dd4c6047e7, key: Some("BEto21c1DAdmFiJKhGEpOEQKRF9J4n+BeowNxp5bhWQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19003", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::17]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4a0479f880d" }] }), cloud_init_bytes: Some(..) } instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 metadata = InstanceMetadata { silo_id: ee579470-b16b-4af1-ad3a-b3d29f9a2fb2, project_id: 885c1fe9-bb43-40e3-afde-f8c797c136a5 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-20T23:05:32.596233659Z }
26482024-12-20T23:05:32.610ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 migration_id = None propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
26492024-12-20T23:05:32.610ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 migration_id = None propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9502392))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7af95d5c-cc00-4843-9aab-7ae751cf8054, kind: Instance { id: a19e5d99-42f4-4662-bf03-f1e0ac809d69 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9502392), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-4a0479f880d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 4740d9db-7966-4110-96fa-28dd4c6047e7, read_only_parent: Some(Volume { block_size: 512, id: ae7f3df2-622d-410b-9b6d-19c8cd398443, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: a82a4cb0-5f6a-454d-b509-4eb67fc08d56, key: Some("wwVZPtNVljV778TxlJQpU+nk3TBcbDz7kQ+mvOt+MRk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 4740d9db-7966-4110-96fa-28dd4c6047e7, key: Some("BEto21c1DAdmFiJKhGEpOEQKRF9J4n+BeowNxp5bhWQ="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19003", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::17]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-4a0479f880d" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-20T23:05:32.596233659Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26502024-12-20T23:05:32.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58574 req_id = de7bf685-95cb-4459-944b-158a663f5e22 response_code = 200 uri = /vmms/4f3aa377-5a1f-4ea1-87b6-225f36799569
26512024-12-20T23:05:32.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61394
26522024-12-20T23:05:32.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61394 req_id = 92a0d5e3-410c-4e69-a0c1-f4cffdfab175 response_code = 200 uri = /vpc-routes
26532024-12-20T23:05:32.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33912
26542024-12-20T23:05:32.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33912 req_id = 6d8b23a9-db26-44ab-be83-2c89de4e98cd response_code = 200 uri = /vmms/4f3aa377-5a1f-4ea1-87b6-225f36799569/state
26552024-12-20T23:05:32.724ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 9502392 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26562024-12-20T23:05:32.724ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {7af95d5c-cc00-4843-9aab-7ae751cf8054: {10.151.1.175: {b9f0e957-0765-4023-bc13-350c229e799c}, 10.151.1.176: {b9f0e957-0765-4023-bc13-350c229e799c}}} }
26572024-12-20T23:05:32.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26582024-12-20T23:05:32.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61394 req_id = 3d645fa3-81de-4040-b178-fd31d7d568cb response_code = 204 uri = /eip-gateways
26592024-12-20T23:05:32.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58889
26602024-12-20T23:05:32.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58889 req_id = ba0c7928-fc4d-4c15-9b6d-8d12bb2c2ede response_code = 200 uri = /v2p
26612024-12-20T23:05:32.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61394 req_id = dacaae79-af03-447f-9f69-3d47b97adf51 response_code = 204 uri = /vpc-routes
26622024-12-20T23:05:32.786ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569 file = illumos-utils/src/zone.rs:325 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
26632024-12-20T23:05:32.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62841
26642024-12-20T23:05:32.792ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26652024-12-20T23:05:32.816ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569 file = illumos-utils/src/zone.rs:363 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
26662024-12-20T23:05:32.838ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26672024-12-20T23:05:32.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62841 req_id = a5bc9b6a-4e15-4c84-aa54-8838ff2b721a response_code = 204 uri = /switch-ports
26682024-12-20T23:05:32.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62841 req_id = a05e53ee-46a1-47ad-95f5-fb5e025e61f4 response_code = 200 uri = /network-bootstore-config
26692024-12-20T23:05:32.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34342
26702024-12-20T23:05:32.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62390
26712024-12-20T23:05:32.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62390 req_id = 6517fcc2-6767-479b-ae9d-053f2b172b7e response_code = 200 uri = /vpc-routes
26722024-12-20T23:05:33.046ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {7af95d5c-cc00-4843-9aab-7ae751cf8054: {10.151.1.175: {b9f0e957-0765-4023-bc13-350c229e799c}, 10.151.1.176: {b9f0e957-0765-4023-bc13-350c229e799c}}} }
26732024-12-20T23:05:33.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62390 req_id = 4e762a87-69b0-42b9-b176-b29cf2dbdfc4 response_code = 204 uri = /eip-gateways
26742024-12-20T23:05:33.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55830
26752024-12-20T23:05:33.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26762024-12-20T23:05:33.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26772024-12-20T23:05:33.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55830 req_id = 77acebfd-28b1-448d-a085-485c3f7e26e3 response_code = 204 uri = /switch-ports
26782024-12-20T23:05:33.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61347
26792024-12-20T23:05:33.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61347 req_id = 08786764-3ffa-44a4-95d1-73f8a855d166 response_code = 200 uri = /v2p
26802024-12-20T23:05:33.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55830 req_id = 17171a6f-4511-4d4a-9905-c404842f8ebc response_code = 200 uri = /network-bootstore-config
26812024-12-20T23:05:33.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 936 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62390 req_id = fd03e403-d899-4196-8287-24968f495f2b response_code = 204 uri = /vpc-routes
26822024-12-20T23:05:33.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33379
26832024-12-20T23:05:33.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33379 req_id = 2c0f1a9c-57ef-4fd3-b70a-e57d4fcf74c7 response_code = 200 uri = /vpc-routes
26842024-12-20T23:05:33.346ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {7af95d5c-cc00-4843-9aab-7ae751cf8054: {10.151.1.175: {b9f0e957-0765-4023-bc13-350c229e799c}, 10.151.1.176: {b9f0e957-0765-4023-bc13-350c229e799c}}} }
26852024-12-20T23:05:33.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33379 req_id = 88e5b542-8276-4bf9-8d88-854dbbeb0f34 response_code = 204 uri = /eip-gateways
26862024-12-20T23:05:33.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33379 req_id = ded6bfb4-4581-4144-b6f0-e1c72b38c0a4 response_code = 204 uri = /vpc-routes
26872024-12-20T23:05:34.298ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
26882024-12-20T23:05:34.298ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569 zone file = illumos-utils/src/running_zone.rs:488 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26892024-12-20T23:05:34.487ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 73.028289ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26902024-12-20T23:05:34.586ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 62.771928ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26912024-12-20T23:05:34.669ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 240.001569ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26922024-12-20T23:05:34.924ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 470.513536ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26932024-12-20T23:05:35.409ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 455.385493ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26942024-12-20T23:05:35.876ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 1.148775638s file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26952024-12-20T23:05:37.036ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 1.307056869s file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26962024-12-20T23:05:38.355ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 1.037515427s file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 zone = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
26972024-12-20T23:05:39.424ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569 file = sled-agent/src/instance.rs:1786 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
26982024-12-20T23:05:39.434ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 35.58275ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
26992024-12-20T23:05:39.480ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 61.318821ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27002024-12-20T23:05:39.552ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 168.68553ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27012024-12-20T23:05:39.731ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569") failed: Property not found. retry in 347.73367ms file = illumos-utils/src/svc.rs:36 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27022024-12-20T23:05:39.811ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50947
27032024-12-20T23:05:39.811ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50947 req_id = 16aa3ada-2cd7-47f6-b756-e944cd7fc3e0 response_code = 200 uri = /baseboard
27042024-12-20T23:05:40.090ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27052024-12-20T23:05:40.129ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27062024-12-20T23:05:40.266ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27072024-12-20T23:05:40.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7311048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34342 req_id = 982ebf35-119d-46dc-9a93-73c9a28bc742 response_code = 200 uri = /vmms/4f3aa377-5a1f-4ea1-87b6-225f36799569/state
27082024-12-20T23:05:40.269ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-20T23:05:40.269939263Z } file = sled-agent/src/instance.rs:780 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27092024-12-20T23:05:40.269ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T23:05:40.269939263Z } propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27102024-12-20T23:05:40.269ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-20T23:05:40.269939263Z }, migration_in: None, migration_out: None }
27112024-12-20T23:05:40.313ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-20T23:05:40.313109689Z } file = sled-agent/src/instance.rs:780 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27122024-12-20T23:05:40.313ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T23:05:40.313109689Z } propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27132024-12-20T23:05:40.313ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-20T23:05:40.313109689Z }, migration_in: None, migration_out: None }
27142024-12-20T23:05:43.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7785 local_addr = [fd00:1122:3344:101::1]:54328 method = GET remote_addr = [fd00:1122:3344:101::d]:51440 req_id = ab722ddc-f016-4d0d-8249-69ca26146358 response_code = 200 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d uri = /287d6774-d3e6-4b73-8c77-c90534d4a54d
27152024-12-20T23:05:50.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41363
27162024-12-20T23:05:50.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41363 req_id = 17b2dac0-9989-4576-bb75-d1eeb767a984 response_code = 200 uri = /vmms/4f3aa377-5a1f-4ea1-87b6-225f36799569/state
27172024-12-20T23:05:50.643ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-20T23:05:50.643415688Z } file = sled-agent/src/instance.rs:780 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27182024-12-20T23:05:50.643ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T23:05:50.643415688Z } propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27192024-12-20T23:05:50.643ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-20T23:05:50.643415688Z }, migration_in: None, migration_out: None }
27202024-12-20T23:05:50.680ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-20T23:05:50.680355113Z } file = sled-agent/src/instance.rs:780 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27212024-12-20T23:05:50.680ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-20T23:05:50.680355113Z } propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27222024-12-20T23:05:50.680ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27232024-12-20T23:05:50.680ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27242024-12-20T23:05:50.680ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 9114975650173687235 n_samples = 6 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
27252024-12-20T23:05:50.680ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27262024-12-20T23:05:50.680ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/54947fde-6f46-42c6-a75c-eac205d82ba4/debug/bundle/zone", "/pool/int/708c9a94-dadb-4abd-b4a8-a26b3220460f/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/1bebbc47-252a-4b92-8d16-64a505e777ec/crypt/debug", "/pool/ext/701c8ea1-345c-4075-ace9-faafb7eddcd2/crypt/debug", "/pool/ext/d31b2b69-efd5-461d-912c-5052088aed91/crypt/debug", "/pool/ext/2b0333c0-c6c1-4cff-a03f-fd082c50dea1/crypt/debug", "/pool/ext/166c0ffc-1620-468b-944c-cc02dcfd2e27/crypt/debug", "/pool/ext/7b572d7f-8e45-4fb2-b3eb-bd3394a846b4/crypt/debug", "/pool/ext/091028cb-f478-4341-abae-5f1e6cecc3ba/crypt/debug", "/pool/ext/b960ef68-fd77-411f-b5e4-77a645524bc5/crypt/debug", "/pool/ext/38fd6a55-6517-4c3e-af4d-ade80ff38aae/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569
27272024-12-20T23:05:50.680ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11648718352064798456 n_samples = 6 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
27282024-12-20T23:05:51.331ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569", bundle_id: cc57b0ac-a672-43f6-89cc-dbb59f8f3530 }, time_created: 2024-12-20T23:05:50.681740811Z, version: 0, cause: TerminatedInstance }
27292024-12-20T23:05:51.331ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_4f3aa377-5a1f-4ea1-87b6-225f36799569 file = sled-agent/src/instance.rs:1032 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27302024-12-20T23:05:53.103ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27312024-12-20T23:05:53.120ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9502392), kind: System }
27322024-12-20T23:05:53.120ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9502392), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27332024-12-20T23:05:53.121ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T23:05:53.120977547Z }, migration_in: None, migration_out: None }
27342024-12-20T23:05:53.143ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-20T23:05:53.120977547Z }, migration_in: None, migration_out: None }
27352024-12-20T23:05:53.148ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = a19e5d99-42f4-4662-bf03-f1e0ac809d69 propolis_id = 4f3aa377-5a1f-4ea1-87b6-225f36799569
27362024-12-20T23:05:53.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59527
27372024-12-20T23:05:53.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59527 req_id = 93549e14-33c1-49e5-b8e0-5c2f160e54e0 response_code = 200 uri = /vpc-routes
27382024-12-20T23:05:53.618ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
27392024-12-20T23:05:53.618ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d
27402024-12-20T23:05:53.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59527 req_id = 73e26add-74b2-4d9b-86de-50b3fc0b6f84 response_code = 204 uri = /eip-gateways
27412024-12-20T23:05:53.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54873
27422024-12-20T23:05:53.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54873 req_id = 0328ff7f-5d75-45b7-aa53-c323c43b0b51 response_code = 200 uri = /v2p
27432024-12-20T23:05:53.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59527 req_id = e75c9c5a-f623-4474-922a-bc9316a8ca8b response_code = 204 uri = /vpc-routes
27442024-12-20T23:05:53.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37413
27452024-12-20T23:05:53.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37413 req_id = d7e76779-afee-4d39-ab0f-40275f5f51e3 response_code = 200 uri = /v2p
27462024-12-20T23:05:54.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35107
27472024-12-20T23:05:54.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35107 req_id = c425481d-ccb9-4519-afba-fd1cf049fdb0 response_code = 200 uri = /vpc-routes
27482024-12-20T23:05:54.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
27492024-12-20T23:05:54.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35107 req_id = b0e95a25-1565-4d73-8ea0-a15cc329c115 response_code = 204 uri = /eip-gateways
27502024-12-20T23:05:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35107 req_id = ce97c227-a3a5-4c4e-bb80-72278493e509 response_code = 204 uri = /vpc-routes
27512024-12-20T23:05:54.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33161
27522024-12-20T23:05:54.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33161 req_id = a4fffcdc-6e91-4a52-8ee5-13cc9044fa40 response_code = 200 uri = /vpc-routes
27532024-12-20T23:05:54.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 287d6774-d3e6-4b73-8c77-c90534d4a54d values = ExternalIpGatewayMap { mappings: {} }
27542024-12-20T23:05:54.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33161 req_id = 2c6373ec-70a5-4c56-a590-b008d5128645 response_code = 204 uri = /eip-gateways
27552024-12-20T23:05:54.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33161 req_id = 4d527dc4-ef46-40e2-9b67-3c81f796bcbd response_code = 204 uri = /vpc-routes