Max level shown:
1 [ Dec 21 01:36:29 Enabled. ]
2 [ Dec 21 01:36:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 01:36:29 Method "start" exited with status 0. ]
4 [ Dec 21 01:36:29 Rereading configuration. ]
5 [ Dec 21 01:36:29 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T01:36:29.326ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T01:36:29.326ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T01:36:29.379ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T01:36:29.379ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T01:36:29.493ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T01:36:29.502ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T01:36:29.511ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T01:36:30.116ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-21T01:36:30.255ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T01:36:30.255ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T01:36:30.255ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T01:36:30.255ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192024-12-21T01:36:30.255ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202024-12-21T01:36:30.255ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-21T01:36:30.258ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T01:36:30.258ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T01:36:30.258ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T01:36:30.258ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T01:36:30.258ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T01:36:30.258ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T01:36:30.259ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T01:36:30.259ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T01:36:30.259ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T01:36:30.270ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T01:36:30.270ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool)
322024-12-21T01:36:30.372ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal }
332024-12-21T01:36:30.735ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T01:36:30.735ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T01:36:30.735ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T01:36:30.735ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T01:36:30.735ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T01:36:30.735ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T01:36:30.736ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T01:36:30.744ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T01:36:30.744ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool)
422024-12-21T01:36:30.831ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal }
432024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
532024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
722024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
882024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-21T01:36:31.196ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-21T01:36:31.196ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-21T01:36:31.196ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-21T01:36:31.196ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-21T01:36:31.196ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-21T01:36:31.196ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-21T01:36:31.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032024-12-21T01:36:31.196ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-21T01:36:31.196ZINFOSledAgent (bootstore): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-21T01:36:31.196ZINFOSledAgent (bootstore): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-21T01:36:31.196ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-12-21T01:36:31.196ZINFOSledAgent (bootstore): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-12-21T01:36:31.196ZINFOSledAgent (bootstore): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-12-21T01:36:31.196ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-12-21T01:36:31.196ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-21T01:36:31.196ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-21T01:36:31.207ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132024-12-21T01:36:31.208ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1236, tv_nsec: 571834669 } time_to_next_cleanup = 599.999904249s
1142024-12-21T01:36:31.208ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1152024-12-21T01:36:31.208ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-21T01:36:31.210ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-21T01:36:31.210ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-21T01:36:31.211ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-12-21T01:36:31.212ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-12-21T01:36:31.213ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-21T01:36:31.213ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-21T01:36:31.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-21T01:36:31.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-21T01:36:31.213ZINFOSledAgent (RSS): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-21T01:36:31.213ZINFOSledAgent (RSS): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-21T01:36:31.213ZINFOSledAgent (RSS): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-21T01:36:31.213ZINFOSledAgent (RSS): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-21T01:36:31.213ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-21T01:36:31.213ZINFOSledAgent (RSS): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-21T01:36:31.213ZINFOSledAgent (RSS): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-21T01:36:31.214ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-21T01:36:31.214ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-21T01:36:31.214ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-21T01:36:31.214ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-21T01:36:31.214ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362024-12-21T01:36:31.214ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-12-21T01:36:31.214ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382024-12-21T01:36:31.214ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392024-12-21T01:36:31.214ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 402798b1-2357-48f5-992b-b9e53d91bbe0 (sled), rack_id: 71471b13-5882-48d1-83b5-9cf05bae6c2e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402024-12-21T01:36:31.215ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1412024-12-21T01:36:31.215ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1422024-12-21T01:36:31.219ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-21T01:36:31.225ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-21T01:36:31.225ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-21T01:36:31.229ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-21T01:36:31.229ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-21T01:36:31.230ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:52603
1482024-12-21T01:36:31.230ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 402798b1-2357-48f5-992b-b9e53d91bbe0 (sled), rack_id: 71471b13-5882-48d1-83b5-9cf05bae6c2e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-21T01:36:31.230ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-21T01:36:31.230ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-21T01:36:31.230ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542024-12-21T01:36:31.230ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-21T01:36:31.230ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-21T01:36:31.230ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-21T01:36:31.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-21T01:36:31.265ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-21T01:36:31.282ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-21T01:36:31.315ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1662024-12-21T01:36:31.315ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-21T01:36:31.315ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1682024-12-21T01:36:31.315ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-21T01:36:31.318ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 99.146168ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a0a3da5d-1f5e-4e12-9f95-c621980e1e8f", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a0a3da5d-1f5e-4e12-9f95-c621980e1e8f" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-21T01:36:31.329ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_b96d83ac-d68d-40e0-9691-01eb0216fb08/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-21T01:36:31.356ZINFOSledAgent: successfully created encrypted zvol: name="oxi_b96d83ac-d68d-40e0-9691-01eb0216fb08/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-21T01:36:31.356ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_b96d83ac-d68d-40e0-9691-01eb0216fb08/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-21T01:36:31.362ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1742024-12-21T01:36:31.362ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-21T01:36:31.362ZINFOSledAgent (BackingFs): Ensuring dataset oxi_b96d83ac-d68d-40e0-9691-01eb0216fb08/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-21T01:36:31.419ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T01:36:31.419ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 76.951114ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8d42717f-ff0a-4a02-a765-12dc89b73288", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8d42717f-ff0a-4a02-a765-12dc89b73288" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T01:36:31.434ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792024-12-21T01:36:31.497ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-21T01:36:31.497ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 93.026573ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c83ebcfb-35f8-44ef-bd20-cd5e45ee9798", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c83ebcfb-35f8-44ef-bd20-cd5e45ee9798" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-21T01:36:31.591ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-12-21T01:36:31.591ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 156.424029ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d2e91279-89fa-4829-83c3-6256a59acb12", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d2e91279-89fa-4829-83c3-6256a59acb12" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-12-21T01:36:31.652ZINFOSledAgent (BackingFs): Mounting oxi_b96d83ac-d68d-40e0-9691-01eb0216fb08/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842024-12-21T01:36:31.665ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852024-12-21T01:36:31.665ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862024-12-21T01:36:31.665ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872024-12-21T01:36:31.665ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882024-12-21T01:36:31.750ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-21T01:36:31.750ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 139.184765ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "84c26b5c-4489-402b-a01a-c3e387e9d77f", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "84c26b5c-4489-402b-a01a-c3e387e9d77f" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-21T01:36:31.891ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-21T01:36:31.892ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 208.466244ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5a973d48-20b4-49ee-9a3f-135a45df132d", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5a973d48-20b4-49ee-9a3f-135a45df132d" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-21T01:36:32.101ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-21T01:36:32.102ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 406.961186ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "19a5ca03-a91b-4bdd-9b6e-12719b954096", "content-length": "124", "date": "Sat, 21 Dec 2024 01:36:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "19a5ca03-a91b-4bdd-9b6e-12719b954096" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-21T01:36:32.409ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1952024-12-21T01:36:32.415ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:57402 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1962024-12-21T01:36:32.415ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1972024-12-21T01:36:32.415ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57402 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1982024-12-21T01:36:32.416ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 238.982915ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
1992024-12-21T01:36:32.417ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2002024-12-21T01:36:32.417ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2012024-12-21T01:36:32.417ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022024-12-21T01:36:32.417ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-21T01:36:32.510ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-12-21T01:36:32.656ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 297.695245ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2052024-12-21T01:36:32.956ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 702.165927ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2062024-12-21T01:36:33.660ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.458711673s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2072024-12-21T01:36:34.970ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2082024-12-21T01:36:34.970ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2092024-12-21T01:36:34.970ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2102024-12-21T01:36:34.970ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2112024-12-21T01:36:34.970ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2122024-12-21T01:36:34.970ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2132024-12-21T01:36:34.972ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2142024-12-21T01:36:34.973ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2152024-12-21T01:36:34.973ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='1c2ffd7f-e2ca-4ca9-a444-14d6fc9d8eb0'/> <propval type="astring" name="rack_id" value='71471b13-5882-48d1-83b5-9cf05bae6c2e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe9d:234e'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='71471b13-5882-48d1-83b5-9cf05bae6c2e'/> <propval type="astring" name="sled_id" value='402798b1-2357-48f5-992b-b9e53d91bbe0'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='402798b1-2357-48f5-992b-b9e53d91bbe0'/> <propval type="astring" name="rack_uuid" value='71471b13-5882-48d1-83b5-9cf05bae6c2e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='402798b1-2357-48f5-992b-b9e53d91bbe0'/> <propval type="astring" name="rack_uuid" value='71471b13-5882-48d1-83b5-9cf05bae6c2e'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-21T01:36:34.973ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-21T01:36:35.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 54.063561ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T01:36:35.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 146.298335ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-21T01:36:35.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 166.901217ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T01:36:35.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 489.869537ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T01:36:36.121ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.651975647s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2222024-12-21T01:36:36.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 721.89713ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T01:36:37.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 690.63322ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-21T01:36:38.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.25713323s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-21T01:36:39.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.079063313s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-21T01:36:41.044ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.809870619s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2272024-12-21T01:36:41.050ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/nexus.rs:527 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2282024-12-21T01:36:41.080ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292024-12-21T01:36:41.081ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2302024-12-21T01:36:41.082ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-21T01:36:41.082ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-21T01:36:41.082ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332024-12-21T01:36:41.082ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-21T01:36:41.083ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-21T01:36:41.083ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-21T01:36:41.083ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-21T01:36:41.083ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2382024-12-21T01:36:41.312ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:52603
2392024-12-21T01:36:41.313ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-12-21T01:36:41.313ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412024-12-21T01:36:41.325ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-21T01:36:41.325ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2432024-12-21T01:36:41.325ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-21T01:36:41.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47009
2452024-12-21T01:36:41.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462024-12-21T01:36:41.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472024-12-21T01:36:41.617ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-21T01:36:41.618ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:188
2492024-12-21T01:36:41.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47009 req_id = cc18ebac-5487-4f6b-8d0d-a55db213e9b6 response_code = 200 uri = /inventory
2502024-12-21T01:36:41.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60508
2512024-12-21T01:36:41.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60508 req_id = 922639bb-bd47-44dd-985c-949512a3e5c5 response_code = 200 uri = /sled-role
2522024-12-21T01:36:41.678ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a184af40-e245-4e77-a450-d7bd3fd69d0c (physical_disk), pool_id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 08253bca-8ccf-4a86-9c57-cc3d5e5b87cf (physical_disk), pool_id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 45a7b236-68b6-4c05-8969-b65e042f112f (physical_disk), pool_id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1bd81cc8-d339-4e55-b736-42e1e9b6c382 (physical_disk), pool_id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b8f5f1e6-dbfc-4124-ad16-6d12f3c18ac1 (physical_disk), pool_id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7a99c5a1-4462-48af-ad88-3cfba360bc93 (physical_disk), pool_id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 5b0300ea-f722-4fd6-b4b7-cf9c6d3399a8 (physical_disk), pool_id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3cd35dfc-ffcb-4d9b-912e-90acc47b7346 (physical_disk), pool_id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: bd88edd8-7ace-42e0-8c02-ef4a4cf97d30 (physical_disk), pool_id: e97d276e-ea54-4591-8041-1234166ccdea (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532024-12-21T01:36:41.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48306
2542024-12-21T01:36:41.678ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2552024-12-21T01:36:41.678ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a184af40-e245-4e77-a450-d7bd3fd69d0c (physical_disk), pool_id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 08253bca-8ccf-4a86-9c57-cc3d5e5b87cf (physical_disk), pool_id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 45a7b236-68b6-4c05-8969-b65e042f112f (physical_disk), pool_id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 1bd81cc8-d339-4e55-b736-42e1e9b6c382 (physical_disk), pool_id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b8f5f1e6-dbfc-4124-ad16-6d12f3c18ac1 (physical_disk), pool_id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7a99c5a1-4462-48af-ad88-3cfba360bc93 (physical_disk), pool_id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 5b0300ea-f722-4fd6-b4b7-cf9c6d3399a8 (physical_disk), pool_id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 3cd35dfc-ffcb-4d9b-912e-90acc47b7346 (physical_disk), pool_id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: bd88edd8-7ace-42e0-8c02-ef4a4cf97d30 (physical_disk), pool_id: e97d276e-ea54-4591-8041-1234166ccdea (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562024-12-21T01:36:41.678ZINFOSledAgent (StorageManager): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-21T01:36:41.678ZINFOSledAgent (StorageManager): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582024-12-21T01:36:41.678ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592024-12-21T01:36:41.678ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602024-12-21T01:36:41.678ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612024-12-21T01:36:41.678ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622024-12-21T01:36:41.678ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632024-12-21T01:36:41.821ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642024-12-21T01:36:41.821ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool)
2652024-12-21T01:36:42.274ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2662024-12-21T01:36:42.484ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2672024-12-21T01:36:42.485ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4094104007061318683 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2682024-12-21T01:36:42.485ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17437686288073003279 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
2692024-12-21T01:36:42.533ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }
2702024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2712024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2722024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2732024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2742024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-12-21T01:36:42.541ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2772024-12-21T01:36:42.578ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-12-21T01:36:42.587ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone file = sled-storage/src/dataset.rs:302
2792024-12-21T01:36:42.726ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9 file = sled-storage/src/dataset.rs:388
2802024-12-21T01:36:42.735ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812024-12-21T01:36:42.735ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822024-12-21T01:36:42.735ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832024-12-21T01:36:42.735ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-12-21T01:36:42.735ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852024-12-21T01:36:42.744ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2862024-12-21T01:36:42.744ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool)
2872024-12-21T01:36:42.840ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }
2882024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2892024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2902024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2912024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2922024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-12-21T01:36:42.850ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2952024-12-21T01:36:42.886ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-12-21T01:36:42.895ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone file = sled-storage/src/dataset.rs:302
2972024-12-21T01:36:43.035ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593 file = sled-storage/src/dataset.rs:388
2982024-12-21T01:36:43.044ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-12-21T01:36:43.044ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-12-21T01:36:43.044ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-12-21T01:36:43.044ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-12-21T01:36:43.044ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-12-21T01:36:43.054ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042024-12-21T01:36:43.054ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool)
3052024-12-21T01:36:43.149ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }
3062024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3072024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3082024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3092024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3102024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-21T01:36:43.157ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3132024-12-21T01:36:43.192ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-12-21T01:36:43.200ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone file = sled-storage/src/dataset.rs:302
3152024-12-21T01:36:43.276ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
3162024-12-21T01:36:43.339ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5 file = sled-storage/src/dataset.rs:388
3172024-12-21T01:36:43.347ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182024-12-21T01:36:43.347ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192024-12-21T01:36:43.347ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202024-12-21T01:36:43.347ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-12-21T01:36:43.347ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-12-21T01:36:43.357ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3232024-12-21T01:36:43.357ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b5960098-1ada-427e-bb79-ca59165428b6 (zpool)
3242024-12-21T01:36:43.458ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }
3252024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3262024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3272024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3282024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3292024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-12-21T01:36:43.467ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3322024-12-21T01:36:43.503ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-12-21T01:36:43.511ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone file = sled-storage/src/dataset.rs:302
3342024-12-21T01:36:43.652ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b5960098-1ada-427e-bb79-ca59165428b6 file = sled-storage/src/dataset.rs:388
3352024-12-21T01:36:43.660ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362024-12-21T01:36:43.660ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372024-12-21T01:36:43.660ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382024-12-21T01:36:43.660ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392024-12-21T01:36:43.660ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-12-21T01:36:43.670ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3412024-12-21T01:36:43.670ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool)
3422024-12-21T01:36:43.773ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }
3432024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3442024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3452024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3462024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3472024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-12-21T01:36:43.782ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3502024-12-21T01:36:43.817ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-12-21T01:36:43.826ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone file = sled-storage/src/dataset.rs:302
3522024-12-21T01:36:43.964ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0 file = sled-storage/src/dataset.rs:388
3532024-12-21T01:36:43.972ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542024-12-21T01:36:43.972ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552024-12-21T01:36:43.972ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562024-12-21T01:36:43.972ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572024-12-21T01:36:43.973ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-12-21T01:36:43.982ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3592024-12-21T01:36:43.982ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 335ed515-415f-4302-9f2a-54aed0987aee (zpool)
3602024-12-21T01:36:44.079ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }
3612024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3622024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3632024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3642024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3652024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-21T01:36:44.087ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3682024-12-21T01:36:44.122ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-12-21T01:36:44.130ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_335ed515-415f-4302-9f2a-54aed0987aee/crypt/zone file = sled-storage/src/dataset.rs:302
3702024-12-21T01:36:44.268ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_335ed515-415f-4302-9f2a-54aed0987aee file = sled-storage/src/dataset.rs:388
3712024-12-21T01:36:44.276ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722024-12-21T01:36:44.276ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732024-12-21T01:36:44.276ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742024-12-21T01:36:44.276ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-12-21T01:36:44.276ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-12-21T01:36:44.286ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772024-12-21T01:36:44.286ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool)
3782024-12-21T01:36:44.379ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }
3792024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3802024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3812024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3822024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3832024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-21T01:36:44.387ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3862024-12-21T01:36:44.391ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
3872024-12-21T01:36:44.424ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-12-21T01:36:44.432ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone file = sled-storage/src/dataset.rs:302
3892024-12-21T01:36:44.571ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_130551aa-49ad-44d7-81d9-df8b0df41eec file = sled-storage/src/dataset.rs:388
3902024-12-21T01:36:44.579ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3912024-12-21T01:36:44.579ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3922024-12-21T01:36:44.579ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3932024-12-21T01:36:44.579ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3942024-12-21T01:36:44.579ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952024-12-21T01:36:44.589ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3962024-12-21T01:36:44.589ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool)
3972024-12-21T01:36:44.688ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }
3982024-12-21T01:36:44.696ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3992024-12-21T01:36:44.697ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4002024-12-21T01:36:44.697ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4012024-12-21T01:36:44.697ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4022024-12-21T01:36:44.697ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-21T01:36:44.697ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-12-21T01:36:44.697ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4052024-12-21T01:36:44.733ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062024-12-21T01:36:44.742ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone file = sled-storage/src/dataset.rs:302
4072024-12-21T01:36:44.887ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142 file = sled-storage/src/dataset.rs:388
4082024-12-21T01:36:44.896ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092024-12-21T01:36:44.896ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102024-12-21T01:36:44.896ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112024-12-21T01:36:44.896ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122024-12-21T01:36:44.896ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132024-12-21T01:36:44.905ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4142024-12-21T01:36:44.905ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e97d276e-ea54-4591-8041-1234166ccdea (zpool)
4152024-12-21T01:36:45.006ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }
4162024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4172024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4182024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4192024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4202024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-21T01:36:45.014ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4232024-12-21T01:36:45.054ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242024-12-21T01:36:45.062ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e97d276e-ea54-4591-8041-1234166ccdea/crypt/zone file = sled-storage/src/dataset.rs:302
4252024-12-21T01:36:45.207ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e97d276e-ea54-4591-8041-1234166ccdea file = sled-storage/src/dataset.rs:388
4262024-12-21T01:36:45.215ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272024-12-21T01:36:45.215ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282024-12-21T01:36:45.215ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292024-12-21T01:36:45.216ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b96d83ac-d68d-40e0-9691-01eb0216fb08 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7dc7dd1f-faf1-44a0-bded-f21c01fb1c73 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302024-12-21T01:36:45.216ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312024-12-21T01:36:45.216ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322024-12-21T01:36:45.216ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-12-21T01:36:45.216ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4342024-12-21T01:36:45.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4352024-12-21T01:36:45.216ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4362024-12-21T01:36:45.216ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4372024-12-21T01:36:45.216ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4382024-12-21T01:36:45.216ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4392024-12-21T01:36:45.216ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4402024-12-21T01:36:45.216ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412024-12-21T01:36:45.216ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4422024-12-21T01:36:45.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3538245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48306 req_id = 453f0721-686b-4860-a2b9-d64b8bfc61dd response_code = 200 uri = /omicron-physical-disks
4432024-12-21T01:36:45.248ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03b406b1-5a9a-4b0b-b653-ae5541d03abf (dataset): DatasetConfig { id: 03b406b1-5a9a-4b0b-b653-ae5541d03abf (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04022685-ff9b-4916-9b34-d2de66d4906f (dataset): DatasetConfig { id: 04022685-ff9b-4916-9b34-d2de66d4906f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07224e8c-1a9a-4b13-9bd5-7a3478719567 (dataset): DatasetConfig { id: 07224e8c-1a9a-4b13-9bd5-7a3478719567 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a3fa0ae-88ff-4e47-9235-12292ddce387 (dataset): DatasetConfig { id: 0a3fa0ae-88ff-4e47-9235-12292ddce387 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d174530-5e92-403e-a569-297c51e7f411 (dataset): DatasetConfig { id: 0d174530-5e92-403e-a569-297c51e7f411 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0db1af98-1ae8-4b35-8de3-c6dc6992766f (dataset): DatasetConfig { id: 0db1af98-1ae8-4b35-8de3-c6dc6992766f (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10fb3dc6-71e9-4b79-8436-a763f73be3d5 (dataset): DatasetConfig { id: 10fb3dc6-71e9-4b79-8436-a763f73be3d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1488f279-6e9c-4555-8dd1-2f3db192f269 (dataset): DatasetConfig { id: 1488f279-6e9c-4555-8dd1-2f3db192f269 (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dba0c60-124f-46e7-86e0-f2c6799cb5e3 (dataset): DatasetConfig { id: 1dba0c60-124f-46e7-86e0-f2c6799cb5e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 202625a2-eec5-487d-9b43-0c45758c83b9 (dataset): DatasetConfig { id: 202625a2-eec5-487d-9b43-0c45758c83b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 261df95c-46c3-4395-84fb-c918f6984fcb (dataset): DatasetConfig { id: 261df95c-46c3-4395-84fb-c918f6984fcb (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 277e246e-61d5-4478-9ebf-1c28eab69b87 (dataset): DatasetConfig { id: 277e246e-61d5-4478-9ebf-1c28eab69b87 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 308527e4-f1c9-4ef2-9542-615236988638 (dataset): DatasetConfig { id: 308527e4-f1c9-4ef2-9542-615236988638 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 343eb120-da34-417a-b52d-844329cefb58 (dataset): DatasetConfig { id: 343eb120-da34-417a-b52d-844329cefb58 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 39b53e17-bab5-4bcd-b1af-0a61b2715038 (dataset): DatasetConfig { id: 39b53e17-bab5-4bcd-b1af-0a61b2715038 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ef31e98-7282-402a-8e53-b3e68f53443b (dataset): DatasetConfig { id: 3ef31e98-7282-402a-8e53-b3e68f53443b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bf6cf85-e930-41bc-a2c0-b57d3c9b9de4 (dataset): DatasetConfig { id: 4bf6cf85-e930-41bc-a2c0-b57d3c9b9de4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d42d607-10aa-471f-b9f4-3cb64186fc4f (dataset): DatasetConfig { id: 4d42d607-10aa-471f-b9f4-3cb64186fc4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e1de61a-3cc5-41b4-9c76-b61a0bf66ab4 (dataset): DatasetConfig { id: 4e1de61a-3cc5-41b4-9c76-b61a0bf66ab4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 526ce18b-8352-4d17-ab93-ba36b93d9ae3 (dataset): DatasetConfig { id: 526ce18b-8352-4d17-ab93-ba36b93d9ae3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 55a5b648-a2b4-49f3-b871-78a8e86a4b90 (dataset): DatasetConfig { id: 55a5b648-a2b4-49f3-b871-78a8e86a4b90 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57a0a1bf-a20b-4617-889c-87bc176dce90 (dataset): DatasetConfig { id: 57a0a1bf-a20b-4617-889c-87bc176dce90 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58694d3f-8cfc-4cd1-a3f9-b1d206899e5f (dataset): DatasetConfig { id: 58694d3f-8cfc-4cd1-a3f9-b1d206899e5f (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 597b3408-0127-4f61-9170-ceedb5f446d6 (dataset): DatasetConfig { id: 597b3408-0127-4f61-9170-ceedb5f446d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b8a93f9-1af2-4347-917b-0dc50631048c (dataset): DatasetConfig { id: 5b8a93f9-1af2-4347-917b-0dc50631048c (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62e038cb-ec47-400d-8d90-eca38880a694 (dataset): DatasetConfig { id: 62e038cb-ec47-400d-8d90-eca38880a694 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6541f04a-36b4-427d-b07c-4271b041c441 (dataset): DatasetConfig { id: 6541f04a-36b4-427d-b07c-4271b041c441 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ff261e3-cd40-4df6-9aaa-067c6d2313fb (dataset): DatasetConfig { id: 6ff261e3-cd40-4df6-9aaa-067c6d2313fb (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 71e33a48-e2f8-4d86-bdf0-24c37b294d4b (dataset): DatasetConfig { id: 71e33a48-e2f8-4d86-bdf0-24c37b294d4b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7323eb19-460e-451e-987d-233de1c7e562 (dataset): DatasetConfig { id: 7323eb19-460e-451e-987d-233de1c7e562 (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76e78720-412e-46cc-a5e1-f86c07e6ad14 (dataset): DatasetConfig { id: 76e78720-412e-46cc-a5e1-f86c07e6ad14 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7765aa10-6281-417b-932a-4ce470989ed5 (dataset): DatasetConfig { id: 7765aa10-6281-417b-932a-4ce470989ed5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7aa3ae87-3217-4e06-bffd-3165addc2378 (dataset): DatasetConfig { id: 7aa3ae87-3217-4e06-bffd-3165addc2378 (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c4017f9-d4c7-4c0b-aa99-48650479583d (dataset): DatasetConfig { id: 7c4017f9-d4c7-4c0b-aa99-48650479583d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c63a937-4d09-47ff-beac-30b374277c4c (dataset): DatasetConfig { id: 7c63a937-4d09-47ff-beac-30b374277c4c (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fb3179b-4623-4d95-9224-b078a92f340c (dataset): DatasetConfig { id: 7fb3179b-4623-4d95-9224-b078a92f340c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83f9c716-33e7-43d0-9c07-35bbfbf645e7 (dataset): DatasetConfig { id: 83f9c716-33e7-43d0-9c07-35bbfbf645e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cd22508-476d-4842-a286-fcbe458a5914 (dataset): DatasetConfig { id: 8cd22508-476d-4842-a286-fcbe458a5914 (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91ae3390-a0ae-4c20-bc4b-94e374a64af4 (dataset): DatasetConfig { id: 91ae3390-a0ae-4c20-bc4b-94e374a64af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97781768-df12-4941-bd60-c7877b66bd56 (dataset): DatasetConfig { id: 97781768-df12-4941-bd60-c7877b66bd56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c8d6c0e-0bcb-4d48-acbd-b4a4b41113bf (dataset): DatasetConfig { id: 9c8d6c0e-0bcb-4d48-acbd-b4a4b41113bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ceddb03-909d-40fa-bdba-3f47969dfd17 (dataset): DatasetConfig { id: 9ceddb03-909d-40fa-bdba-3f47969dfd17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fe15b7e-436e-4331-8754-c93cbe565ae8 (dataset): DatasetConfig { id: 9fe15b7e-436e-4331-8754-c93cbe565ae8 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a21b5af9-3758-40de-9c89-873f560da15e (dataset): DatasetConfig { id: a21b5af9-3758-40de-9c89-873f560da15e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a29d4a48-312e-4a9e-99d9-ff4372fe0d12 (dataset): DatasetConfig { id: a29d4a48-312e-4a9e-99d9-ff4372fe0d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a70e0dbb-57a8-499a-927d-c2ffeafcf8ab (dataset): DatasetConfig { id: a70e0dbb-57a8-499a-927d-c2ffeafcf8ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8eee252-6160-4323-9830-480956858b9b (dataset): DatasetConfig { id: a8eee252-6160-4323-9830-480956858b9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab2955f0-827e-467e-9f29-ca6fa1564104 (dataset): DatasetConfig { id: ab2955f0-827e-467e-9f29-ca6fa1564104 (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aff2558b-3dd6-430b-bae9-7d21785f3b4d (dataset): DatasetConfig { id: aff2558b-3dd6-430b-bae9-7d21785f3b4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b599cee8-521c-4ea0-8ab3-7373f2a31ad6 (dataset): DatasetConfig { id: b599cee8-521c-4ea0-8ab3-7373f2a31ad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdae3fb9-1a7b-4f83-ab6f-fd33d006bac0 (dataset): DatasetConfig { id: bdae3fb9-1a7b-4f83-ab6f-fd33d006bac0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c482f7dd-0bbc-4edc-9f55-9097cda21348 (dataset): DatasetConfig { id: c482f7dd-0bbc-4edc-9f55-9097cda21348 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c4c66fe4-db1c-4945-b30c-ea77d953df2f (dataset): DatasetConfig { id: c4c66fe4-db1c-4945-b30c-ea77d953df2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c649324b-dc8a-40f9-b07f-c05b4a718625 (dataset): DatasetConfig { id: c649324b-dc8a-40f9-b07f-c05b4a718625 (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc24e36b-e9d3-4e1c-8ed0-548cc5c11407 (dataset): DatasetConfig { id: cc24e36b-e9d3-4e1c-8ed0-548cc5c11407 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd352ac2-47a3-4872-a57e-b3cc5e1f8ac5 (dataset): DatasetConfig { id: cd352ac2-47a3-4872-a57e-b3cc5e1f8ac5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4a46ff8-e98d-433b-b7fc-3d8f3e71c40a (dataset): DatasetConfig { id: d4a46ff8-e98d-433b-b7fc-3d8f3e71c40a (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d66d6383-71ca-4935-8d75-66f2d9a98d79 (dataset): DatasetConfig { id: d66d6383-71ca-4935-8d75-66f2d9a98d79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7bc052b-bc8c-45d4-b163-c21dc82da201 (dataset): DatasetConfig { id: d7bc052b-bc8c-45d4-b163-c21dc82da201 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0606784-dd56-4d63-bab0-71912c6c06c0 (dataset): DatasetConfig { id: e0606784-dd56-4d63-bab0-71912c6c06c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2d01b29-f64d-41fd-9fb7-daad121bc2de (dataset): DatasetConfig { id: f2d01b29-f64d-41fd-9fb7-daad121bc2de (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f71664b8-19b6-4a3f-9952-9696a8f6feda (dataset): DatasetConfig { id: f71664b8-19b6-4a3f-9952-9696a8f6feda (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f89539d2-cd47-4b8f-937d-aa87d17bbc5c (dataset): DatasetConfig { id: f89539d2-cd47-4b8f-937d-aa87d17bbc5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9db9dc5-72a8-4d71-bf4f-e18926378b7f (dataset): DatasetConfig { id: f9db9dc5-72a8-4d71-bf4f-e18926378b7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff5ad163-25c9-4432-9fc3-60f127752bf7 (dataset): DatasetConfig { id: ff5ad163-25c9-4432-9fc3-60f127752bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffa261de-f1dd-4b67-b238-3324920a156d (dataset): DatasetConfig { id: ffa261de-f1dd-4b67-b238-3324920a156d (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442024-12-21T01:36:45.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64810
4452024-12-21T01:36:45.249ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4462024-12-21T01:36:45.249ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03b406b1-5a9a-4b0b-b653-ae5541d03abf (dataset): DatasetConfig { id: 03b406b1-5a9a-4b0b-b653-ae5541d03abf (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04022685-ff9b-4916-9b34-d2de66d4906f (dataset): DatasetConfig { id: 04022685-ff9b-4916-9b34-d2de66d4906f (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07224e8c-1a9a-4b13-9bd5-7a3478719567 (dataset): DatasetConfig { id: 07224e8c-1a9a-4b13-9bd5-7a3478719567 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a3fa0ae-88ff-4e47-9235-12292ddce387 (dataset): DatasetConfig { id: 0a3fa0ae-88ff-4e47-9235-12292ddce387 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d174530-5e92-403e-a569-297c51e7f411 (dataset): DatasetConfig { id: 0d174530-5e92-403e-a569-297c51e7f411 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0db1af98-1ae8-4b35-8de3-c6dc6992766f (dataset): DatasetConfig { id: 0db1af98-1ae8-4b35-8de3-c6dc6992766f (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10fb3dc6-71e9-4b79-8436-a763f73be3d5 (dataset): DatasetConfig { id: 10fb3dc6-71e9-4b79-8436-a763f73be3d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1488f279-6e9c-4555-8dd1-2f3db192f269 (dataset): DatasetConfig { id: 1488f279-6e9c-4555-8dd1-2f3db192f269 (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1dba0c60-124f-46e7-86e0-f2c6799cb5e3 (dataset): DatasetConfig { id: 1dba0c60-124f-46e7-86e0-f2c6799cb5e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 202625a2-eec5-487d-9b43-0c45758c83b9 (dataset): DatasetConfig { id: 202625a2-eec5-487d-9b43-0c45758c83b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 261df95c-46c3-4395-84fb-c918f6984fcb (dataset): DatasetConfig { id: 261df95c-46c3-4395-84fb-c918f6984fcb (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 277e246e-61d5-4478-9ebf-1c28eab69b87 (dataset): DatasetConfig { id: 277e246e-61d5-4478-9ebf-1c28eab69b87 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 308527e4-f1c9-4ef2-9542-615236988638 (dataset): DatasetConfig { id: 308527e4-f1c9-4ef2-9542-615236988638 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 343eb120-da34-417a-b52d-844329cefb58 (dataset): DatasetConfig { id: 343eb120-da34-417a-b52d-844329cefb58 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 39b53e17-bab5-4bcd-b1af-0a61b2715038 (dataset): DatasetConfig { id: 39b53e17-bab5-4bcd-b1af-0a61b2715038 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ef31e98-7282-402a-8e53-b3e68f53443b (dataset): DatasetConfig { id: 3ef31e98-7282-402a-8e53-b3e68f53443b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4bf6cf85-e930-41bc-a2c0-b57d3c9b9de4 (dataset): DatasetConfig { id: 4bf6cf85-e930-41bc-a2c0-b57d3c9b9de4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d42d607-10aa-471f-b9f4-3cb64186fc4f (dataset): DatasetConfig { id: 4d42d607-10aa-471f-b9f4-3cb64186fc4f (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e1de61a-3cc5-41b4-9c76-b61a0bf66ab4 (dataset): DatasetConfig { id: 4e1de61a-3cc5-41b4-9c76-b61a0bf66ab4 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 526ce18b-8352-4d17-ab93-ba36b93d9ae3 (dataset): DatasetConfig { id: 526ce18b-8352-4d17-ab93-ba36b93d9ae3 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 55a5b648-a2b4-49f3-b871-78a8e86a4b90 (dataset): DatasetConfig { id: 55a5b648-a2b4-49f3-b871-78a8e86a4b90 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57a0a1bf-a20b-4617-889c-87bc176dce90 (dataset): DatasetConfig { id: 57a0a1bf-a20b-4617-889c-87bc176dce90 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58694d3f-8cfc-4cd1-a3f9-b1d206899e5f (dataset): DatasetConfig { id: 58694d3f-8cfc-4cd1-a3f9-b1d206899e5f (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 597b3408-0127-4f61-9170-ceedb5f446d6 (dataset): DatasetConfig { id: 597b3408-0127-4f61-9170-ceedb5f446d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b8a93f9-1af2-4347-917b-0dc50631048c (dataset): DatasetConfig { id: 5b8a93f9-1af2-4347-917b-0dc50631048c (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62e038cb-ec47-400d-8d90-eca38880a694 (dataset): DatasetConfig { id: 62e038cb-ec47-400d-8d90-eca38880a694 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6541f04a-36b4-427d-b07c-4271b041c441 (dataset): DatasetConfig { id: 6541f04a-36b4-427d-b07c-4271b041c441 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ff261e3-cd40-4df6-9aaa-067c6d2313fb (dataset): DatasetConfig { id: 6ff261e3-cd40-4df6-9aaa-067c6d2313fb (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 71e33a48-e2f8-4d86-bdf0-24c37b294d4b (dataset): DatasetConfig { id: 71e33a48-e2f8-4d86-bdf0-24c37b294d4b (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7323eb19-460e-451e-987d-233de1c7e562 (dataset): DatasetConfig { id: 7323eb19-460e-451e-987d-233de1c7e562 (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76e78720-412e-46cc-a5e1-f86c07e6ad14 (dataset): DatasetConfig { id: 76e78720-412e-46cc-a5e1-f86c07e6ad14 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7765aa10-6281-417b-932a-4ce470989ed5 (dataset): DatasetConfig { id: 7765aa10-6281-417b-932a-4ce470989ed5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7aa3ae87-3217-4e06-bffd-3165addc2378 (dataset): DatasetConfig { id: 7aa3ae87-3217-4e06-bffd-3165addc2378 (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c4017f9-d4c7-4c0b-aa99-48650479583d (dataset): DatasetConfig { id: 7c4017f9-d4c7-4c0b-aa99-48650479583d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c63a937-4d09-47ff-beac-30b374277c4c (dataset): DatasetConfig { id: 7c63a937-4d09-47ff-beac-30b374277c4c (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7fb3179b-4623-4d95-9224-b078a92f340c (dataset): DatasetConfig { id: 7fb3179b-4623-4d95-9224-b078a92f340c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83f9c716-33e7-43d0-9c07-35bbfbf645e7 (dataset): DatasetConfig { id: 83f9c716-33e7-43d0-9c07-35bbfbf645e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8cd22508-476d-4842-a286-fcbe458a5914 (dataset): DatasetConfig { id: 8cd22508-476d-4842-a286-fcbe458a5914 (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91ae3390-a0ae-4c20-bc4b-94e374a64af4 (dataset): DatasetConfig { id: 91ae3390-a0ae-4c20-bc4b-94e374a64af4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 97781768-df12-4941-bd60-c7877b66bd56 (dataset): DatasetConfig { id: 97781768-df12-4941-bd60-c7877b66bd56 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c8d6c0e-0bcb-4d48-acbd-b4a4b41113bf (dataset): DatasetConfig { id: 9c8d6c0e-0bcb-4d48-acbd-b4a4b41113bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ceddb03-909d-40fa-bdba-3f47969dfd17 (dataset): DatasetConfig { id: 9ceddb03-909d-40fa-bdba-3f47969dfd17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fe15b7e-436e-4331-8754-c93cbe565ae8 (dataset): DatasetConfig { id: 9fe15b7e-436e-4331-8754-c93cbe565ae8 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a21b5af9-3758-40de-9c89-873f560da15e (dataset): DatasetConfig { id: a21b5af9-3758-40de-9c89-873f560da15e (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a29d4a48-312e-4a9e-99d9-ff4372fe0d12 (dataset): DatasetConfig { id: a29d4a48-312e-4a9e-99d9-ff4372fe0d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a70e0dbb-57a8-499a-927d-c2ffeafcf8ab (dataset): DatasetConfig { id: a70e0dbb-57a8-499a-927d-c2ffeafcf8ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8eee252-6160-4323-9830-480956858b9b (dataset): DatasetConfig { id: a8eee252-6160-4323-9830-480956858b9b (dataset), name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab2955f0-827e-467e-9f29-ca6fa1564104 (dataset): DatasetConfig { id: ab2955f0-827e-467e-9f29-ca6fa1564104 (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aff2558b-3dd6-430b-bae9-7d21785f3b4d (dataset): DatasetConfig { id: aff2558b-3dd6-430b-bae9-7d21785f3b4d (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b599cee8-521c-4ea0-8ab3-7373f2a31ad6 (dataset): DatasetConfig { id: b599cee8-521c-4ea0-8ab3-7373f2a31ad6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bdae3fb9-1a7b-4f83-ab6f-fd33d006bac0 (dataset): DatasetConfig { id: bdae3fb9-1a7b-4f83-ab6f-fd33d006bac0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c482f7dd-0bbc-4edc-9f55-9097cda21348 (dataset): DatasetConfig { id: c482f7dd-0bbc-4edc-9f55-9097cda21348 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c4c66fe4-db1c-4945-b30c-ea77d953df2f (dataset): DatasetConfig { id: c4c66fe4-db1c-4945-b30c-ea77d953df2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c649324b-dc8a-40f9-b07f-c05b4a718625 (dataset): DatasetConfig { id: c649324b-dc8a-40f9-b07f-c05b4a718625 (dataset), name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc24e36b-e9d3-4e1c-8ed0-548cc5c11407 (dataset): DatasetConfig { id: cc24e36b-e9d3-4e1c-8ed0-548cc5c11407 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd352ac2-47a3-4872-a57e-b3cc5e1f8ac5 (dataset): DatasetConfig { id: cd352ac2-47a3-4872-a57e-b3cc5e1f8ac5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4a46ff8-e98d-433b-b7fc-3d8f3e71c40a (dataset): DatasetConfig { id: d4a46ff8-e98d-433b-b7fc-3d8f3e71c40a (dataset), name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d66d6383-71ca-4935-8d75-66f2d9a98d79 (dataset): DatasetConfig { id: d66d6383-71ca-4935-8d75-66f2d9a98d79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7bc052b-bc8c-45d4-b163-c21dc82da201 (dataset): DatasetConfig { id: d7bc052b-bc8c-45d4-b163-c21dc82da201 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0606784-dd56-4d63-bab0-71912c6c06c0 (dataset): DatasetConfig { id: e0606784-dd56-4d63-bab0-71912c6c06c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2d01b29-f64d-41fd-9fb7-daad121bc2de (dataset): DatasetConfig { id: f2d01b29-f64d-41fd-9fb7-daad121bc2de (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f71664b8-19b6-4a3f-9952-9696a8f6feda (dataset): DatasetConfig { id: f71664b8-19b6-4a3f-9952-9696a8f6feda (dataset), name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f89539d2-cd47-4b8f-937d-aa87d17bbc5c (dataset): DatasetConfig { id: f89539d2-cd47-4b8f-937d-aa87d17bbc5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f9db9dc5-72a8-4d71-bf4f-e18926378b7f (dataset): DatasetConfig { id: f9db9dc5-72a8-4d71-bf4f-e18926378b7f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff5ad163-25c9-4432-9fc3-60f127752bf7 (dataset): DatasetConfig { id: ff5ad163-25c9-4432-9fc3-60f127752bf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffa261de-f1dd-4b67-b238-3324920a156d (dataset): DatasetConfig { id: ffa261de-f1dd-4b67-b238-3324920a156d (dataset), name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4472024-12-21T01:36:45.249ZINFOSledAgent (StorageManager): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-21T01:36:45.249ZINFOSledAgent (StorageManager): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492024-12-21T01:36:45.249ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4502024-12-21T01:36:45.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512024-12-21T01:36:45.264ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4522024-12-21T01:36:45.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone/oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc"), full_name: "oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone/oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc" } file = sled-storage/src/manager.rs:1431
4532024-12-21T01:36:45.331ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542024-12-21T01:36:45.331ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4552024-12-21T01:36:45.331ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4562024-12-21T01:36:45.382ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572024-12-21T01:36:45.382ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582024-12-21T01:36:45.382ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crucible" } file = sled-storage/src/manager.rs:1431
4592024-12-21T01:36:45.394ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
4602024-12-21T01:36:45.432ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612024-12-21T01:36:45.432ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622024-12-21T01:36:45.432ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crucible" } file = sled-storage/src/manager.rs:1431
4632024-12-21T01:36:45.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642024-12-21T01:36:45.483ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4652024-12-21T01:36:45.483ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4662024-12-21T01:36:45.535ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672024-12-21T01:36:45.535ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682024-12-21T01:36:45.535ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone/oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8"), full_name: "oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone/oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8" } file = sled-storage/src/manager.rs:1431
4692024-12-21T01:36:45.596ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702024-12-21T01:36:45.596ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712024-12-21T01:36:45.596ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b" } file = sled-storage/src/manager.rs:1431
4722024-12-21T01:36:45.658ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732024-12-21T01:36:45.658ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742024-12-21T01:36:45.658ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone/oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc"), full_name: "oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone/oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc" } file = sled-storage/src/manager.rs:1431
4752024-12-21T01:36:45.721ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762024-12-21T01:36:45.721ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772024-12-21T01:36:45.721ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd" } file = sled-storage/src/manager.rs:1431
4782024-12-21T01:36:45.783ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792024-12-21T01:36:45.783ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802024-12-21T01:36:45.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone/oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone/oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec" } file = sled-storage/src/manager.rs:1431
4812024-12-21T01:36:45.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822024-12-21T01:36:45.845ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832024-12-21T01:36:45.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4842024-12-21T01:36:45.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852024-12-21T01:36:45.894ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4862024-12-21T01:36:45.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone" } file = sled-storage/src/manager.rs:1431
4872024-12-21T01:36:45.924ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882024-12-21T01:36:45.924ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4892024-12-21T01:36:45.924ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone" } file = sled-storage/src/manager.rs:1431
4902024-12-21T01:36:45.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912024-12-21T01:36:45.955ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4922024-12-21T01:36:45.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5960098-1ada-427e-bb79-ca59165428b6/crypt/debug"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/debug" } file = sled-storage/src/manager.rs:1431
4932024-12-21T01:36:45.984ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942024-12-21T01:36:45.984ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952024-12-21T01:36:45.984ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone/oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone/oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d" } file = sled-storage/src/manager.rs:1431
4962024-12-21T01:36:46.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972024-12-21T01:36:46.046ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982024-12-21T01:36:46.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b" } file = sled-storage/src/manager.rs:1431
4992024-12-21T01:36:46.107ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002024-12-21T01:36:46.108ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012024-12-21T01:36:46.108ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crucible" } file = sled-storage/src/manager.rs:1431
5022024-12-21T01:36:46.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032024-12-21T01:36:46.155ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5042024-12-21T01:36:46.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/debug"), full_name: "oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/debug" } file = sled-storage/src/manager.rs:1431
5052024-12-21T01:36:46.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062024-12-21T01:36:46.185ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072024-12-21T01:36:46.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone/oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone/oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12" } file = sled-storage/src/manager.rs:1431
5082024-12-21T01:36:46.247ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092024-12-21T01:36:46.247ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5102024-12-21T01:36:46.247ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/debug"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/debug" } file = sled-storage/src/manager.rs:1431
5112024-12-21T01:36:46.277ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122024-12-21T01:36:46.277ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132024-12-21T01:36:46.277ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone/oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone/oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5" } file = sled-storage/src/manager.rs:1431
5142024-12-21T01:36:46.337ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152024-12-21T01:36:46.337ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162024-12-21T01:36:46.337ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crucible" } file = sled-storage/src/manager.rs:1431
5172024-12-21T01:36:46.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182024-12-21T01:36:46.387ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5192024-12-21T01:36:46.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e97d276e-ea54-4591-8041-1234166ccdea/crypt/debug"), full_name: "oxp_e97d276e-ea54-4591-8041-1234166ccdea/crypt/debug" } file = sled-storage/src/manager.rs:1431
5202024-12-21T01:36:46.395ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
5212024-12-21T01:36:46.417ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222024-12-21T01:36:46.417ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232024-12-21T01:36:46.417ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/335ed515-415f-4302-9f2a-54aed0987aee/crypt/debug"), full_name: "oxp_335ed515-415f-4302-9f2a-54aed0987aee/crypt/debug" } file = sled-storage/src/manager.rs:1431
5242024-12-21T01:36:46.447ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252024-12-21T01:36:46.448ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5262024-12-21T01:36:46.448ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone"), full_name: "oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone" } file = sled-storage/src/manager.rs:1431
5272024-12-21T01:36:46.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282024-12-21T01:36:46.476ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5292024-12-21T01:36:46.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone" } file = sled-storage/src/manager.rs:1431
5302024-12-21T01:36:46.506ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312024-12-21T01:36:46.506ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322024-12-21T01:36:46.506ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5332024-12-21T01:36:46.557ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342024-12-21T01:36:46.557ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5352024-12-21T01:36:46.557ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/debug"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5362024-12-21T01:36:46.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5372024-12-21T01:36:46.586ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5382024-12-21T01:36:46.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/debug"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/debug" } file = sled-storage/src/manager.rs:1431
5392024-12-21T01:36:46.616ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402024-12-21T01:36:46.616ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5412024-12-21T01:36:46.616ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crucible" } file = sled-storage/src/manager.rs:1431
5422024-12-21T01:36:46.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432024-12-21T01:36:46.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442024-12-21T01:36:46.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crucible" } file = sled-storage/src/manager.rs:1431
5452024-12-21T01:36:46.713ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462024-12-21T01:36:46.713ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5472024-12-21T01:36:46.713ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone/oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone/oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed" } file = sled-storage/src/manager.rs:1431
5482024-12-21T01:36:46.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492024-12-21T01:36:46.772ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5502024-12-21T01:36:46.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e97d276e-ea54-4591-8041-1234166ccdea/crypt/zone"), full_name: "oxp_e97d276e-ea54-4591-8041-1234166ccdea/crypt/zone" } file = sled-storage/src/manager.rs:1431
5512024-12-21T01:36:46.801ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522024-12-21T01:36:46.801ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532024-12-21T01:36:46.801ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75" } file = sled-storage/src/manager.rs:1431
5542024-12-21T01:36:46.862ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552024-12-21T01:36:46.862ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562024-12-21T01:36:46.862ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone/oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103"), full_name: "oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone/oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103" } file = sled-storage/src/manager.rs:1431
5572024-12-21T01:36:46.927ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582024-12-21T01:36:46.927ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592024-12-21T01:36:46.928ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f" } file = sled-storage/src/manager.rs:1431
5602024-12-21T01:36:46.987ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612024-12-21T01:36:46.987ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622024-12-21T01:36:46.987ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone/oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone/oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc" } file = sled-storage/src/manager.rs:1431
5632024-12-21T01:36:47.045ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642024-12-21T01:36:47.045ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5652024-12-21T01:36:47.045ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone"), full_name: "oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/zone" } file = sled-storage/src/manager.rs:1431
5662024-12-21T01:36:47.074ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672024-12-21T01:36:47.074ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682024-12-21T01:36:47.074ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5692024-12-21T01:36:47.123ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702024-12-21T01:36:47.123ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712024-12-21T01:36:47.123ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4" } file = sled-storage/src/manager.rs:1431
5722024-12-21T01:36:47.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732024-12-21T01:36:47.182ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742024-12-21T01:36:47.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone/oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6"), full_name: "oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone/oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6" } file = sled-storage/src/manager.rs:1431
5752024-12-21T01:36:47.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762024-12-21T01:36:47.241ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772024-12-21T01:36:47.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5782024-12-21T01:36:47.290ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-21T01:36:47.290ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802024-12-21T01:36:47.290ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5812024-12-21T01:36:47.338ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822024-12-21T01:36:47.338ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832024-12-21T01:36:47.338ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f" } file = sled-storage/src/manager.rs:1431
5842024-12-21T01:36:47.396ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852024-12-21T01:36:47.396ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5862024-12-21T01:36:47.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone" } file = sled-storage/src/manager.rs:1431
5872024-12-21T01:36:47.399ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
5882024-12-21T01:36:47.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892024-12-21T01:36:47.425ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902024-12-21T01:36:47.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone" } file = sled-storage/src/manager.rs:1431
5912024-12-21T01:36:47.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922024-12-21T01:36:47.453ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932024-12-21T01:36:47.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone/oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587"), full_name: "oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/zone/oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587" } file = sled-storage/src/manager.rs:1431
5942024-12-21T01:36:47.513ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952024-12-21T01:36:47.513ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5962024-12-21T01:36:47.513ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/335ed515-415f-4302-9f2a-54aed0987aee/crypt/zone"), full_name: "oxp_335ed515-415f-4302-9f2a-54aed0987aee/crypt/zone" } file = sled-storage/src/manager.rs:1431
5972024-12-21T01:36:47.541ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982024-12-21T01:36:47.541ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5992024-12-21T01:36:47.541ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/debug"), full_name: "oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/debug" } file = sled-storage/src/manager.rs:1431
6002024-12-21T01:36:47.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012024-12-21T01:36:47.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022024-12-21T01:36:47.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone/oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5"), full_name: "oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/zone/oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5" } file = sled-storage/src/manager.rs:1431
6032024-12-21T01:36:47.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042024-12-21T01:36:47.632ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6052024-12-21T01:36:47.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone/oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/zone/oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70" } file = sled-storage/src/manager.rs:1431
6062024-12-21T01:36:47.691ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072024-12-21T01:36:47.691ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6082024-12-21T01:36:47.691ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/debug"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/debug" } file = sled-storage/src/manager.rs:1431
6092024-12-21T01:36:47.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102024-12-21T01:36:47.719ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112024-12-21T01:36:47.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6122024-12-21T01:36:47.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132024-12-21T01:36:47.767ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142024-12-21T01:36:47.767ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crucible" } file = sled-storage/src/manager.rs:1431
6152024-12-21T01:36:47.816ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162024-12-21T01:36:47.816ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172024-12-21T01:36:47.816ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5960098-1ada-427e-bb79-ca59165428b6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6182024-12-21T01:36:47.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192024-12-21T01:36:47.865ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202024-12-21T01:36:47.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e97d276e-ea54-4591-8041-1234166ccdea/crucible" } file = sled-storage/src/manager.rs:1431
6212024-12-21T01:36:47.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222024-12-21T01:36:47.912ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232024-12-21T01:36:47.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e97d276e-ea54-4591-8041-1234166ccdea/crypt/zone/oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763"), full_name: "oxp_e97d276e-ea54-4591-8041-1234166ccdea/crypt/zone/oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763" } file = sled-storage/src/manager.rs:1431
6242024-12-21T01:36:47.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252024-12-21T01:36:47.972ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262024-12-21T01:36:47.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca" } file = sled-storage/src/manager.rs:1431
6272024-12-21T01:36:48.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282024-12-21T01:36:48.033ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292024-12-21T01:36:48.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830" } file = sled-storage/src/manager.rs:1431
6302024-12-21T01:36:48.091ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312024-12-21T01:36:48.091ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322024-12-21T01:36:48.091ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6332024-12-21T01:36:48.140ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342024-12-21T01:36:48.140ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352024-12-21T01:36:48.140ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_335ed515-415f-4302-9f2a-54aed0987aee/crucible" } file = sled-storage/src/manager.rs:1431
6362024-12-21T01:36:48.188ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372024-12-21T01:36:48.188ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382024-12-21T01:36:48.188ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone/oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca"), full_name: "oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/zone/oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca" } file = sled-storage/src/manager.rs:1431
6392024-12-21T01:36:48.248ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402024-12-21T01:36:48.248ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412024-12-21T01:36:48.248ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/zone/oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6" } file = sled-storage/src/manager.rs:1431
6422024-12-21T01:36:48.307ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432024-12-21T01:36:48.307ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442024-12-21T01:36:48.307ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611"), full_name: "oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/zone/oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611" } file = sled-storage/src/manager.rs:1431
6452024-12-21T01:36:48.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462024-12-21T01:36:48.365ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472024-12-21T01:36:48.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6482024-12-21T01:36:48.402ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
6492024-12-21T01:36:48.413ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502024-12-21T01:36:48.413ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512024-12-21T01:36:48.413ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/335ed515-415f-4302-9f2a-54aed0987aee/crypt/zone/oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612"), full_name: "oxp_335ed515-415f-4302-9f2a-54aed0987aee/crypt/zone/oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612" } file = sled-storage/src/manager.rs:1431
6522024-12-21T01:36:48.473ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532024-12-21T01:36:48.473ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542024-12-21T01:36:48.473ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
6552024-12-21T01:36:48.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3225154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64810 req_id = 765a5733-21c3-41a9-af3f-3ea385fcb986 response_code = 200 uri = /datasets
6562024-12-21T01:36:48.505ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 128d3821-d472-4176-aa9e-0882678240d4 (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d23ac49b-0ed8-412c-acf3-9813f5d7b4ca (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6572024-12-21T01:36:48.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33483
6582024-12-21T01:36:48.506ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592024-12-21T01:36:48.506ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602024-12-21T01:36:48.514ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612024-12-21T01:36:48.514ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-21T01:36:48.523ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632024-12-21T01:36:48.523ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642024-12-21T01:36:48.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652024-12-21T01:36:48.531ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-12-21T01:36:48.531ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-12-21T01:36:48.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-21T01:36:48.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T01:36:48.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-21T01:36:48.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-21T01:36:48.629ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4 file = illumos-utils/src/zone.rs:325
6722024-12-21T01:36:48.633ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd file = illumos-utils/src/zone.rs:325
6732024-12-21T01:36:48.637ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca file = illumos-utils/src/zone.rs:325
6742024-12-21T01:36:48.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4 file = illumos-utils/src/zone.rs:363
6752024-12-21T01:36:48.654ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd file = illumos-utils/src/zone.rs:363
6762024-12-21T01:36:48.659ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca file = illumos-utils/src/zone.rs:363
6772024-12-21T01:36:49.404ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/402798b1-2357-48f5-992b-b9e53d91bbe0) file = sled-agent/src/probe_manager.rs:231 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
6782024-12-21T01:36:50.236ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792024-12-21T01:36:50.236ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6802024-12-21T01:36:50.236ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
6812024-12-21T01:36:50.720ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-12-21T01:36:51.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14088857524902884004 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
6832024-12-21T01:36:51.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17426268471716214220 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
6842024-12-21T01:36:51.201ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6852024-12-21T01:36:51.201ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862024-12-21T01:36:51.201ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6872024-12-21T01:36:51.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 59.895138ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
6882024-12-21T01:36:51.210ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
6892024-12-21T01:36:51.214ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
6902024-12-21T01:36:51.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 113.321805ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
6912024-12-21T01:36:51.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 36.132803ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
6922024-12-21T01:36:51.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 46.366437ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
6932024-12-21T01:36:51.382ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6942024-12-21T01:36:51.383ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6952024-12-21T01:36:51.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 136.718322ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
6962024-12-21T01:36:51.389ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6972024-12-21T01:36:51.389ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6982024-12-21T01:36:51.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 218.42507ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
6992024-12-21T01:36:51.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 62.758806ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7002024-12-21T01:36:51.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 243.569536ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7012024-12-21T01:36:51.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 453.050982ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7022024-12-21T01:36:51.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 295.485708ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7032024-12-21T01:36:51.888ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
7042024-12-21T01:36:51.889ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
7052024-12-21T01:36:51.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 380.107951ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7062024-12-21T01:36:51.940ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
7072024-12-21T01:36:51.940ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
7082024-12-21T01:36:51.995ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
7092024-12-21T01:36:51.995ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
7102024-12-21T01:36:52.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 245.09404ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7112024-12-21T01:36:52.026ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
7122024-12-21T01:36:52.026ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
7132024-12-21T01:36:52.105ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
7142024-12-21T01:36:52.105ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
7152024-12-21T01:36:52.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 1.018522254s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7162024-12-21T01:36:52.198ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
7172024-12-21T01:36:52.198ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7182024-12-21T01:36:52.231ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7192024-12-21T01:36:52.267ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202024-12-21T01:36:52.267ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212024-12-21T01:36:52.267ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7222024-12-21T01:36:52.267ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232024-12-21T01:36:52.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 1.094023454s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7242024-12-21T01:36:52.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 1.175162251s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7252024-12-21T01:36:52.310ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7262024-12-21T01:36:52.360ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7272024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7292024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7312024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7332024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7352024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7372024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7392024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7412024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7432024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7452024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7472024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-21T01:36:52.360ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7492024-12-21T01:36:52.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4094104007061318683 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
7502024-12-21T01:36:52.487ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17437686288073003279 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
7512024-12-21T01:36:53.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 760.280599ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7522024-12-21T01:36:53.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 1.272028277s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7532024-12-21T01:36:53.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 816.97084ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7542024-12-21T01:36:53.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 1.476728514s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7552024-12-21T01:36:54.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 601.975574ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7562024-12-21T01:36:54.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 658.040892ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7572024-12-21T01:36:54.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 1.39969093s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7582024-12-21T01:36:55.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 1.494766126s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7592024-12-21T01:36:55.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 808.278882ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7602024-12-21T01:36:56.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 515.313069ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7612024-12-21T01:36:56.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 1.269026415s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7622024-12-21T01:36:56.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4") failed: Property not found. retry in 1.12808252s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7632024-12-21T01:36:56.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd") failed: Property not found. retry in 1.263774429s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7642024-12-21T01:36:57.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca") failed: Property not found. retry in 1.25446066s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7652024-12-21T01:36:58.863ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_128d3821-d472-4176-aa9e-0882678240d4
7662024-12-21T01:36:58.863ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd
7672024-12-21T01:36:58.863ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_d23ac49b-0ed8-412c-acf3-9813f5d7b4ca
7682024-12-21T01:36:58.863ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7692024-12-21T01:36:58.863ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7702024-12-21T01:36:58.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10358114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33483 req_id = 2554728c-3bb8-4ef8-8824-703d081804e1 response_code = 204 uri = /omicron-zones
7712024-12-21T01:36:58.866ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722024-12-21T01:36:59.395ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 125.559841ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7732024-12-21T01:36:59.579ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742024-12-21T01:36:59.655ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752024-12-21T01:36:59.732ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7762024-12-21T01:36:59.732ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7772024-12-21T01:36:59.764ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7782024-12-21T01:36:59.765ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7792024-12-21T01:36:59.765ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7802024-12-21T01:36:59.793ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 128d3821-d472-4176-aa9e-0882678240d4 (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d23ac49b-0ed8-412c-acf3-9813f5d7b4ca (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 646c3275-4b02-475b-97fb-c591b67ecd12 (service), filesystem_pool: Some(ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d56b97af-3cee-44ba-a3ed-54c8efa4456b, kind: Service { id: 646c3275-4b02-475b-97fb-c591b67ecd12 }, name: Name("ntp-646c3275-4b02-475b-97fb-c591b67ecd12"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7812024-12-21T01:36:59.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51545
7822024-12-21T01:36:59.794ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-21T01:36:59.794ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-21T01:36:59.805ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-21T01:36:59.807ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-21T01:36:59.815ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872024-12-21T01:36:59.815ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882024-12-21T01:36:59.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7892024-12-21T01:36:59.825ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
7902024-12-21T01:36:59.825ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
7912024-12-21T01:36:59.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922024-12-21T01:36:59.836ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7932024-12-21T01:36:59.868ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7942024-12-21T01:36:59.869ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7952024-12-21T01:36:59.869ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7962024-12-21T01:36:59.899ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 159, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7972024-12-21T01:36:59.899ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7982024-12-21T01:36:59.899ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7992024-12-21T01:36:59.899ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8002024-12-21T01:36:59.900ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8012024-12-21T01:36:59.901ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8022024-12-21T01:36:59.924ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12 file = illumos-utils/src/zone.rs:325
8032024-12-21T01:36:59.943ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12 file = illumos-utils/src/zone.rs:363
8042024-12-21T01:37:00.564ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8052024-12-21T01:37:00.564ZINFOSledAgent (ServiceManager): Booting oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8062024-12-21T01:37:00.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 46.438203ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8072024-12-21T01:37:00.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 73.680366ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8082024-12-21T01:37:00.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 187.154036ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8092024-12-21T01:37:01.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 315.765383ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8102024-12-21T01:37:01.055ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14088857524902884004 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8112024-12-21T01:37:01.055ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17426268471716214220 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8122024-12-21T01:37:01.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 444.473578ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8132024-12-21T01:37:01.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 582.335044ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8142024-12-21T01:37:02.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 1.335955292s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8152024-12-21T01:37:02.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4094104007061318683 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8162024-12-21T01:37:02.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17437686288073003279 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8172024-12-21T01:37:03.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 1.207468002s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8182024-12-21T01:37:04.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12") failed: Property not found. retry in 1.3714635s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8192024-12-21T01:37:06.367ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12
8202024-12-21T01:37:06.367ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212024-12-21T01:37:06.368ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8222024-12-21T01:37:06.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6574608 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51545 req_id = c64cdc3c-6c66-40d0-a3ca-2e097eb3392e response_code = 204 uri = /omicron-zones
8232024-12-21T01:37:06.370ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8242024-12-21T01:37:06.400ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8252024-12-21T01:37:06.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64979
8262024-12-21T01:37:06.411ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8272024-12-21T01:37:06.411ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 10115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64979 req_id = be21f3f9-4df0-470d-b7d6-e9d6451dec8d response_code = 500 uri = /timesync
8282024-12-21T01:37:06.414ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8292024-12-21T01:37:06.539ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8302024-12-21T01:37:06.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45512
8312024-12-21T01:37:07.919ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012244141214871814 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8322024-12-21T01:37:08.113ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12219222284397852048 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8332024-12-21T01:37:08.866ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3800093317888029865 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8342024-12-21T01:37:10.548ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8352024-12-21T01:37:10.548ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45512 req_id = aadf566f-18ec-4bdf-a385-3237b495d428 response_code = 500 uri = /timesync
8362024-12-21T01:37:10.551ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372024-12-21T01:37:10.741ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382024-12-21T01:37:10.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41152
8392024-12-21T01:37:10.750ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8402024-12-21T01:37:10.750ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8955 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41152 req_id = 95b4483a-366b-46ba-bff7-de268a7a8b34 response_code = 500 uri = /timesync
8412024-12-21T01:37:10.753ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422024-12-21T01:37:10.954ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432024-12-21T01:37:10.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43045
8442024-12-21T01:37:10.963ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_646c3275-4b02-475b-97fb-c591b67ecd12': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8452024-12-21T01:37:10.963ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9097 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43045 req_id = 0a46806d-8b12-4020-8f99-cf40e780cdbf response_code = 500 uri = /timesync
8462024-12-21T01:37:10.967ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8472024-12-21T01:37:11.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14088857524902884004 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8482024-12-21T01:37:11.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17426268471716214220 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8492024-12-21T01:37:11.123ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8502024-12-21T01:37:11.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39765
8512024-12-21T01:37:12.493ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4094104007061318683 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8522024-12-21T01:37:12.493ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17437686288073003279 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8532024-12-21T01:37:13.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39765 req_id = 5d6f700b-cdb3-4c7c-b299-eb799d59a871 response_code = 200 uri = /timesync
8542024-12-21T01:37:13.136ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8552024-12-21T01:37:13.136ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562024-12-21T01:37:13.290ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572024-12-21T01:37:13.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38908
8582024-12-21T01:37:13.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8925 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38908 req_id = 5d6717ff-3e2a-4152-83ac-3ce829524b58 response_code = 200 uri = /timesync
8592024-12-21T01:37:13.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8602024-12-21T01:37:13.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612024-12-21T01:37:13.626ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622024-12-21T01:37:13.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53928
8632024-12-21T01:37:13.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53928 req_id = 7dc038a3-8aec-4b2c-912e-3147f9b0149e response_code = 200 uri = /timesync
8642024-12-21T01:37:13.637ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8652024-12-21T01:37:13.637ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662024-12-21T01:37:13.931ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672024-12-21T01:37:13.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41705
8682024-12-21T01:37:13.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41705 req_id = c1b10340-0d3c-40c9-826b-e9c8ff8681d5 response_code = 200 uri = /timesync
8692024-12-21T01:37:13.941ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.071786284 } file = sled-agent/src/rack_setup/service.rs:743
8702024-12-21T01:37:13.941ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8712024-12-21T01:37:14.183ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8722024-12-21T01:37:14.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59862
8732024-12-21T01:37:14.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59862 req_id = d8012a94-a54c-4c67-99a1-cae249cfbff7 response_code = 200 uri = /timesync
8742024-12-21T01:37:14.196ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.071103461 } file = sled-agent/src/rack_setup/service.rs:743
8752024-12-21T01:37:14.196ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8762024-12-21T01:37:14.853ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772024-12-21T01:37:14.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53051
8782024-12-21T01:37:14.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53051 req_id = 80e1448b-be00-4f20-8755-22bcc9a7fea8 response_code = 200 uri = /timesync
8792024-12-21T01:37:14.863ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.06964007 } file = sled-agent/src/rack_setup/service.rs:743
8802024-12-21T01:37:14.863ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812024-12-21T01:37:15.310ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8822024-12-21T01:37:15.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39248
8832024-12-21T01:37:15.319ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 273.881087ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8842024-12-21T01:37:15.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10097 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39248 req_id = ff2b0320-8b1d-43d8-91d2-39683fde1b52 response_code = 200 uri = /timesync
8852024-12-21T01:37:15.323ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.068400055 } file = sled-agent/src/rack_setup/service.rs:743
8862024-12-21T01:37:15.323ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872024-12-21T01:37:15.806ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882024-12-21T01:37:15.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46942
8892024-12-21T01:37:15.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8810 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46942 req_id = cb1d0546-fc1a-4535-8a20-d0de371f9303 response_code = 200 uri = /timesync
8902024-12-21T01:37:15.816ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745034.7589326, correction: 0.067191876 } file = sled-agent/src/rack_setup/service.rs:743
8912024-12-21T01:37:15.816ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922024-12-21T01:37:16.373ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932024-12-21T01:37:16.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56448
8942024-12-21T01:37:16.378ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12646648280581131990 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8952024-12-21T01:37:16.378ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 45068286631577106 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
8962024-12-21T01:37:16.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56448 req_id = e336b7af-0ecc-4cfc-851b-529f0a413709 response_code = 200 uri = /timesync
8972024-12-21T01:37:16.383ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745034.7589326, correction: 0.065660872 } file = sled-agent/src/rack_setup/service.rs:743
8982024-12-21T01:37:16.383ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8992024-12-21T01:37:17.175ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9002024-12-21T01:37:17.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33755
9012024-12-21T01:37:17.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33755 req_id = a16eafbf-cfcb-4d21-8971-febd19b7ec45 response_code = 200 uri = /timesync
9022024-12-21T01:37:17.187ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745035.4738836, correction: 0.06334465 } file = sled-agent/src/rack_setup/service.rs:743
9032024-12-21T01:37:17.187ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9042024-12-21T01:37:17.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14012244141214871814 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9052024-12-21T01:37:18.078ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9062024-12-21T01:37:18.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40351
9072024-12-21T01:37:18.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40351 req_id = b1729f09-1364-41eb-b81b-3844479c817f response_code = 200 uri = /timesync
9082024-12-21T01:37:18.089ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745037.0759437, correction: 0.06081143 } file = sled-agent/src/rack_setup/service.rs:743
9092024-12-21T01:37:18.089ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9102024-12-21T01:37:18.126ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12219222284397852048 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9112024-12-21T01:37:18.881ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3800093317888029865 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9122024-12-21T01:37:19.817ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9132024-12-21T01:37:19.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60378
9142024-12-21T01:37:19.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60378 req_id = 48099c2d-e6e3-4e65-b9e1-3ebc9c2ef327 response_code = 200 uri = /timesync
9152024-12-21T01:37:19.829ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745038.8225138, correction: 0.055702925 } file = sled-agent/src/rack_setup/service.rs:743
9162024-12-21T01:37:19.829ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172024-12-21T01:37:21.080ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14088857524902884004 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9182024-12-21T01:37:21.080ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17426268471716214220 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9192024-12-21T01:37:21.128ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9202024-12-21T01:37:21.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57095
9212024-12-21T01:37:21.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8878 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57095 req_id = bcb61e5d-d559-46ed-9403-661066575e15 response_code = 200 uri = /timesync
9222024-12-21T01:37:21.140ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745039.7923725, correction: 0.05210343 } file = sled-agent/src/rack_setup/service.rs:743
9232024-12-21T01:37:21.140ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9242024-12-21T01:37:21.788ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49592
9252024-12-21T01:37:21.788ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49592 req_id = 68bb5748-ca64-4483-b9ef-863ae48597a3 response_code = 200 uri = /baseboard
9262024-12-21T01:37:22.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4094104007061318683 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9272024-12-21T01:37:22.520ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17437686288073003279 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
9282024-12-21T01:37:23.435ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9292024-12-21T01:37:23.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64912
9302024-12-21T01:37:23.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21523 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64912 req_id = 73872048-6136-4261-ac95-eed83d5d295b response_code = 200 uri = /timesync
9312024-12-21T01:37:23.461ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1734745043.3548765, correction: 0.045818135 } file = sled-agent/src/rack_setup/service.rs:743
9322024-12-21T01:37:23.461ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9332024-12-21T01:37:23.491ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 128d3821-d472-4176-aa9e-0882678240d4 (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d23ac49b-0ed8-412c-acf3-9813f5d7b4ca (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 646c3275-4b02-475b-97fb-c591b67ecd12 (service), filesystem_pool: Some(ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d56b97af-3cee-44ba-a3ed-54c8efa4456b, kind: Service { id: 646c3275-4b02-475b-97fb-c591b67ecd12 }, name: Name("ntp-646c3275-4b02-475b-97fb-c591b67ecd12"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b3eaea23-6186-413b-85f8-4695a2d666f6 (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } } } }, OmicronZoneConfig { id: ede897ee-bb8d-4699-8106-43b098136611 (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } } } }, OmicronZoneConfig { id: fbebab72-2d7c-4860-ac0a-3f84d25966ec (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: c43af16c-e785-4212-9523-ec4f05d1ba70 (service), filesystem_pool: Some(ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External } } } }, OmicronZoneConfig { id: ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5 (service), filesystem_pool: Some(ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9342024-12-21T01:37:23.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48621
9352024-12-21T01:37:23.492ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9362024-12-21T01:37:23.492ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9372024-12-21T01:37:23.503ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9382024-12-21T01:37:23.503ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9392024-12-21T01:37:23.513ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9402024-12-21T01:37:23.513ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9412024-12-21T01:37:23.523ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9422024-12-21T01:37:23.523ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9432024-12-21T01:37:23.533ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9442024-12-21T01:37:23.533ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9452024-12-21T01:37:23.543ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9462024-12-21T01:37:23.543ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9472024-12-21T01:37:23.552ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9482024-12-21T01:37:23.553ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9492024-12-21T01:37:23.562ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9502024-12-21T01:37:23.562ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9512024-12-21T01:37:23.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9522024-12-21T01:37:23.571ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
9532024-12-21T01:37:23.571ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
9542024-12-21T01:37:23.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9552024-12-21T01:37:23.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9562024-12-21T01:37:23.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9572024-12-21T01:37:23.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9582024-12-21T01:37:23.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9592024-12-21T01:37:23.654ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9602024-12-21T01:37:23.746ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70 file = illumos-utils/src/zone.rs:325
9612024-12-21T01:37:23.750ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 file = illumos-utils/src/zone.rs:325
9622024-12-21T01:37:23.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5 file = illumos-utils/src/zone.rs:325
9632024-12-21T01:37:23.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec file = illumos-utils/src/zone.rs:325
9642024-12-21T01:37:23.764ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611 file = illumos-utils/src/zone.rs:325
9652024-12-21T01:37:23.768ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70 file = illumos-utils/src/zone.rs:363
9662024-12-21T01:37:23.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 file = illumos-utils/src/zone.rs:363
9672024-12-21T01:37:23.777ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5 file = illumos-utils/src/zone.rs:363
9682024-12-21T01:37:23.782ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec file = illumos-utils/src/zone.rs:363
9692024-12-21T01:37:23.787ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611 file = illumos-utils/src/zone.rs:363
9702024-12-21T01:37:27.186ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='fbebab72-2d7c-4860-ac0a-3f84d25966ec'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9712024-12-21T01:37:27.187ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
9722024-12-21T01:37:27.192ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c43af16c-e785-4212-9523-ec4f05d1ba70'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9732024-12-21T01:37:27.193ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b3eaea23-6186-413b-85f8-4695a2d666f6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9742024-12-21T01:37:27.193ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
9752024-12-21T01:37:27.197ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
9762024-12-21T01:37:27.202ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ede897ee-bb8d-4699-8106-43b098136611'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9772024-12-21T01:37:27.202ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
9782024-12-21T01:37:27.207ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9792024-12-21T01:37:27.207ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
9802024-12-21T01:37:27.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 73.43229ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
9812024-12-21T01:37:27.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 27.885543ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
9822024-12-21T01:37:27.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 42.844349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
9832024-12-21T01:37:27.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 46.176495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
9842024-12-21T01:37:27.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 42.554155ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
9852024-12-21T01:37:27.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 137.642243ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
9862024-12-21T01:37:27.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 122.585636ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
9872024-12-21T01:37:27.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 140.529985ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
9882024-12-21T01:37:27.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 115.976276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
9892024-12-21T01:37:27.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 101.595528ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
9902024-12-21T01:37:28.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 184.37518ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
9912024-12-21T01:37:28.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 195.208495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
9922024-12-21T01:37:28.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 176.237486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
9932024-12-21T01:37:28.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 116.8828ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
9942024-12-21T01:37:28.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 177.434639ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
9952024-12-21T01:37:28.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 419.755074ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
9962024-12-21T01:37:28.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 307.017993ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
9972024-12-21T01:37:28.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 419.577463ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
9982024-12-21T01:37:28.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 329.171683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
9992024-12-21T01:37:28.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 552.788531ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10002024-12-21T01:37:28.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 1.060707416s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10012024-12-21T01:37:28.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 754.255104ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10022024-12-21T01:37:28.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 1.147231701s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10032024-12-21T01:37:28.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 1.125266367s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10042024-12-21T01:37:29.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 707.812759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10052024-12-21T01:37:29.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 660.010166ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10062024-12-21T01:37:29.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 556.007971ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10072024-12-21T01:37:29.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 688.42901ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10082024-12-21T01:37:29.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 759.767291ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10092024-12-21T01:37:29.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 1.160315744s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10102024-12-21T01:37:30.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 1.310509487s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10112024-12-21T01:37:30.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 758.760627ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10122024-12-21T01:37:30.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 792.338935ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10132024-12-21T01:37:30.671ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 749.620942ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
10142024-12-21T01:37:30.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 714.183495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10152024-12-21T01:37:31.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 797.788785ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10162024-12-21T01:37:31.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 601.917339ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10172024-12-21T01:37:31.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 845.134112ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10182024-12-21T01:37:31.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 639.098577ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10192024-12-21T01:37:31.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 695.219628ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10202024-12-21T01:37:31.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 671.46964ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10212024-12-21T01:37:31.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 934.862528ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10222024-12-21T01:37:32.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 1.154110036s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10232024-12-21T01:37:32.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 1.045030163s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10242024-12-21T01:37:32.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 1.263095015s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10252024-12-21T01:37:32.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 647.843998ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10262024-12-21T01:37:32.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 1.324078449s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10272024-12-21T01:37:33.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 899.232801ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10282024-12-21T01:37:33.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 563.299065ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10292024-12-21T01:37:33.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 1.472717747s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10302024-12-21T01:37:33.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 923.806359ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10312024-12-21T01:37:33.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 1.456351756s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10322024-12-21T01:37:34.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 1.467433826s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10332024-12-21T01:37:34.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 1.448103134s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10342024-12-21T01:37:34.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 1.405476438s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10352024-12-21T01:37:34.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 1.243863196s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10362024-12-21T01:37:35.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 518.961908ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10372024-12-21T01:37:35.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5") failed: Property not found. retry in 1.072424499s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10382024-12-21T01:37:35.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6") failed: Property not found. retry in 1.379812259s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10392024-12-21T01:37:35.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70") failed: Property not found. retry in 699.011276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10402024-12-21T01:37:35.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec") failed: Property not found. retry in 1.161384825s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10412024-12-21T01:37:36.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611") failed: Property not found. retry in 884.528536ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10422024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_c43af16c-e785-4212-9523-ec4f05d1ba70
10432024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6
10442024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5
10452024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_fbebab72-2d7c-4860-ac0a-3f84d25966ec
10462024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_ede897ee-bb8d-4699-8106-43b098136611
10472024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10482024-12-21T01:37:37.005ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10492024-12-21T01:37:37.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13477733 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48621 req_id = 0b3ac79a-9a63-4d81-89e5-cc3bffb6f1c8 response_code = 204 uri = /omicron-zones
10502024-12-21T01:37:37.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56336
10512024-12-21T01:37:37.070ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 1f6d1590-bc9f-4943-9efb-b43a1ef1f167 response_code = 500 uri = /cockroachdb
10522024-12-21T01:37:37.071ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1f6d1590-bc9f-4943-9efb-b43a1ef1f167", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1f6d1590-bc9f-4943-9efb-b43a1ef1f167" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 129.878ms
10532024-12-21T01:37:37.232ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 56e76d7e-4474-4a05-a934-037865088070 response_code = 500 uri = /cockroachdb
10542024-12-21T01:37:37.232ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "56e76d7e-4474-4a05-a934-037865088070", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "56e76d7e-4474-4a05-a934-037865088070" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 166.649887ms
10552024-12-21T01:37:37.428ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27585 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 9d9a0c23-9875-4cb3-83a6-0fc2e9acf14d response_code = 500 uri = /cockroachdb
10562024-12-21T01:37:37.428ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9d9a0c23-9875-4cb3-83a6-0fc2e9acf14d", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9d9a0c23-9875-4cb3-83a6-0fc2e9acf14d" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 92.179491ms
10572024-12-21T01:37:37.550ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = f55fc590-7710-4ee1-8097-df5cc8ebd9f3 response_code = 500 uri = /cockroachdb
10582024-12-21T01:37:37.550ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f55fc590-7710-4ee1-8097-df5cc8ebd9f3", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f55fc590-7710-4ee1-8097-df5cc8ebd9f3" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 135.950953ms
10592024-12-21T01:37:37.716ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 7a98da47-5dab-477a-b287-f6673c8c9461 response_code = 500 uri = /cockroachdb
10602024-12-21T01:37:37.716ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7a98da47-5dab-477a-b287-f6673c8c9461", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7a98da47-5dab-477a-b287-f6673c8c9461" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 156.379317ms
10612024-12-21T01:37:37.902ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 37b767bd-deee-42f4-bd84-0694e51f39e6 response_code = 500 uri = /cockroachdb
10622024-12-21T01:37:37.903ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "37b767bd-deee-42f4-bd84-0694e51f39e6", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:37 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "37b767bd-deee-42f4-bd84-0694e51f39e6" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 299.221628ms
10632024-12-21T01:37:38.231ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27389 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 552a1bff-9aef-4da3-8f83-6bdcbcf1c981 response_code = 500 uri = /cockroachdb
10642024-12-21T01:37:38.232ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "552a1bff-9aef-4da3-8f83-6bdcbcf1c981", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "552a1bff-9aef-4da3-8f83-6bdcbcf1c981" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 445.569244ms
10652024-12-21T01:37:38.708ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = de30f94d-80bd-4165-8f40-c6c167f52ac8 response_code = 500 uri = /cockroachdb
10662024-12-21T01:37:38.708ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "de30f94d-80bd-4165-8f40-c6c167f52ac8", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "de30f94d-80bd-4165-8f40-c6c167f52ac8" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 383.041039ms
10672024-12-21T01:37:39.120ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25935 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 1f715b6b-c32c-40a0-91ca-b0e31d3ee900 response_code = 500 uri = /cockroachdb
10682024-12-21T01:37:39.120ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1f715b6b-c32c-40a0-91ca-b0e31d3ee900", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:38 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1f715b6b-c32c-40a0-91ca-b0e31d3ee900" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 622.315958ms
10692024-12-21T01:37:39.774ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_b3eaea23-6186-413b-85f8-4695a2d666f6 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 41ced77d-b0c3-4b02-9c3e-d8576c4e3c11 response_code = 500 uri = /cockroachdb
10702024-12-21T01:37:39.774ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "41ced77d-b0c3-4b02-9c3e-d8576c4e3c11", "content-length": "124", "date": "Sat, 21 Dec 2024 01:37:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "41ced77d-b0c3-4b02-9c3e-d8576c4e3c11" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 689.567174ms
10712024-12-21T01:37:40.499ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3758
10722024-12-21T01:37:50.529ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10732024-12-21T01:37:54.646ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10742024-12-21T01:37:54.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14180012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:56336 req_id = 08bf14f0-501c-4cef-be2c-104991d65f07 response_code = 204 uri = /cockroachdb
10752024-12-21T01:37:54.648ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52621
10762024-12-21T01:37:54.649ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52621 req_id = 614588a0-f864-4c6a-b8b6-eab5af6a94d9 response_code = 200 uri = /baseboard
10772024-12-21T01:37:54.656ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 610.367097ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
10782024-12-21T01:37:54.689ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: cded7eb5-a00e-4c84-8bf5-bc1c8248fcdd (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 128d3821-d472-4176-aa9e-0882678240d4 (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d23ac49b-0ed8-412c-acf3-9813f5d7b4ca (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 646c3275-4b02-475b-97fb-c591b67ecd12 (service), filesystem_pool: Some(ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d56b97af-3cee-44ba-a3ed-54c8efa4456b, kind: Service { id: 646c3275-4b02-475b-97fb-c591b67ecd12 }, name: Name("ntp-646c3275-4b02-475b-97fb-c591b67ecd12"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 159, 83])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b3eaea23-6186-413b-85f8-4695a2d666f6 (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } } } }, OmicronZoneConfig { id: ede897ee-bb8d-4699-8106-43b098136611 (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } } } }, OmicronZoneConfig { id: fbebab72-2d7c-4860-ac0a-3f84d25966ec (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: c43af16c-e785-4212-9523-ec4f05d1ba70 (service), filesystem_pool: Some(ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External } } } }, OmicronZoneConfig { id: ece2f384-7f8f-49c7-b6a8-66c5f0a60ac5 (service), filesystem_pool: Some(ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0ebacafa-86bf-4887-9449-555ff2475830 (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 329ee834-a5be-43de-9495-a0167e01a5cc (service), filesystem_pool: Some(ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4c22d3c5-4241-430e-a780-0dd847f2622b (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: eacc809e-e4ad-4278-85b0-582ce7d2f103 (service), filesystem_pool: Some(ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 4b8cc219-c049-4c6e-8565-7499e246880f (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } } } }, OmicronZoneConfig { id: e685f9ba-fc38-4403-9930-a5fc9ac64587 (service), filesystem_pool: Some(ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ea880817-06e5-436d-974a-fbd5a7dd0ecc (service), filesystem_pool: Some(ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 87acc9f1-bd6e-4cb4-99e8-f19109246fbc (service), filesystem_pool: Some(ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 141b4eb6-11f8-423a-87ca-16de7e367f75 (service), filesystem_pool: Some(ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 93385bd5-c59a-4479-b2bc-adcfffae549f (service), filesystem_pool: Some(ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0815e255-1f71-4707-8a37-c6acfe6ab5ed (service), filesystem_pool: Some(ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5 (service), filesystem_pool: Some(ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2cfe4c76-0a3a-4375-984b-593a3834ef4d (service), filesystem_pool: Some(ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4b78370c-2208-42bf-9bea-345adcfd9612 (service), filesystem_pool: Some(ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External } } } }, OmicronZoneConfig { id: 6e4b451b-bda2-46b9-a9ac-ad6f570d28f8 (service), filesystem_pool: Some(ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ff745a8-7f86-4305-bb55-236a8dae14d6 (service), filesystem_pool: Some(ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2b48b14b-7061-4b95-8d98-a7b44a59d763 (service), filesystem_pool: Some(ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10792024-12-21T01:37:54.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40834
10802024-12-21T01:37:54.690ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10812024-12-21T01:37:54.690ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10822024-12-21T01:37:54.705ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10832024-12-21T01:37:54.705ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10842024-12-21T01:37:54.717ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10852024-12-21T01:37:54.717ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10862024-12-21T01:37:54.727ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10872024-12-21T01:37:54.727ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10882024-12-21T01:37:54.739ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10892024-12-21T01:37:54.739ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10902024-12-21T01:37:54.749ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10912024-12-21T01:37:54.749ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10922024-12-21T01:37:54.759ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10932024-12-21T01:37:54.759ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10942024-12-21T01:37:54.770ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10952024-12-21T01:37:54.770ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10962024-12-21T01:37:54.779ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10972024-12-21T01:37:54.779ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10982024-12-21T01:37:54.790ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10992024-12-21T01:37:54.790ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11002024-12-21T01:37:54.802ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11012024-12-21T01:37:54.802ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11022024-12-21T01:37:54.814ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11032024-12-21T01:37:54.814ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11042024-12-21T01:37:54.825ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11052024-12-21T01:37:54.825ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, kind: Crucible }, responder: ... }
11062024-12-21T01:37:54.835ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11072024-12-21T01:37:54.835ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, kind: Crucible }, responder: ... }
11082024-12-21T01:37:54.844ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11092024-12-21T01:37:54.844ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, kind: Crucible }, responder: ... }
11102024-12-21T01:37:54.855ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11112024-12-21T01:37:54.855ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11122024-12-21T01:37:54.867ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11132024-12-21T01:37:54.867ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, kind: Crucible }, responder: ... }
11142024-12-21T01:37:54.878ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11152024-12-21T01:37:54.878ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, kind: Crucible }, responder: ... }
11162024-12-21T01:37:54.890ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11172024-12-21T01:37:54.890ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, kind: Crucible }, responder: ... }
11182024-12-21T01:37:54.903ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11192024-12-21T01:37:54.903ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, kind: Crucible }, responder: ... }
11202024-12-21T01:37:54.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11212024-12-21T01:37:54.915ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
11222024-12-21T01:37:54.915ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
11232024-12-21T01:37:54.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11242024-12-21T01:37:55.119ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11252024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11262024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11272024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11292024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11302024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11322024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11332024-12-21T01:37:55.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342024-12-21T01:37:55.145ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11352024-12-21T01:37:55.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362024-12-21T01:37:55.145ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372024-12-21T01:37:55.159ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382024-12-21T01:37:55.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11392024-12-21T01:37:55.186ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11402024-12-21T01:37:55.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412024-12-21T01:37:55.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11422024-12-21T01:37:55.188ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11432024-12-21T01:37:55.466ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612 file = illumos-utils/src/zone.rs:325
11442024-12-21T01:37:55.471ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6 file = illumos-utils/src/zone.rs:325
11452024-12-21T01:37:55.476ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc file = illumos-utils/src/zone.rs:325
11462024-12-21T01:37:55.482ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763 file = illumos-utils/src/zone.rs:325
11472024-12-21T01:37:55.487ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587 file = illumos-utils/src/zone.rs:325
11482024-12-21T01:37:55.492ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75 file = illumos-utils/src/zone.rs:325
11492024-12-21T01:37:55.498ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d file = illumos-utils/src/zone.rs:325
11502024-12-21T01:37:55.503ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8 file = illumos-utils/src/zone.rs:325
11512024-12-21T01:37:55.509ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f file = illumos-utils/src/zone.rs:325
11522024-12-21T01:37:55.515ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f file = illumos-utils/src/zone.rs:325
11532024-12-21T01:37:55.520ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103 file = illumos-utils/src/zone.rs:325
11542024-12-21T01:37:55.526ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612 file = illumos-utils/src/zone.rs:363
11552024-12-21T01:37:55.532ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6 file = illumos-utils/src/zone.rs:363
11562024-12-21T01:37:55.538ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc file = illumos-utils/src/zone.rs:363
11572024-12-21T01:37:55.544ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763 file = illumos-utils/src/zone.rs:363
11582024-12-21T01:37:55.549ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587 file = illumos-utils/src/zone.rs:363
11592024-12-21T01:37:55.556ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75 file = illumos-utils/src/zone.rs:363
11602024-12-21T01:37:55.563ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d file = illumos-utils/src/zone.rs:363
11612024-12-21T01:37:55.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8 file = illumos-utils/src/zone.rs:363
11622024-12-21T01:37:55.574ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f file = illumos-utils/src/zone.rs:363
11632024-12-21T01:37:55.581ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f file = illumos-utils/src/zone.rs:363
11642024-12-21T01:37:55.587ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103 file = illumos-utils/src/zone.rs:363
11652024-12-21T01:37:55.593ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5 file = illumos-utils/src/zone.rs:325
11662024-12-21T01:37:55.600ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc file = illumos-utils/src/zone.rs:325
11672024-12-21T01:37:55.607ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed file = illumos-utils/src/zone.rs:325
11682024-12-21T01:37:55.676ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11692024-12-21T01:37:55.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5 file = illumos-utils/src/zone.rs:363
11702024-12-21T01:37:55.695ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc file = illumos-utils/src/zone.rs:363
11712024-12-21T01:37:55.719ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed file = illumos-utils/src/zone.rs:363
11722024-12-21T01:37:55.817ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11732024-12-21T01:37:55.878ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11742024-12-21T01:37:55.937ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11752024-12-21T01:37:55.999ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11762024-12-21T01:37:56.001ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11772024-12-21T01:37:56.001ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11782024-12-21T01:37:56.058ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 213, 251]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11792024-12-21T01:37:56.058ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11802024-12-21T01:37:56.059ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11812024-12-21T01:37:56.059ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11822024-12-21T01:37:56.114ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 136, 168]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11832024-12-21T01:37:56.114ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11842024-12-21T01:37:56.115ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11852024-12-21T01:37:56.115ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11862024-12-21T01:37:56.171ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 168, 67]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11872024-12-21T01:37:56.171ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11882024-12-21T01:37:56.174ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11892024-12-21T01:37:56.174ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11902024-12-21T01:37:56.231ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 141, 127]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11912024-12-21T01:37:56.231ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11922024-12-21T01:37:56.233ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11932024-12-21T01:37:56.233ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11942024-12-21T01:37:56.288ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 200, 200]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11952024-12-21T01:37:56.288ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11962024-12-21T01:37:56.301ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11972024-12-21T01:37:56.301ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11982024-12-21T01:37:56.301ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11992024-12-21T01:37:56.301ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12002024-12-21T01:37:56.302ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12012024-12-21T01:37:56.302ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12022024-12-21T01:37:56.302ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12032024-12-21T01:37:56.302ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12042024-12-21T01:37:56.302ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12052024-12-21T01:37:56.302ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12062024-12-21T01:37:56.327ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12072024-12-21T01:37:56.329ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12082024-12-21T01:37:56.378ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12092024-12-21T01:37:56.383ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12102024-12-21T01:37:56.387ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12112024-12-21T01:37:56.388ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12122024-12-21T01:37:56.388ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12132024-12-21T01:37:56.391ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12142024-12-21T01:37:56.394ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12152024-12-21T01:37:56.394ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12162024-12-21T01:37:56.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc file = illumos-utils/src/zone.rs:325
12172024-12-21T01:37:56.615ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca file = illumos-utils/src/zone.rs:325
12182024-12-21T01:37:56.632ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b file = illumos-utils/src/zone.rs:325
12192024-12-21T01:37:56.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b file = illumos-utils/src/zone.rs:325
12202024-12-21T01:37:56.653ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830 file = illumos-utils/src/zone.rs:325
12212024-12-21T01:37:56.670ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc file = illumos-utils/src/zone.rs:363
12222024-12-21T01:37:56.681ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca file = illumos-utils/src/zone.rs:363
12232024-12-21T01:37:56.696ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b file = illumos-utils/src/zone.rs:363
12242024-12-21T01:37:56.707ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b file = illumos-utils/src/zone.rs:363
12252024-12-21T01:37:56.717ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830 file = illumos-utils/src/zone.rs:363
12262024-12-21T01:38:04.765ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272024-12-21T01:38:04.766ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
12282024-12-21T01:38:04.822ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292024-12-21T01:38:04.822ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12302024-12-21T01:38:04.822ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
12312024-12-21T01:38:04.830ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
12322024-12-21T01:38:05.217ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='014e8d7c-3dd1-4590-a8bd-dddb716fb31b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12332024-12-21T01:38:05.217ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
12342024-12-21T01:38:05.226ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_130551aa-49ad-44d7-81d9-df8b0df41eec/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9fadf745-2d17-41d6-80d4-7f303e29f9d1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352024-12-21T01:38:05.227ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b5960098-1ada-427e-bb79-ca59165428b6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='21f3ffb8-9764-48c6-8e5a-9a25c6597558'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362024-12-21T01:38:05.227ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='99a85603-ee21-43a6-974d-c651e819e6f1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-12-21T01:38:05.228ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='53b3388a-50a7-49f8-a514-fb4b2e56273a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382024-12-21T01:38:05.228ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e97d276e-ea54-4591-8041-1234166ccdea/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='debb00f7-9386-4503-87f7-a4c589d0a127'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12392024-12-21T01:38:05.228ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
12402024-12-21T01:38:05.235ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
12412024-12-21T01:38:05.242ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
12422024-12-21T01:38:05.249ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_335ed515-415f-4302-9f2a-54aed0987aee/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1ae60b43-59e5-4c9c-a673-401c370484db'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12432024-12-21T01:38:05.249ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
12442024-12-21T01:38:05.256ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
12452024-12-21T01:38:05.263ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
12462024-12-21T01:38:05.496ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='eacc809e-e4ad-4278-85b0-582ce7d2f103'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12472024-12-21T01:38:05.496ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
12482024-12-21T01:38:05.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 33.091514ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
12492024-12-21T01:38:05.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 42.911719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
12502024-12-21T01:38:05.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 37.940782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
12512024-12-21T01:38:05.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 63.468321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
12522024-12-21T01:38:06.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 46.721115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
12532024-12-21T01:38:06.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 41.560564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
12542024-12-21T01:38:06.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 39.681991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
12552024-12-21T01:38:06.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 46.207022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
12562024-12-21T01:38:06.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 57.849392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
12572024-12-21T01:38:06.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 59.240297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
12582024-12-21T01:38:06.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 114.864857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
12592024-12-21T01:38:06.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 132.611356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
12602024-12-21T01:38:06.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 119.486986ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
12612024-12-21T01:38:06.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 72.346265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
12622024-12-21T01:38:06.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 116.759684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
12632024-12-21T01:38:06.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 54.370526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
12642024-12-21T01:38:06.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 117.305901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
12652024-12-21T01:38:06.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 192.606981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
12662024-12-21T01:38:06.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 108.230663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
12672024-12-21T01:38:06.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 125.346507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
12682024-12-21T01:38:06.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 60.895881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
12692024-12-21T01:38:06.945ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4538d4e0-7a8b-49c4-918d-52cbf69828ca'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12702024-12-21T01:38:06.945ZINFOSledAgent (ServiceManager): Booting oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
12712024-12-21T01:38:06.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 291.292777ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
12722024-12-21T01:38:06.979ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12732024-12-21T01:38:06.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 90.165309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
12742024-12-21T01:38:07.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 75.743231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
12752024-12-21T01:38:07.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 96.616095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
12762024-12-21T01:38:07.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 103.763349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
12772024-12-21T01:38:07.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 107.593791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
12782024-12-21T01:38:07.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 182.686795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
12792024-12-21T01:38:07.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 276.676887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
12802024-12-21T01:38:07.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 413.215957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
12812024-12-21T01:38:07.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 247.38498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
12822024-12-21T01:38:07.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 289.660232ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
12832024-12-21T01:38:07.213ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
12842024-12-21T01:38:07.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 278.993808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
12852024-12-21T01:38:07.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 288.183345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
12862024-12-21T01:38:07.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 109.576261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
12872024-12-21T01:38:07.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 551.482973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
12882024-12-21T01:38:07.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 408.486697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
12892024-12-21T01:38:07.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 33.809465ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
12902024-12-21T01:38:07.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 313.395876ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
12912024-12-21T01:38:07.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 67.456593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
12922024-12-21T01:38:07.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 219.322584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
12932024-12-21T01:38:07.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 423.620236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
12942024-12-21T01:38:07.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 126.389211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
12952024-12-21T01:38:07.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 287.460437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
12962024-12-21T01:38:07.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 780.364822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
12972024-12-21T01:38:07.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 545.974511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
12982024-12-21T01:38:07.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 306.408112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
12992024-12-21T01:38:07.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 593.250188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13002024-12-21T01:38:07.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 608.887726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
13012024-12-21T01:38:07.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 582.646558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13022024-12-21T01:38:07.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 27.916115ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13032024-12-21T01:38:07.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.080478295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
13042024-12-21T01:38:07.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 950.009114ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
13052024-12-21T01:38:07.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 97.84481ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13062024-12-21T01:38:07.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 1.046507373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
13072024-12-21T01:38:07.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 992.890162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13082024-12-21T01:38:07.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 286.002921ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13092024-12-21T01:38:07.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 474.255515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13102024-12-21T01:38:07.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 972.726839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
13112024-12-21T01:38:07.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 434.066475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13122024-12-21T01:38:08.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 375.288731ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13132024-12-21T01:38:08.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 853.8179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
13142024-12-21T01:38:08.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 460.777296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13152024-12-21T01:38:08.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 450.723684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13162024-12-21T01:38:08.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 545.955408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
13172024-12-21T01:38:08.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 525.815275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
13182024-12-21T01:38:08.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.256701728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13192024-12-21T01:38:08.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 727.23794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13202024-12-21T01:38:08.457ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212024-12-21T01:38:08.457ZINFOSledAgent (ServiceManager): Booting oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13222024-12-21T01:38:08.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 931.146753ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13232024-12-21T01:38:08.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.171686544s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
13242024-12-21T01:38:08.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 764.693381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13252024-12-21T01:38:08.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 523.692827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13262024-12-21T01:38:08.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 43.62396ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13272024-12-21T01:38:08.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.395592734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
13282024-12-21T01:38:08.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 149.106798ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13292024-12-21T01:38:08.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 835.506415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
13302024-12-21T01:38:08.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.337604085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
13312024-12-21T01:38:08.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 766.34421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13322024-12-21T01:38:08.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 745.325597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
13332024-12-21T01:38:08.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.131025491s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
13342024-12-21T01:38:08.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 215.920111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13352024-12-21T01:38:08.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.151053521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
13362024-12-21T01:38:09.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 680.923547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13372024-12-21T01:38:09.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 304.52573ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13382024-12-21T01:38:09.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.446943769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13392024-12-21T01:38:09.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.13990995s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13402024-12-21T01:38:09.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.407014088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13412024-12-21T01:38:09.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 675.231559ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13422024-12-21T01:38:09.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.163577128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13432024-12-21T01:38:09.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 818.179778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13442024-12-21T01:38:09.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 868.198214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
13452024-12-21T01:38:09.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 930.595287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
13462024-12-21T01:38:09.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 838.856886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13472024-12-21T01:38:09.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.206278116s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
13482024-12-21T01:38:09.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 624.35029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
13492024-12-21T01:38:10.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 795.375582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
13502024-12-21T01:38:10.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 704.937167ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
13512024-12-21T01:38:10.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 583.1719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
13522024-12-21T01:38:10.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 999.92596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13532024-12-21T01:38:10.401ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.75469686s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
13542024-12-21T01:38:10.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 786.306112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13552024-12-21T01:38:10.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 756.565836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
13562024-12-21T01:38:10.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 1.334034829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
13572024-12-21T01:38:10.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 822.607902ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13582024-12-21T01:38:10.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 1.47855005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13592024-12-21T01:38:10.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.076139502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
13602024-12-21T01:38:10.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 852.966973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13612024-12-21T01:38:10.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 675.743519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13622024-12-21T01:38:10.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 839.164634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
13632024-12-21T01:38:10.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 662.153084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13642024-12-21T01:38:10.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.379951793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
13652024-12-21T01:38:10.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 969.625217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
13662024-12-21T01:38:11.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 979.75577ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
13672024-12-21T01:38:11.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.244071101s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13682024-12-21T01:38:11.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 878.140439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13692024-12-21T01:38:11.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.30408656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
13702024-12-21T01:38:11.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 529.909969ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13712024-12-21T01:38:11.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 599.575012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13722024-12-21T01:38:11.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.019255979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13732024-12-21T01:38:11.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.26152789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13742024-12-21T01:38:11.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 506.232265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
13752024-12-21T01:38:11.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.395310698s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
13762024-12-21T01:38:11.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 1.386687841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
13772024-12-21T01:38:11.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.06631767s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
13782024-12-21T01:38:11.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.341703867s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
13792024-12-21T01:38:12.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 957.482618ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
13802024-12-21T01:38:12.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 572.563803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13812024-12-21T01:38:12.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 544.113916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13822024-12-21T01:38:12.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 501.252609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13832024-12-21T01:38:12.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 945.39199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
13842024-12-21T01:38:12.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.007043938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
13852024-12-21T01:38:12.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.356551297s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
13862024-12-21T01:38:12.485ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb57a0dd-718a-43c4-a7c9-928857fc3a0a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13872024-12-21T01:38:12.485ZINFOSledAgent (ServiceManager): Booting oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
13882024-12-21T01:38:12.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.478191208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
13892024-12-21T01:38:12.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.428688225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
13902024-12-21T01:38:12.570ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13912024-12-21T01:38:12.570ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
13922024-12-21T01:38:12.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 685.029657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
13932024-12-21T01:38:12.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 641.541875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
13942024-12-21T01:38:12.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.264574996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
13952024-12-21T01:38:12.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 25.818007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
13962024-12-21T01:38:12.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 122.162728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
13972024-12-21T01:38:12.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 55.820021ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
13982024-12-21T01:38:12.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.43143278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
13992024-12-21T01:38:12.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 105.109689ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14002024-12-21T01:38:12.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 165.652741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14012024-12-21T01:38:12.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 829.531261ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
14022024-12-21T01:38:12.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 188.007264ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14032024-12-21T01:38:13.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.202871796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
14042024-12-21T01:38:13.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.065133446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
14052024-12-21T01:38:13.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 312.685268ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14062024-12-21T01:38:13.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.075455918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
14072024-12-21T01:38:13.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 453.311124ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14082024-12-21T01:38:13.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 697.54124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
14092024-12-21T01:38:13.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.125767201s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
14102024-12-21T01:38:13.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 1.084082926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
14112024-12-21T01:38:13.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.109572621s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
14122024-12-21T01:38:13.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 960.601901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
14132024-12-21T01:38:13.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 1.119409008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14142024-12-21T01:38:13.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 717.446941ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14152024-12-21T01:38:13.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.414208318s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
14162024-12-21T01:38:13.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.069865994s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
14172024-12-21T01:38:13.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.48312819s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
14182024-12-21T01:38:13.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 843.271959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
14192024-12-21T01:38:14.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 655.635427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
14202024-12-21T01:38:14.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 930.718039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
14212024-12-21T01:38:14.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.260161798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
14222024-12-21T01:38:14.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 740.126945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
14232024-12-21T01:38:14.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.017628323s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
14242024-12-21T01:38:14.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.304005612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
14252024-12-21T01:38:14.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 585.353076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
14262024-12-21T01:38:14.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 751.700878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
14272024-12-21T01:38:14.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 1.42869226s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14282024-12-21T01:38:14.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 547.206543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
14292024-12-21T01:38:14.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 501.510798ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
14302024-12-21T01:38:14.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 899.267451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14312024-12-21T01:38:14.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.362289642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
14322024-12-21T01:38:14.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 533.224797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
14332024-12-21T01:38:14.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 1.043923027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
14342024-12-21T01:38:14.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.039557473s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
14352024-12-21T01:38:14.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.023347342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
14362024-12-21T01:38:14.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.085547346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
14372024-12-21T01:38:14.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 647.855648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
14382024-12-21T01:38:15.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 503.741827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
14392024-12-21T01:38:15.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 789.411909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
14402024-12-21T01:38:15.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.451813037s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
14412024-12-21T01:38:15.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.049368373s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
14422024-12-21T01:38:15.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 728.166805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
14432024-12-21T01:38:15.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 797.77834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
14442024-12-21T01:38:15.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.140359319s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
14452024-12-21T01:38:15.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 1.380160346s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14462024-12-21T01:38:15.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 710.323377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
14472024-12-21T01:38:15.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.387473791s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
14482024-12-21T01:38:15.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.056664335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
14492024-12-21T01:38:15.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 1.038118164s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14502024-12-21T01:38:15.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 537.620141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
14512024-12-21T01:38:15.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 659.056545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
14522024-12-21T01:38:15.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 670.785128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
14532024-12-21T01:38:15.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.316111241s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
14542024-12-21T01:38:16.021ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14552024-12-21T01:38:16.022ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14562024-12-21T01:38:16.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 744.108209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
14572024-12-21T01:38:16.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 609.380139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
14582024-12-21T01:38:16.073ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14592024-12-21T01:38:16.073ZINFOSledAgent (ServiceManager): Booting oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14602024-12-21T01:38:16.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.284915716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
14612024-12-21T01:38:16.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 37.887086ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14622024-12-21T01:38:16.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.224837734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
14632024-12-21T01:38:16.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 122.483448ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14642024-12-21T01:38:16.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 47.773224ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14652024-12-21T01:38:16.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.427492475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
14662024-12-21T01:38:16.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 120.276043ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14672024-12-21T01:38:16.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 147.027157ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14682024-12-21T01:38:16.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 603.340725ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
14692024-12-21T01:38:16.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 179.945206ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14702024-12-21T01:38:16.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 1.319052046s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
14712024-12-21T01:38:16.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 303.605259ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14722024-12-21T01:38:16.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.223832728s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
14732024-12-21T01:38:16.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 995.251053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
14742024-12-21T01:38:16.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 440.136736ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14752024-12-21T01:38:16.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 558.496775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
14762024-12-21T01:38:16.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.392039727s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
14772024-12-21T01:38:16.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 820.006577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
14782024-12-21T01:38:16.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 715.807984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
14792024-12-21T01:38:16.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 676.293719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
14802024-12-21T01:38:16.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 841.686679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14812024-12-21T01:38:16.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 435.431792ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14822024-12-21T01:38:16.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 519.522613ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14832024-12-21T01:38:16.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 651.827095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
14842024-12-21T01:38:17.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.187673737s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
14852024-12-21T01:38:17.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 587.840193ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14862024-12-21T01:38:17.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.434382545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
14872024-12-21T01:38:17.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 885.716692ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
14882024-12-21T01:38:17.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.191341952s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
14892024-12-21T01:38:17.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 589.918869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
14902024-12-21T01:38:17.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 785.315033ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
14912024-12-21T01:38:17.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 867.391021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
14922024-12-21T01:38:17.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.124249495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
14932024-12-21T01:38:17.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.060424983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
14942024-12-21T01:38:17.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.345622313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
14952024-12-21T01:38:17.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.239998138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
14962024-12-21T01:38:17.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 839.798833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
14972024-12-21T01:38:17.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 871.050003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
14982024-12-21T01:38:17.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 1.465010714s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
14992024-12-21T01:38:17.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.353939551s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
15002024-12-21T01:38:17.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 804.841944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
15012024-12-21T01:38:17.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 537.145583ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
15022024-12-21T01:38:18.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 954.667793ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
15032024-12-21T01:38:18.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 535.064189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
15042024-12-21T01:38:18.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 586.172061ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
15052024-12-21T01:38:18.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 1.127881314s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15062024-12-21T01:38:18.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 969.382922ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
15072024-12-21T01:38:18.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.44874269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
15082024-12-21T01:38:18.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.373082662s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
15092024-12-21T01:38:18.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 518.548013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
15102024-12-21T01:38:18.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.083199177s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
15112024-12-21T01:38:18.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.37460268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
15122024-12-21T01:38:18.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 1.024141727s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
15132024-12-21T01:38:18.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.097650852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
15142024-12-21T01:38:18.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 789.382695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
15152024-12-21T01:38:18.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.469159591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
15162024-12-21T01:38:18.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 572.300597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
15172024-12-21T01:38:18.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 1.065536246s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
15182024-12-21T01:38:18.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.016886182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
15192024-12-21T01:38:18.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 500.154485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
15202024-12-21T01:38:18.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 979.101876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
15212024-12-21T01:38:19.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 1.480864257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
15222024-12-21T01:38:19.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 868.979903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
15232024-12-21T01:38:19.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 1.278917532s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
15242024-12-21T01:38:19.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.032783219s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
15252024-12-21T01:38:19.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 737.813052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
15262024-12-21T01:38:19.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 546.846312ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15272024-12-21T01:38:19.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.390720792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
15282024-12-21T01:38:19.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 533.063634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
15292024-12-21T01:38:19.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 845.364359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
15302024-12-21T01:38:19.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.353741316s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
15312024-12-21T01:38:19.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.006058513s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
15322024-12-21T01:38:19.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.185610454s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
15332024-12-21T01:38:19.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 571.109725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
15342024-12-21T01:38:19.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 1.206766414s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
15352024-12-21T01:38:19.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 965.159966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
15362024-12-21T01:38:19.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 523.202225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
15372024-12-21T01:38:19.960ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15382024-12-21T01:38:19.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 522.663423ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15392024-12-21T01:38:19.968ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15402024-12-21T01:38:19.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.176304644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
15412024-12-21T01:38:20.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.315535675s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
15422024-12-21T01:38:20.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 929.166251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
15432024-12-21T01:38:20.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 709.232916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
15442024-12-21T01:38:20.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.1099068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
15452024-12-21T01:38:20.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 72.217096ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15462024-12-21T01:38:20.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 143.355491ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15472024-12-21T01:38:20.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.378079889s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
15482024-12-21T01:38:20.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.213991987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
15492024-12-21T01:38:20.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 780.34792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
15502024-12-21T01:38:20.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 661.1496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
15512024-12-21T01:38:20.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 256.501049ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15522024-12-21T01:38:20.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 983.097547ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
15532024-12-21T01:38:20.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 800.415604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
15542024-12-21T01:38:20.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 990.763134ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15552024-12-21T01:38:20.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.124529789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
15562024-12-21T01:38:20.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.164463836s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
15572024-12-21T01:38:20.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 521.571283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
15582024-12-21T01:38:20.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 537.879209ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15592024-12-21T01:38:20.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 855.912925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
15602024-12-21T01:38:20.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 1.191599882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
15612024-12-21T01:38:20.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 766.547387ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
15622024-12-21T01:38:21.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.343821224s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
15632024-12-21T01:38:21.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 983.566195ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
15642024-12-21T01:38:21.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 715.627196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
15652024-12-21T01:38:21.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 1.043212463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
15662024-12-21T01:38:21.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.398669195s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
15672024-12-21T01:38:21.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.258999696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
15682024-12-21T01:38:21.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.340852027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
15692024-12-21T01:38:21.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 614.747662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
15702024-12-21T01:38:21.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 405.90001ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15712024-12-21T01:38:21.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 643.308211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
15722024-12-21T01:38:21.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 1.178142487s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
15732024-12-21T01:38:21.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 614.288344ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15742024-12-21T01:38:21.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 545.815137ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
15752024-12-21T01:38:21.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 594.584703ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
15762024-12-21T01:38:21.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.226301859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
15772024-12-21T01:38:21.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.048117734s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
15782024-12-21T01:38:21.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 529.680246ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15792024-12-21T01:38:21.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.074054625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
15802024-12-21T01:38:21.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 530.419638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
15812024-12-21T01:38:21.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.296949548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
15822024-12-21T01:38:22.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 983.153846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
15832024-12-21T01:38:22.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 793.064835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
15842024-12-21T01:38:22.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 1.13143097s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
15852024-12-21T01:38:22.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 1.152638199s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
15862024-12-21T01:38:22.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 725.391883ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
15872024-12-21T01:38:22.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 504.342572ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15882024-12-21T01:38:22.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 1.054616277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
15892024-12-21T01:38:22.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.218311955s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
15902024-12-21T01:38:22.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 565.928421ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
15912024-12-21T01:38:22.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 606.660779ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
15922024-12-21T01:38:22.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.099586824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
15932024-12-21T01:38:22.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.058424841s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
15942024-12-21T01:38:22.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 937.503102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
15952024-12-21T01:38:22.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 1.472108056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
15962024-12-21T01:38:22.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 1.230883681s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
15972024-12-21T01:38:22.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 1.045631008s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
15982024-12-21T01:38:22.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 1.102883047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
15992024-12-21T01:38:22.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 503.639939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
16002024-12-21T01:38:22.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 696.220091ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
16012024-12-21T01:38:22.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 1.2894521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
16022024-12-21T01:38:22.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103") failed: Property not found. retry in 1.410510759s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
16032024-12-21T01:38:22.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 983.352676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
16042024-12-21T01:38:23.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 708.914ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16052024-12-21T01:38:23.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.017062414s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
16062024-12-21T01:38:23.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763") failed: Property not found. retry in 1.446651244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
16072024-12-21T01:38:23.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 590.327842ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
16082024-12-21T01:38:23.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 782.467622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
16092024-12-21T01:38:23.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 1.434649596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
16102024-12-21T01:38:23.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc") failed: Property not found. retry in 1.456591836s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
16112024-12-21T01:38:23.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 1.088855261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
16122024-12-21T01:38:23.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.477247182s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
16132024-12-21T01:38:23.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 796.627181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
16142024-12-21T01:38:23.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b") failed: Property not found. retry in 1.131925904s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
16152024-12-21T01:38:23.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587") failed: Property not found. retry in 1.256892372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
16162024-12-21T01:38:23.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 1.251627565s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16172024-12-21T01:38:23.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 732.359723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
16182024-12-21T01:38:23.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 1.437602944s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
16192024-12-21T01:38:23.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 934.324851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
16202024-12-21T01:38:23.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 707.261995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
16212024-12-21T01:38:24.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 1.234139768s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
16222024-12-21T01:38:24.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f") failed: Property not found. retry in 1.095599884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
16232024-12-21T01:38:24.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5") failed: Property not found. retry in 807.238813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
16242024-12-21T01:38:24.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc") failed: Property not found. retry in 529.848388ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
16252024-12-21T01:38:24.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8") failed: Property not found. retry in 584.856159ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
16262024-12-21T01:38:24.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d") failed: Property not found. retry in 1.136111197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
16272024-12-21T01:38:24.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca") failed: Property not found. retry in 1.454265405s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
16282024-12-21T01:38:24.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed") failed: Property not found. retry in 955.60985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
16292024-12-21T01:38:24.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6") failed: Property not found. retry in 846.395507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
16302024-12-21T01:38:24.751ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63053
16312024-12-21T01:38:24.763ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 756 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63053 req_id = 8aad74fc-d6f1-48d4-a2f6-73eec7e3b73c response_code = 200 uri = /baseboard
16322024-12-21T01:38:24.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75") failed: Property not found. retry in 738.816503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
16332024-12-21T01:38:24.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612") failed: Property not found. retry in 659.91695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
16342024-12-21T01:38:24.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 708.385308ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16352024-12-21T01:38:25.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc") failed: Property not found. retry in 1.244784133s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
16362024-12-21T01:38:25.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830") failed: Property not found. retry in 908.649798ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
16372024-12-21T01:38:25.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b") failed: Property not found. retry in 764.268302ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
16382024-12-21T01:38:25.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 1.348910337s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16392024-12-21T01:38:27.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 1.450182102s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16402024-12-21T01:38:28.205ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.046665621s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
16412024-12-21T01:38:28.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 933.042207ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16422024-12-21T01:38:29.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f") failed: Property not found. retry in 827.580416ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16432024-12-21T01:38:30.302ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.229970237s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
16442024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_4b78370c-2208-42bf-9bea-345adcfd9612
16452024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_2ff745a8-7f86-4305-bb55-236a8dae14d6
16462024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_87acc9f1-bd6e-4cb4-99e8-f19109246fbc
16472024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_2b48b14b-7061-4b95-8d98-a7b44a59d763
16482024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_e685f9ba-fc38-4403-9930-a5fc9ac64587
16492024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_141b4eb6-11f8-423a-87ca-16de7e367f75
16502024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_2cfe4c76-0a3a-4375-984b-593a3834ef4d
16512024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_6e4b451b-bda2-46b9-a9ac-ad6f570d28f8
16522024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_4b8cc219-c049-4c6e-8565-7499e246880f
16532024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_65c76d16-81e5-4dc4-a11f-07cac6693dca
16542024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_93385bd5-c59a-4479-b2bc-adcfffae549f
16552024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_eacc809e-e4ad-4278-85b0-582ce7d2f103
16562024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_6dfd6dd4-a4da-48b2-a18e-56aed702d02b
16572024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_c6a5f4d8-c7fd-4058-b410-8b5d99f44bc5
16582024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_4c22d3c5-4241-430e-a780-0dd847f2622b
16592024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_ea880817-06e5-436d-974a-fbd5a7dd0ecc
16602024-12-21T01:38:30.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_0815e255-1f71-4707-8a37-c6acfe6ab5ed
16612024-12-21T01:38:30.358ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_0ebacafa-86bf-4887-9449-555ff2475830
16622024-12-21T01:38:30.358ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_329ee834-a5be-43de-9495-a0167e01a5cc
16632024-12-21T01:38:30.370ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16642024-12-21T01:38:30.392ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16652024-12-21T01:38:30.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35742407 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40834 req_id = 3aa16fe0-455f-4ad7-94d4-4af65f2fce27 response_code = 204 uri = /omicron-zones
16662024-12-21T01:38:30.459ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16672024-12-21T01:38:30.479ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16682024-12-21T01:38:30.481ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
16692024-12-21T01:38:30.514ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
16702024-12-21T01:38:30.515ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16712024-12-21T01:38:30.571ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16722024-12-21T01:38:30.726ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16732024-12-21T01:38:30.850ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16742024-12-21T01:38:31.066ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16752024-12-21T01:38:31.286ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16762024-12-21T01:38:31.418ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16772024-12-21T01:38:31.724ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16782024-12-21T01:38:32.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16792024-12-21T01:38:32.392ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16802024-12-21T01:38:33.140ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16812024-12-21T01:38:33.498ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/71471b13-5882-48d1-83b5-9cf05bae6c2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16822024-12-21T01:38:36.361ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8d0b9036-e0c1-4ddb-86c7-fd8db1a6c817", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"71471b13-5882-48d1-83b5-9cf05bae6c2e\"", request_id: "8d0b9036-e0c1-4ddb-86c7-fd8db1a6c817" } file = sled-agent/src/rack_setup/service.rs:1078
16832024-12-21T01:38:36.884ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c0b1cde6-ceee-4c0b-885c-4a8eb2c2c87b", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"71471b13-5882-48d1-83b5-9cf05bae6c2e\"", request_id: "c0b1cde6-ceee-4c0b-885c-4a8eb2c2c87b" } file = sled-agent/src/rack_setup/service.rs:1078
16842024-12-21T01:38:38.063ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d3050205-c1b3-4873-bfd6-6f375ccedae5", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"71471b13-5882-48d1-83b5-9cf05bae6c2e\"", request_id: "d3050205-c1b3-4873-bfd6-6f375ccedae5" } file = sled-agent/src/rack_setup/service.rs:1078
16852024-12-21T01:38:42.551ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ccf048cc-128a-4ce2-b6c3-0702f6e26742", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "ccf048cc-128a-4ce2-b6c3-0702f6e26742" } file = sled-agent/src/rack_setup/service.rs:1078
16862024-12-21T01:38:46.272ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "271da84f-7490-4083-92d4-01b60c79a587", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "271da84f-7490-4083-92d4-01b60c79a587" } file = sled-agent/src/rack_setup/service.rs:1078
16872024-12-21T01:38:48.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0a59cbae-4622-49ee-9f14-0fec09d754f7", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "0a59cbae-4622-49ee-9f14-0fec09d754f7" } file = sled-agent/src/rack_setup/service.rs:1078
16882024-12-21T01:38:52.557ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7e3f3ea7-7d22-488e-89a8-47f4dcde4573", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "7e3f3ea7-7d22-488e-89a8-47f4dcde4573" } file = sled-agent/src/rack_setup/service.rs:1078
16892024-12-21T01:38:54.798ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50244
16902024-12-21T01:38:54.799ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50244 req_id = 1109fdda-ba2c-4d19-8593-eb38da1ceb69 response_code = 200 uri = /baseboard
16912024-12-21T01:38:56.440ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "566079c0-a723-4366-a941-e49b7b627103", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "566079c0-a723-4366-a941-e49b7b627103" } file = sled-agent/src/rack_setup/service.rs:1078
16922024-12-21T01:38:59.256ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a703a3d9-216a-43b7-99b9-60a7d2990b96", "content-length": "173", "date": "Sat, 21 Dec 2024 01:38:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "a703a3d9-216a-43b7-99b9-60a7d2990b96" } file = sled-agent/src/rack_setup/service.rs:1078
16932024-12-21T01:39:04.952ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4effab58-23b3-4716-89e6-e55ad1f47cd7", "content-length": "173", "date": "Sat, 21 Dec 2024 01:39:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "4effab58-23b3-4716-89e6-e55ad1f47cd7" } file = sled-agent/src/rack_setup/service.rs:1078
16942024-12-21T01:39:10.164ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4b1873c1-f4a0-4d5c-82ed-3cc64cd11d7b", "content-length": "173", "date": "Sat, 21 Dec 2024 01:39:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"402798b1-2357-48f5-992b-b9e53d91bbe0\"", request_id: "4b1873c1-f4a0-4d5c-82ed-3cc64cd11d7b" } file = sled-agent/src/rack_setup/service.rs:1078
16952024-12-21T01:39:16.900ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
16962024-12-21T01:39:17.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62234
16972024-12-21T01:39:17.086ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16982024-12-21T01:39:17.087ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16992024-12-21T01:39:17.087ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
17002024-12-21T01:39:17.088ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
17012024-12-21T01:39:17.101ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17022024-12-21T01:39:17.101ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9
17032024-12-21T01:39:17.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17042024-12-21T01:39:17.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593
17052024-12-21T01:39:17.150ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17062024-12-21T01:39:17.150ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5
17072024-12-21T01:39:17.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17082024-12-21T01:39:17.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5960098-1ada-427e-bb79-ca59165428b6
17092024-12-21T01:39:17.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17102024-12-21T01:39:17.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0
17112024-12-21T01:39:17.217ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17122024-12-21T01:39:17.217ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_335ed515-415f-4302-9f2a-54aed0987aee
17132024-12-21T01:39:17.236ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17142024-12-21T01:39:17.236ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_130551aa-49ad-44d7-81d9-df8b0df41eec
17152024-12-21T01:39:17.257ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17162024-12-21T01:39:17.257ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142
17172024-12-21T01:39:17.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17182024-12-21T01:39:17.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e97d276e-ea54-4591-8041-1234166ccdea
17192024-12-21T01:39:17.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205091 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62234 req_id = 509d87a0-3129-4c7b-b394-077489a335ba response_code = 200 uri = /inventory
17202024-12-21T01:39:18.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49368
17212024-12-21T01:39:18.054ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17222024-12-21T01:39:18.055ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17232024-12-21T01:39:18.055ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17242024-12-21T01:39:18.055ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17252024-12-21T01:39:18.055ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262024-12-21T01:39:18.055ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17272024-12-21T01:39:18.055ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282024-12-21T01:39:18.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49368 req_id = c9b743bd-15cb-4424-85fa-22de55875d83 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17292024-12-21T01:39:18.057ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
17302024-12-21T01:39:18.061ZINFOSledAgent (RSS): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17312024-12-21T01:39:18.061ZINFOSledAgent (RSS): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17322024-12-21T01:39:18.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65422
17332024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17342024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17352024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17362024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17372024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17382024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17392024-12-21T01:39:18.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402024-12-21T01:39:18.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65422 req_id = 39701ada-f5ca-42e8-805a-a015aa3d9255 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17412024-12-21T01:39:18.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40851
17422024-12-21T01:39:18.454ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17432024-12-21T01:39:18.454ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17442024-12-21T01:39:18.454ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
17452024-12-21T01:39:18.455ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
17462024-12-21T01:39:18.467ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17472024-12-21T01:39:18.467ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9
17482024-12-21T01:39:18.494ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17492024-12-21T01:39:18.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593
17502024-12-21T01:39:18.516ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17512024-12-21T01:39:18.516ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5
17522024-12-21T01:39:18.538ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17532024-12-21T01:39:18.538ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5960098-1ada-427e-bb79-ca59165428b6
17542024-12-21T01:39:18.558ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17552024-12-21T01:39:18.559ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0
17562024-12-21T01:39:18.580ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17572024-12-21T01:39:18.580ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_335ed515-415f-4302-9f2a-54aed0987aee
17582024-12-21T01:39:18.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17592024-12-21T01:39:18.603ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_130551aa-49ad-44d7-81d9-df8b0df41eec
17602024-12-21T01:39:18.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17612024-12-21T01:39:18.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142
17622024-12-21T01:39:18.652ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17632024-12-21T01:39:18.652ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e97d276e-ea54-4591-8041-1234166ccdea
17642024-12-21T01:39:18.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40851 req_id = 8d0f3cd3-fdd1-40ef-ba70-c924f9326f16 response_code = 200 uri = /inventory
17652024-12-21T01:39:19.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60278
17662024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17672024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17682024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17692024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17702024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17712024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17722024-12-21T01:39:19.091ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17732024-12-21T01:39:19.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60278 req_id = 536220c2-a581-4846-80a0-2f7a3385ec7d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17742024-12-21T01:39:19.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56761
17752024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17762024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17772024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17782024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17792024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17802024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17812024-12-21T01:39:19.342ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17822024-12-21T01:39:19.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56761 req_id = 2dfd0848-a00d-4ebb-8134-d9a260c7f783 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17832024-12-21T01:39:19.817ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:57402 remote_addr = [fd00:1122:3344:101::d]:48810 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
17842024-12-21T01:39:19.844ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25210 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 0fdd0906-95d7-48c2-bc2a-d6272d3f3a0c response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
17852024-12-21T01:39:22.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48351
17862024-12-21T01:39:22.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48351 req_id = f9419b49-fcf0-4a65-9462-a9e666fb7a02 response_code = 200 uri = /vpc-routes
17872024-12-21T01:39:22.989ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
17882024-12-21T01:39:22.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48351 req_id = 82bac6bd-b7fe-4fdb-b063-07e7c9f8f778 response_code = 204 uri = /eip-gateways
17892024-12-21T01:39:23.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1741 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48351 req_id = 6bf4bb9e-f5d2-45ba-91a3-3a0c41556e4b response_code = 204 uri = /vpc-routes
17902024-12-21T01:39:24.832ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51451
17912024-12-21T01:39:24.832ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51451 req_id = 54f0b36d-9f80-4f95-b171-c21384bf5f1b response_code = 200 uri = /baseboard
17922024-12-21T01:39:38.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33949
17932024-12-21T01:39:38.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33949 req_id = 7ca96d98-4e7a-4890-8f28-5a56c821a032 response_code = 200 uri = /vpc-routes
17942024-12-21T01:39:38.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51630
17952024-12-21T01:39:38.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51630 req_id = df88d4ad-5c8a-4265-860c-2c916cde07b3 response_code = 200 uri = /vpc-routes
17962024-12-21T01:39:38.766ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
17972024-12-21T01:39:38.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51630 req_id = b452791f-dd00-4870-8241-0b1485b98c21 response_code = 204 uri = /eip-gateways
17982024-12-21T01:39:38.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
17992024-12-21T01:39:38.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33949 req_id = f50bd725-4300-4d58-a694-3e169f199482 response_code = 204 uri = /eip-gateways
18002024-12-21T01:39:38.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33949 req_id = d23021c6-6088-487e-9982-860eb88d0ebd response_code = 204 uri = /vpc-routes
18012024-12-21T01:39:38.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56887
18022024-12-21T01:39:38.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 791 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56887 req_id = e67ce09f-cb13-4620-a43f-f70ef7787f58 response_code = 200 uri = /v2p
18032024-12-21T01:39:38.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51630 req_id = a2541007-c45f-461e-8111-5f23dee2e391 response_code = 204 uri = /vpc-routes
18042024-12-21T01:39:38.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37775
18052024-12-21T01:39:38.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18062024-12-21T01:39:39.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18072024-12-21T01:39:39.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37775 req_id = bcdb95b3-0254-497d-910f-63e4f50adb3d response_code = 204 uri = /switch-ports
18082024-12-21T01:39:39.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58202
18092024-12-21T01:39:39.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60206
18102024-12-21T01:39:39.092ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18112024-12-21T01:39:39.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4789 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37775 req_id = 2b13e284-4a1f-4060-982b-97fd664c3da8 response_code = 200 uri = /network-bootstore-config
18122024-12-21T01:39:39.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58202 req_id = 3aa32100-d7ea-45c3-8518-7c65920c17db response_code = 200 uri = /v2p
18132024-12-21T01:39:39.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18142024-12-21T01:39:39.174ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18152024-12-21T01:39:39.174ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18162024-12-21T01:39:39.175ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18172024-12-21T01:39:39.176ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18182024-12-21T01:39:39.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37775 req_id = fe49ba2d-c2a1-4db9-83fd-49c899108c36 response_code = 204 uri = /network-bootstore-config
18192024-12-21T01:39:39.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60206 req_id = 05b64561-2992-49a1-8726-c28fe20e086c response_code = 204 uri = /switch-ports
18202024-12-21T01:39:39.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60206 req_id = 2d02b754-5c6a-4e5d-a8bf-98601fd7a729 response_code = 200 uri = /network-bootstore-config
18212024-12-21T01:39:39.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46478
18222024-12-21T01:39:39.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46478 req_id = 997b2525-3cfe-4ea8-acd3-fa3725f69467 response_code = 200 uri = /vpc-routes
18232024-12-21T01:39:39.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
18242024-12-21T01:39:39.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46478 req_id = 869842fc-9f58-4c2c-93f3-418ccbfc8b2e response_code = 204 uri = /eip-gateways
18252024-12-21T01:39:39.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46478 req_id = 145ee956-4bcf-4873-b578-60404d89cec1 response_code = 204 uri = /vpc-routes
18262024-12-21T01:39:39.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42044
18272024-12-21T01:39:39.291ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18282024-12-21T01:39:39.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18292024-12-21T01:39:39.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42044 req_id = 5f0dec65-ae66-4c9c-b030-6f0c9d020f7a response_code = 204 uri = /switch-ports
18302024-12-21T01:39:39.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60050
18312024-12-21T01:39:39.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60050 req_id = 9ed36390-4892-48c9-908d-4450c19022f7 response_code = 200 uri = /v2p
18322024-12-21T01:39:39.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42044 req_id = ad207624-340b-4511-ba04-5ad3681e6e74 response_code = 200 uri = /network-bootstore-config
18332024-12-21T01:39:49.827ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8548 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 7ba9b89d-0e9f-49e9-a180-57ac479444ad response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
18342024-12-21T01:39:54.865ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55247
18352024-12-21T01:39:54.865ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55247 req_id = ecd57e9d-76f7-482d-92f3-28f9fef31066 response_code = 200 uri = /baseboard
18362024-12-21T01:40:08.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65123
18372024-12-21T01:40:08.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65123 req_id = 3ddae552-0c80-4b26-be30-1c1d5bbdc01f response_code = 200 uri = /vpc-routes
18382024-12-21T01:40:08.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37814
18392024-12-21T01:40:08.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37814 req_id = 33d7149c-8970-44e0-ada0-12732ab38cd8 response_code = 200 uri = /v2p
18402024-12-21T01:40:08.688ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
18412024-12-21T01:40:08.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65123 req_id = f946e13c-5a83-4f1c-b914-f738e63b7b05 response_code = 204 uri = /eip-gateways
18422024-12-21T01:40:08.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65222
18432024-12-21T01:40:08.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65222 req_id = 0d5e649f-f53b-4dac-ba2c-33f89465e4a5 response_code = 200 uri = /vpc-routes
18442024-12-21T01:40:08.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56754
18452024-12-21T01:40:08.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56754 req_id = 0945b7ed-ce64-4467-8c38-15838a42f216 response_code = 200 uri = /v2p
18462024-12-21T01:40:08.755ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
18472024-12-21T01:40:08.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65222 req_id = 595b7009-1658-452b-b192-c8696bfce4a3 response_code = 204 uri = /eip-gateways
18482024-12-21T01:40:08.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65123 req_id = 4fbd2837-9804-4af3-b133-76c28f2df1e4 response_code = 204 uri = /vpc-routes
18492024-12-21T01:40:08.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49869
18502024-12-21T01:40:08.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18512024-12-21T01:40:08.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18522024-12-21T01:40:08.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103251 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49869 req_id = 2d3da704-62b6-4d12-8f78-cb3d154666f2 response_code = 204 uri = /switch-ports
18532024-12-21T01:40:08.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35318
18542024-12-21T01:40:08.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18552024-12-21T01:40:08.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49869 req_id = 9f1a45dc-c492-48d7-aed3-ca44a938fa37 response_code = 200 uri = /network-bootstore-config
18562024-12-21T01:40:08.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65222 req_id = c44e85df-6165-4e0a-a2a8-cbc9282e1422 response_code = 204 uri = /vpc-routes
18572024-12-21T01:40:09.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18582024-12-21T01:40:09.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45214
18592024-12-21T01:40:09.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45214 req_id = c714c959-1b25-4493-8c17-69ea58c657b7 response_code = 200 uri = /vpc-routes
18602024-12-21T01:40:09.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44976
18612024-12-21T01:40:09.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44976 req_id = 00c6f5a8-b7ad-4bc7-a5a2-8963751900c6 response_code = 200 uri = /v2p
18622024-12-21T01:40:09.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95286 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35318 req_id = 8c7d04fb-9444-4a9b-bede-33d05f14329f response_code = 204 uri = /switch-ports
18632024-12-21T01:40:09.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35318 req_id = d6460315-1be4-4d9a-a422-77d3fa720892 response_code = 200 uri = /network-bootstore-config
18642024-12-21T01:40:09.103ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
18652024-12-21T01:40:09.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45214 req_id = 049e5050-5da7-4f81-a187-28fd56a89830 response_code = 204 uri = /eip-gateways
18662024-12-21T01:40:09.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45214 req_id = bbbe718e-8fe3-4458-a25c-e283f43d8327 response_code = 204 uri = /vpc-routes
18672024-12-21T01:40:09.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62995
18682024-12-21T01:40:09.233ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18692024-12-21T01:40:09.272ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18702024-12-21T01:40:09.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62995 req_id = 4649afe0-d789-49e8-b0cc-a6550d5306d9 response_code = 204 uri = /switch-ports
18712024-12-21T01:40:09.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62995 req_id = 92f93eee-83bb-418e-96a9-1812432c16ee response_code = 200 uri = /network-bootstore-config
18722024-12-21T01:40:19.826ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8143 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 1032bbc7-17f6-4571-bb11-da4167d911c4 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
18732024-12-21T01:40:24.897ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58698
18742024-12-21T01:40:24.898ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58698 req_id = 53459f37-b951-49e3-8e2a-ee18f759f07f response_code = 200 uri = /baseboard
18752024-12-21T01:40:38.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39351
18762024-12-21T01:40:38.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39351 req_id = deabd614-03c1-423d-b0de-a87ed81b0fdf response_code = 200 uri = /vpc-routes
18772024-12-21T01:40:38.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50144
18782024-12-21T01:40:38.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50144 req_id = 542d6790-003e-47c8-aadb-5406b2e1084c response_code = 200 uri = /vpc-routes
18792024-12-21T01:40:38.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
18802024-12-21T01:40:38.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50144 req_id = 46daa076-f783-45e1-b740-65b3928faded response_code = 204 uri = /eip-gateways
18812024-12-21T01:40:38.763ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
18822024-12-21T01:40:38.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39351 req_id = b67ff6ba-f3c3-4b9b-81e3-d83d4f11b34a response_code = 204 uri = /eip-gateways
18832024-12-21T01:40:38.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50144 req_id = ad680c82-8801-454c-9a62-a85c444658a4 response_code = 204 uri = /vpc-routes
18842024-12-21T01:40:38.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39351 req_id = 2abe0a0d-cf7f-4d92-b1b7-6c046ee78542 response_code = 204 uri = /vpc-routes
18852024-12-21T01:40:38.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52073
18862024-12-21T01:40:38.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52073 req_id = 7a71c36e-b179-4517-ae7e-639e6bd33572 response_code = 200 uri = /v2p
18872024-12-21T01:40:39.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41575
18882024-12-21T01:40:39.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41575 req_id = 3b108d60-d93e-43c7-bf5d-779cbf3e67cb response_code = 200 uri = /v2p
18892024-12-21T01:40:39.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47195
18902024-12-21T01:40:39.055ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18912024-12-21T01:40:39.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18922024-12-21T01:40:39.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47195 req_id = e500eccc-c55a-4c09-9783-208c77a35919 response_code = 204 uri = /switch-ports
18932024-12-21T01:40:39.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54768
18942024-12-21T01:40:39.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51914
18952024-12-21T01:40:39.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54768 req_id = 0c7219d2-4ab0-494c-943c-0763a01b1f52 response_code = 200 uri = /vpc-routes
18962024-12-21T01:40:39.159ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18972024-12-21T01:40:39.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47195 req_id = c4bbb948-396d-4d1f-8b90-2d75655d3351 response_code = 200 uri = /network-bootstore-config
18982024-12-21T01:40:39.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64332
18992024-12-21T01:40:39.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64332 req_id = 45cfe52d-a935-47be-865c-a188c8a35c7e response_code = 200 uri = /v2p
19002024-12-21T01:40:39.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19012024-12-21T01:40:39.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19022024-12-21T01:40:39.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54768 req_id = 20f52080-3ca1-4928-9274-ef0b0bf77adb response_code = 204 uri = /eip-gateways
19032024-12-21T01:40:39.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54768 req_id = 77117556-91bd-40eb-ae5a-822e6630df1a response_code = 204 uri = /vpc-routes
19042024-12-21T01:40:39.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51914 req_id = 57052481-3cdd-4f8c-b037-80ea3c4029f3 response_code = 204 uri = /switch-ports
19052024-12-21T01:40:39.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51914 req_id = fa6a8ae0-f669-4eac-b56c-b0839e74ae3e response_code = 200 uri = /network-bootstore-config
19062024-12-21T01:40:39.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46949
19072024-12-21T01:40:39.340ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19082024-12-21T01:40:39.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19092024-12-21T01:40:39.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94233 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46949 req_id = d71ab4b5-da65-4710-a24b-96311fcedeb1 response_code = 204 uri = /switch-ports
19102024-12-21T01:40:39.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46949 req_id = 57bc6b7f-1829-45c8-8e5d-d1ea3b0778e2 response_code = 200 uri = /network-bootstore-config
19112024-12-21T01:40:49.826ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8259 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 8ef1b172-6fb9-4fff-98cf-11205433c0c1 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
19122024-12-21T01:40:54.930ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33748
19132024-12-21T01:40:54.930ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33748 req_id = f2541d60-b889-40a0-876a-7d66edbb6e53 response_code = 200 uri = /baseboard
19142024-12-21T01:41:08.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58071
19152024-12-21T01:41:08.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58071 req_id = d66d6af1-dfa9-49d3-aa0c-d8725f7f1f02 response_code = 200 uri = /vpc-routes
19162024-12-21T01:41:08.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19172024-12-21T01:41:08.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58071 req_id = ced4188e-743e-48cf-95ec-69769050b015 response_code = 204 uri = /eip-gateways
19182024-12-21T01:41:08.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58071 req_id = 1eb8fa3a-9cfb-4831-89ec-a4302dc89f8f response_code = 204 uri = /vpc-routes
19192024-12-21T01:41:08.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49737
19202024-12-21T01:41:08.676ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19212024-12-21T01:41:08.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19222024-12-21T01:41:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49737 req_id = fce703de-ed5a-4cda-8272-99dce2e2baec response_code = 204 uri = /switch-ports
19232024-12-21T01:41:08.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62475
19242024-12-21T01:41:08.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58176
19252024-12-21T01:41:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58176 req_id = 30273b1f-2b38-49ea-8c71-6281095ff497 response_code = 200 uri = /vpc-routes
19262024-12-21T01:41:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49737 req_id = 77153332-3bd2-4eff-b804-db304d8e854a response_code = 200 uri = /network-bootstore-config
19272024-12-21T01:41:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62475 req_id = 9865b173-769d-4e01-92ad-2ae29ed3250f response_code = 200 uri = /v2p
19282024-12-21T01:41:08.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19292024-12-21T01:41:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58176 req_id = 2a9fc391-d50a-4eac-ab2d-1b2a94778cbe response_code = 204 uri = /eip-gateways
19302024-12-21T01:41:08.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58176 req_id = ed3de501-9d25-48d1-a5ef-466094bab391 response_code = 204 uri = /vpc-routes
19312024-12-21T01:41:08.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42042
19322024-12-21T01:41:08.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42042 req_id = 9d3e08fd-359a-431e-b4f0-492395048b4a response_code = 200 uri = /v2p
19332024-12-21T01:41:08.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59115
19342024-12-21T01:41:08.886ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19352024-12-21T01:41:08.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19362024-12-21T01:41:08.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102196 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59115 req_id = 1a5e9fde-6ff7-4d2b-91ca-b1c1191407e5 response_code = 204 uri = /switch-ports
19372024-12-21T01:41:08.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59115 req_id = 5e99d7b1-b9d9-41fa-ad01-87d1654b717f response_code = 200 uri = /network-bootstore-config
19382024-12-21T01:41:09.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57496
19392024-12-21T01:41:09.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57496 req_id = 96e3efb1-4fb7-444d-b54d-83334059ae6b response_code = 200 uri = /vpc-routes
19402024-12-21T01:41:09.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19412024-12-21T01:41:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57496 req_id = 8240547f-e239-4dff-91af-60a6439dabe4 response_code = 204 uri = /eip-gateways
19422024-12-21T01:41:09.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57496 req_id = 22d1595f-436c-4382-b1c8-437d4b5d0e3c response_code = 204 uri = /vpc-routes
19432024-12-21T01:41:09.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51055
19442024-12-21T01:41:09.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51055 req_id = 86c99919-5d1e-4880-a947-373aa0741028 response_code = 200 uri = /v2p
19452024-12-21T01:41:09.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54783
19462024-12-21T01:41:09.361ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19472024-12-21T01:41:09.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19482024-12-21T01:41:09.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93499 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54783 req_id = 61d958ff-6613-4472-81a2-14259a4f79bd response_code = 204 uri = /switch-ports
19492024-12-21T01:41:09.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54783 req_id = 7674816f-dac3-4bc1-b67e-fd48e05880a7 response_code = 200 uri = /network-bootstore-config
19502024-12-21T01:41:19.827ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8241 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 7a8e73cb-3771-4b58-999f-41ac3be8652b response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
19512024-12-21T01:41:24.964ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38662
19522024-12-21T01:41:24.964ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38662 req_id = 1366e27f-51bd-4450-a7f4-66ff3581b105 response_code = 200 uri = /baseboard
19532024-12-21T01:41:38.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39376
19542024-12-21T01:41:38.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39376 req_id = 87e5bad6-b58c-4c99-bfee-b775d5f9eb51 response_code = 200 uri = /vpc-routes
19552024-12-21T01:41:38.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19562024-12-21T01:41:38.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39376 req_id = 54345cab-2e28-4660-ad9d-2aa928039417 response_code = 204 uri = /eip-gateways
19572024-12-21T01:41:38.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39376 req_id = 12003dda-cbe8-44bf-91c4-33b10146ec0f response_code = 204 uri = /vpc-routes
19582024-12-21T01:41:38.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38284
19592024-12-21T01:41:38.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38284 req_id = 14fe0a59-b683-4ae6-a9b0-86eb8137720e response_code = 200 uri = /vpc-routes
19602024-12-21T01:41:38.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19612024-12-21T01:41:38.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38284 req_id = 3935f17f-b516-4e47-ac1a-cb1051e8580e response_code = 204 uri = /eip-gateways
19622024-12-21T01:41:38.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38284 req_id = 9b24e6cb-69dc-4dfd-9fbd-01e2738b1e8d response_code = 204 uri = /vpc-routes
19632024-12-21T01:41:38.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63022
19642024-12-21T01:41:38.886ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19652024-12-21T01:41:38.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19662024-12-21T01:41:38.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63022 req_id = 93cf69d0-073c-4158-9fa5-ece8fc21a773 response_code = 204 uri = /switch-ports
19672024-12-21T01:41:38.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37622
19682024-12-21T01:41:38.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63417
19692024-12-21T01:41:38.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63417 req_id = 3fd4cc77-ae03-4b3d-97c0-d7d613172c91 response_code = 200 uri = /v2p
19702024-12-21T01:41:38.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63022 req_id = 732329db-2e71-4792-8762-81c002a2b9ad response_code = 200 uri = /network-bootstore-config
19712024-12-21T01:41:38.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37622 req_id = 540ea278-df69-4d6d-87d3-e809aa7e6efb response_code = 200 uri = /v2p
19722024-12-21T01:41:39.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53439
19732024-12-21T01:41:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53439 req_id = aa5bd302-1e25-4a84-a71c-21136d5abee7 response_code = 200 uri = /vpc-routes
19742024-12-21T01:41:39.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38175
19752024-12-21T01:41:39.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19762024-12-21T01:41:39.136ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19772024-12-21T01:41:39.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38175 req_id = da8a8e6d-82f1-476d-b77d-189ad4afb708 response_code = 204 uri = /switch-ports
19782024-12-21T01:41:39.192ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19792024-12-21T01:41:39.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51851
19802024-12-21T01:41:39.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53439 req_id = cc932a5c-3fcb-4ffb-b72a-291b0fa26c77 response_code = 204 uri = /eip-gateways
19812024-12-21T01:41:39.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38175 req_id = be57ba34-1f6c-47f7-bf5b-d8c40cbf8a45 response_code = 200 uri = /network-bootstore-config
19822024-12-21T01:41:39.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51851 req_id = a59cb212-b4bb-416e-a41c-f669040a45ee response_code = 200 uri = /v2p
19832024-12-21T01:41:39.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53439 req_id = 400da33d-866a-431f-aa4f-b65b56a273d4 response_code = 204 uri = /vpc-routes
19842024-12-21T01:41:39.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48302
19852024-12-21T01:41:39.275ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19862024-12-21T01:41:39.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19872024-12-21T01:41:39.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48302 req_id = be0f7efe-cab0-4484-b762-23d9be66983e response_code = 204 uri = /switch-ports
19882024-12-21T01:41:39.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48302 req_id = 41f0789f-e2e5-4701-9dea-2eab8f1bd5e1 response_code = 200 uri = /network-bootstore-config
19892024-12-21T01:41:45.291ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19902024-12-21T01:41:49.826ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7382 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 36de0b3b-cf81-407e-a83d-83d083ac63fb response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
19912024-12-21T01:41:54.996ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57140
19922024-12-21T01:41:54.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57140 req_id = fe6a2882-8477-45e5-b0e7-d83c801803e4 response_code = 200 uri = /baseboard
19932024-12-21T01:42:08.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49490
19942024-12-21T01:42:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49490 req_id = 099fd403-9d9f-4ac2-8436-e2f8f843ff0d response_code = 200 uri = /vpc-routes
19952024-12-21T01:42:08.660ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
19962024-12-21T01:42:08.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49490 req_id = 344abf9e-978e-499b-ab66-8990df68b5fe response_code = 204 uri = /eip-gateways
19972024-12-21T01:42:08.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49490 req_id = 7a7597ac-9553-4f3a-ad1d-3dba6022f227 response_code = 204 uri = /vpc-routes
19982024-12-21T01:42:08.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51490
19992024-12-21T01:42:08.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51490 req_id = 70890f29-da59-4af8-92e8-8ed7515a1414 response_code = 200 uri = /vpc-routes
20002024-12-21T01:42:08.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64797
20012024-12-21T01:42:08.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20022024-12-21T01:42:08.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20032024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64797 req_id = c6ead39e-ccb0-4f60-9d16-c72bcaf82676 response_code = 204 uri = /switch-ports
20042024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37408
20052024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63502
20062024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40500
20072024-12-21T01:42:08.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20082024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51490 req_id = d95db06a-d3c1-4d39-b0eb-c918b651b08a response_code = 204 uri = /eip-gateways
20092024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64797 req_id = 9138d533-f803-4f51-a399-42143a1a5dce response_code = 200 uri = /network-bootstore-config
20102024-12-21T01:42:08.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40500 req_id = e4659028-3c08-41e5-8cea-8fb575c0de57 response_code = 200 uri = /v2p
20112024-12-21T01:42:08.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37408 req_id = 48d4cf8e-5045-45cb-b123-01ce6eeca2ef response_code = 200 uri = /v2p
20122024-12-21T01:42:08.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20132024-12-21T01:42:08.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 968 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51490 req_id = 938d7dbc-fcc5-402d-a88d-cbddce85668d response_code = 204 uri = /vpc-routes
20142024-12-21T01:42:08.999ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20152024-12-21T01:42:09.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51525
20162024-12-21T01:42:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51525 req_id = 7b2e6aba-5ec7-4dac-8c5f-1bc38ef9fac8 response_code = 200 uri = /vpc-routes
20172024-12-21T01:42:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63502 req_id = 18d33a46-b869-4bf1-bdf8-a4be64075b48 response_code = 204 uri = /switch-ports
20182024-12-21T01:42:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63502 req_id = 4c58825d-2300-4182-8fb8-349e95bdeb7f response_code = 200 uri = /network-bootstore-config
20192024-12-21T01:42:09.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20202024-12-21T01:42:09.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51525 req_id = 1d29481c-8e7f-4a51-9379-c9f280e072ea response_code = 204 uri = /eip-gateways
20212024-12-21T01:42:09.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64236
20222024-12-21T01:42:09.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64236 req_id = a79898b7-9f42-4820-9b9d-6c48b3ee9fc5 response_code = 200 uri = /v2p
20232024-12-21T01:42:09.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51525 req_id = 2f0ed06a-f34e-40ea-9b5f-095c72f5ccaa response_code = 204 uri = /vpc-routes
20242024-12-21T01:42:09.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47754
20252024-12-21T01:42:09.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20262024-12-21T01:42:09.189ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20272024-12-21T01:42:09.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47754 req_id = b24d848a-267f-4148-b98d-ce69ef1bbae4 response_code = 204 uri = /switch-ports
20282024-12-21T01:42:09.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47754 req_id = 8e0b2034-40ba-4261-ba34-db1b029eb260 response_code = 200 uri = /network-bootstore-config
20292024-12-21T01:42:19.826ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7464 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 6abf436c-b078-4f05-90ce-84394a15b5bf response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
20302024-12-21T01:42:25.028ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56043
20312024-12-21T01:42:25.029ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56043 req_id = dfca4cda-ddd0-4fef-8112-ecb400a705ae response_code = 200 uri = /baseboard
20322024-12-21T01:42:38.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49052
20332024-12-21T01:42:38.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49052 req_id = eff0fc83-5752-4cbb-b73b-915b9a814c16 response_code = 200 uri = /vpc-routes
20342024-12-21T01:42:38.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20352024-12-21T01:42:38.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49052 req_id = 02045934-5e5a-4711-9889-9d657c9e5bb0 response_code = 204 uri = /eip-gateways
20362024-12-21T01:42:38.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55223
20372024-12-21T01:42:38.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55223 req_id = 255eb954-9eca-4c0b-a1fd-4a1a6d0af77d response_code = 200 uri = /v2p
20382024-12-21T01:42:38.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49052 req_id = d3200778-0e88-4910-842d-20adaa3dfb0c response_code = 204 uri = /vpc-routes
20392024-12-21T01:42:38.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64512
20402024-12-21T01:42:38.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20412024-12-21T01:42:38.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20422024-12-21T01:42:39.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64512 req_id = d629debe-c29e-41c6-8570-e2ad6795d051 response_code = 204 uri = /switch-ports
20432024-12-21T01:42:39.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55999
20442024-12-21T01:42:39.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55944
20452024-12-21T01:42:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64512 req_id = 2007592d-0f3b-46fd-a577-c5b0ced8b31d response_code = 200 uri = /network-bootstore-config
20462024-12-21T01:42:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55999 req_id = 62cad7c8-79bc-4cea-ac0b-1935a43e1749 response_code = 200 uri = /vpc-routes
20472024-12-21T01:42:39.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55944 req_id = b960165b-f2c1-4f22-86ff-a7f3ca392893 response_code = 200 uri = /v2p
20482024-12-21T01:42:39.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20492024-12-21T01:42:39.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55999 req_id = e8d9933d-82d2-4055-8a63-6f0c4329f5e4 response_code = 204 uri = /eip-gateways
20502024-12-21T01:42:39.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55999 req_id = c6592d43-309d-4775-8ad9-f7bda645fc96 response_code = 204 uri = /vpc-routes
20512024-12-21T01:42:39.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42002
20522024-12-21T01:42:39.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20532024-12-21T01:42:39.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20542024-12-21T01:42:39.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42002 req_id = 34ae1dc5-20cf-4e57-a285-203639cdff4b response_code = 204 uri = /switch-ports
20552024-12-21T01:42:39.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52337
20562024-12-21T01:42:39.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52337 req_id = f7cea26f-de6f-4310-b694-77faeff0e051 response_code = 200 uri = /vpc-routes
20572024-12-21T01:42:39.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42002 req_id = cc5b75c9-3c8e-41cc-9da3-a25e97650f4e response_code = 200 uri = /network-bootstore-config
20582024-12-21T01:42:39.192ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20592024-12-21T01:42:39.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52337 req_id = 51386d79-affc-42bc-bb61-16e54b6aed78 response_code = 204 uri = /eip-gateways
20602024-12-21T01:42:39.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52337 req_id = 168fe824-488f-4965-b976-8c64f9ea170e response_code = 204 uri = /vpc-routes
20612024-12-21T01:42:39.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60172
20622024-12-21T01:42:39.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60172 req_id = ebd12c92-c3d6-4d67-978e-087960ad8824 response_code = 200 uri = /v2p
20632024-12-21T01:42:39.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52895
20642024-12-21T01:42:39.447ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20652024-12-21T01:42:39.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20662024-12-21T01:42:39.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52895 req_id = 1ae34622-9fbf-4f6e-8113-81cee9892d46 response_code = 204 uri = /switch-ports
20672024-12-21T01:42:39.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52895 req_id = 1406cab1-071e-4b3e-adf2-cfd31f89a946 response_code = 200 uri = /network-bootstore-config
20682024-12-21T01:42:49.827ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6854 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 3425a85a-6876-4fc3-9a68-1172ffeb5264 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
20692024-12-21T01:42:55.063ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50630
20702024-12-21T01:42:55.063ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50630 req_id = 4920b452-afd7-4918-9ca2-7af945a7c19e response_code = 200 uri = /baseboard
20712024-12-21T01:43:08.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34453
20722024-12-21T01:43:08.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34453 req_id = f25917ff-277a-4d83-96c4-2cc6b910477c response_code = 200 uri = /vpc-routes
20732024-12-21T01:43:08.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20742024-12-21T01:43:08.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34453 req_id = 2e45a7db-386e-41d6-aeb2-49f43d159ff0 response_code = 204 uri = /eip-gateways
20752024-12-21T01:43:08.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47371
20762024-12-21T01:43:08.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47371 req_id = 0a80964b-e8d1-49ca-846a-983132049363 response_code = 200 uri = /v2p
20772024-12-21T01:43:08.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34453 req_id = a559f214-c820-42e0-8c51-2a0a02398d88 response_code = 204 uri = /vpc-routes
20782024-12-21T01:43:08.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40909
20792024-12-21T01:43:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40909 req_id = ee6ee9c6-43c4-4601-8a02-8d12db2c05d5 response_code = 200 uri = /vpc-routes
20802024-12-21T01:43:08.693ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20812024-12-21T01:43:08.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40909 req_id = e3b4b75c-022f-451f-9436-0a9ba56ec2f8 response_code = 204 uri = /eip-gateways
20822024-12-21T01:43:08.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45973
20832024-12-21T01:43:08.695ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20842024-12-21T01:43:08.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20852024-12-21T01:43:08.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45973 req_id = ab739fb9-cb5d-4efe-99af-7b4071e4b453 response_code = 204 uri = /switch-ports
20862024-12-21T01:43:08.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52287
20872024-12-21T01:43:08.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40909 req_id = e9fcfa1b-6b1c-467f-8008-33fa9cf69cfb response_code = 204 uri = /vpc-routes
20882024-12-21T01:43:08.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45973 req_id = 55108cbb-4a9d-4c13-b481-b11eb45ecb00 response_code = 200 uri = /network-bootstore-config
20892024-12-21T01:43:08.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52287 req_id = bb3bb814-f90d-4721-a7fb-6e940ff02d31 response_code = 200 uri = /v2p
20902024-12-21T01:43:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44971
20912024-12-21T01:43:08.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20922024-12-21T01:43:08.834ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20932024-12-21T01:43:08.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119414 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44971 req_id = 40b7897f-40fb-4a1e-93a9-e93add6d893b response_code = 204 uri = /switch-ports
20942024-12-21T01:43:08.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44971 req_id = 33c1b1bf-8447-481f-bd51-36c66a7ade9c response_code = 200 uri = /network-bootstore-config
20952024-12-21T01:43:08.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56689
20962024-12-21T01:43:08.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56689 req_id = 3095392a-a311-4f63-a45c-3be354028592 response_code = 200 uri = /vpc-routes
20972024-12-21T01:43:09.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
20982024-12-21T01:43:09.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56689 req_id = 30e49178-7724-461a-82f7-4e3fb5932597 response_code = 204 uri = /eip-gateways
20992024-12-21T01:43:09.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56689 req_id = 4e1906cc-27be-42f6-b515-a7d486f49f9a response_code = 204 uri = /vpc-routes
21002024-12-21T01:43:09.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45077
21012024-12-21T01:43:09.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45077 req_id = 549037d2-fb88-4e91-b1ad-c6504fb4ee22 response_code = 200 uri = /v2p
21022024-12-21T01:43:09.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64800
21032024-12-21T01:43:09.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21042024-12-21T01:43:09.221ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21052024-12-21T01:43:09.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64800 req_id = da16ac2b-dd9c-4fab-a636-7b419d9e711f response_code = 204 uri = /switch-ports
21062024-12-21T01:43:09.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64800 req_id = d68480d4-58dd-46aa-b6e5-0556564a072f response_code = 200 uri = /network-bootstore-config
21072024-12-21T01:43:19.828ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7095 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = fe7c9c09-b372-4b62-bed9-94cf96a283cb response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
21082024-12-21T01:43:25.098ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37943
21092024-12-21T01:43:25.098ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37943 req_id = 86bf36a6-e08c-4378-81dd-e76111ab6ac5 response_code = 200 uri = /baseboard
21102024-12-21T01:43:38.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37149
21112024-12-21T01:43:38.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37149 req_id = 05b1deef-fdfe-48b1-817a-1f4378cc7ca4 response_code = 200 uri = /vpc-routes
21122024-12-21T01:43:38.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
21132024-12-21T01:43:38.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37149 req_id = 3a109426-8fce-43cd-a684-0f145970c763 response_code = 204 uri = /eip-gateways
21142024-12-21T01:43:38.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64349
21152024-12-21T01:43:38.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 704a6070-b6a7-4427-8d63-e93fe70c07cb response_code = 200 uri = /vpc-routes
21162024-12-21T01:43:38.798ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
21172024-12-21T01:43:38.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 5d6d5030-7f1e-4d6a-87f5-9e77e18e73e3 response_code = 204 uri = /eip-gateways
21182024-12-21T01:43:38.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64349 req_id = fe55d1c2-9fa1-443e-922f-c8f8b7a9e53f response_code = 204 uri = /vpc-routes
21192024-12-21T01:43:38.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52769
21202024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21212024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21222024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21232024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21242024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21252024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21262024-12-21T01:43:38.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21272024-12-21T01:43:38.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52769 req_id = 16f68942-404f-4ef7-97aa-969a6f97a22d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21282024-12-21T01:43:38.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41628
21292024-12-21T01:43:38.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41628 req_id = 85b8ae50-2832-439f-a1bf-724031af2a2e response_code = 200 uri = /v2p
21302024-12-21T01:43:38.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46566
21312024-12-21T01:43:38.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21322024-12-21T01:43:39.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21332024-12-21T01:43:39.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46566 req_id = 98b36c54-f2c0-4a3c-93e7-3e955e556435 response_code = 204 uri = /switch-ports
21342024-12-21T01:43:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55641
21352024-12-21T01:43:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38826
21362024-12-21T01:43:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64028
21372024-12-21T01:43:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46566 req_id = 15d54723-a285-4f11-b255-b3bbef27a03a response_code = 200 uri = /network-bootstore-config
21382024-12-21T01:43:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55641 req_id = df68cec7-e217-4209-8b93-8a1a37bbbf28 response_code = 200 uri = /v2p
21392024-12-21T01:43:39.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21402024-12-21T01:43:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 748 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37149 req_id = cf699841-5e38-42f7-bc42-ccb1a6171609 response_code = 204 uri = /vpc-routes
21412024-12-21T01:43:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64028 req_id = b1624c8a-2450-47c4-a43d-025b2b513b42 response_code = 200 uri = /vpc-routes
21422024-12-21T01:43:39.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21432024-12-21T01:43:39.172ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
21442024-12-21T01:43:39.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 721 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64028 req_id = a47f84fe-1a88-48fd-ac69-931b5d98a4c0 response_code = 204 uri = /eip-gateways
21452024-12-21T01:43:39.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64028 req_id = b65da14f-76d0-4e37-b91b-50a6307f16d0 response_code = 204 uri = /vpc-routes
21462024-12-21T01:43:39.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56179
21472024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21482024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21492024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21502024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21512024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21522024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21532024-12-21T01:43:39.221ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21542024-12-21T01:43:39.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56179 req_id = db181b61-ef6a-4198-ac53-3b6f93e73171 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21552024-12-21T01:43:39.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38826 req_id = 82454338-981c-4923-99c8-4d4be9055426 response_code = 204 uri = /switch-ports
21562024-12-21T01:43:39.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38826 req_id = a874cca6-6af1-4790-b1fe-0d2280bf89b5 response_code = 200 uri = /network-bootstore-config
21572024-12-21T01:43:39.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63134
21582024-12-21T01:43:39.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63134 req_id = 854531ff-9926-4b95-945b-19d8a7fdabbd response_code = 200 uri = /v2p
21592024-12-21T01:43:39.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47132
21602024-12-21T01:43:39.361ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21612024-12-21T01:43:39.399ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21622024-12-21T01:43:39.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94186 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47132 req_id = d101c7e5-15c3-4954-8509-c6510ae1ba0a response_code = 204 uri = /switch-ports
21632024-12-21T01:43:39.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47132 req_id = e3058602-95c1-4694-b824-720f13f7636e response_code = 200 uri = /network-bootstore-config
21642024-12-21T01:43:39.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44344
21652024-12-21T01:43:39.573ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21662024-12-21T01:43:39.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21672024-12-21T01:43:39.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21682024-12-21T01:43:39.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21692024-12-21T01:43:39.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21702024-12-21T01:43:39.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21712024-12-21T01:43:39.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21722024-12-21T01:43:39.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44344 req_id = f9b7ae4f-39f8-4b72-bc6f-8f95dc26f76d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21732024-12-21T01:43:49.829ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7371 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = af626a29-0dd2-4bf4-9b87-4ff86d18c794 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
21742024-12-21T01:43:55.132ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57378
21752024-12-21T01:43:55.132ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57378 req_id = 197be6e1-e142-4f2c-a6c9-1ad978655572 response_code = 200 uri = /baseboard
21762024-12-21T01:44:08.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50042
21772024-12-21T01:44:08.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50042 req_id = b0a05f3e-0208-4f3c-ba82-7ed47da760b9 response_code = 200 uri = /vpc-routes
21782024-12-21T01:44:08.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
21792024-12-21T01:44:08.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50042 req_id = ac173f39-4dad-48bc-8052-99be6abd040c response_code = 204 uri = /eip-gateways
21802024-12-21T01:44:08.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50042 req_id = beb6ae87-82d7-4af6-9081-3d2955b8c265 response_code = 204 uri = /vpc-routes
21812024-12-21T01:44:08.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39780
21822024-12-21T01:44:08.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39780 req_id = cc181dcc-6224-414c-a477-88682ff23107 response_code = 200 uri = /vpc-routes
21832024-12-21T01:44:08.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
21842024-12-21T01:44:08.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39780 req_id = ce0a3390-0b34-42c5-b10b-cc274a9d023c response_code = 204 uri = /eip-gateways
21852024-12-21T01:44:08.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43081
21862024-12-21T01:44:08.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43081 req_id = ff137c7f-f005-47aa-bafa-0b1f1b67ba69 response_code = 200 uri = /v2p
21872024-12-21T01:44:08.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39780 req_id = 394aebc4-78bc-4f76-b849-543b61d6cb83 response_code = 204 uri = /vpc-routes
21882024-12-21T01:44:08.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52535
21892024-12-21T01:44:08.685ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21902024-12-21T01:44:08.723ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21912024-12-21T01:44:08.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52535 req_id = 64c5fbc7-4134-4d61-a763-c569b3a97e08 response_code = 204 uri = /switch-ports
21922024-12-21T01:44:08.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52535 req_id = 438c2a03-94c5-4d90-a8a2-608e3e6ba6ad response_code = 200 uri = /network-bootstore-config
21932024-12-21T01:44:08.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55766
21942024-12-21T01:44:08.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55766 req_id = d8a4d0ae-3e6d-4eb1-9fbc-5089afc8d23b response_code = 200 uri = /v2p
21952024-12-21T01:44:08.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44791
21962024-12-21T01:44:08.834ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21972024-12-21T01:44:08.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21982024-12-21T01:44:08.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44791 req_id = 555184a9-a95a-4e31-8540-a9d6681bd8f6 response_code = 204 uri = /switch-ports
21992024-12-21T01:44:08.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44791 req_id = 3e4e214c-ccb5-4db5-b74a-fab3cd1edb5b response_code = 200 uri = /network-bootstore-config
22002024-12-21T01:44:09.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46044
22012024-12-21T01:44:09.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46044 req_id = 9d26c408-4b82-44a9-bcf7-ea7b51fa0659 response_code = 200 uri = /vpc-routes
22022024-12-21T01:44:09.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22032024-12-21T01:44:09.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46044 req_id = d1a667d5-dad8-4fe3-b85a-96c00d6adef8 response_code = 204 uri = /eip-gateways
22042024-12-21T01:44:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46044 req_id = 20f350c6-7a0f-4deb-9e51-7b51b8a97a80 response_code = 204 uri = /vpc-routes
22052024-12-21T01:44:09.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45542
22062024-12-21T01:44:09.132ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22072024-12-21T01:44:09.171ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22082024-12-21T01:44:09.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45542 req_id = 474e4522-42cd-4d3b-ad4d-c1a9dd2112cf response_code = 204 uri = /switch-ports
22092024-12-21T01:44:09.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39229
22102024-12-21T01:44:09.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45542 req_id = a6f914d7-f38c-4fa9-b485-121994b7a766 response_code = 200 uri = /network-bootstore-config
22112024-12-21T01:44:09.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39229 req_id = 58130991-9dea-49fb-983c-974a264c704b response_code = 200 uri = /v2p
22122024-12-21T01:44:19.829ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8223 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 52bd34c7-394c-4b26-a59e-568916d382aa response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
22132024-12-21T01:44:25.165ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33119
22142024-12-21T01:44:25.165ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33119 req_id = 1e57d8ce-6294-4f81-80b5-c425e50503ad response_code = 200 uri = /baseboard
22152024-12-21T01:44:38.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42259
22162024-12-21T01:44:38.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37927
22172024-12-21T01:44:38.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37927 req_id = a7e78f43-f12d-4fc6-930e-beeaf2101f14 response_code = 200 uri = /vpc-routes
22182024-12-21T01:44:38.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42259 req_id = 6f092748-18f3-4259-bd48-66138900c801 response_code = 200 uri = /vpc-routes
22192024-12-21T01:44:38.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22202024-12-21T01:44:38.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42259 req_id = 6f5f6af8-827a-4287-a684-a6ef4226f39c response_code = 204 uri = /eip-gateways
22212024-12-21T01:44:38.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62381
22222024-12-21T01:44:38.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62381 req_id = 09fe8fae-eacd-4d66-9815-821c15a74ceb response_code = 200 uri = /v2p
22232024-12-21T01:44:38.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42259 req_id = 0c4a8135-bb92-47d8-92ae-daeecaaa2e78 response_code = 204 uri = /vpc-routes
22242024-12-21T01:44:39.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22252024-12-21T01:44:39.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37927 req_id = fa342ce7-ff84-4975-bec2-514ed83a2756 response_code = 204 uri = /eip-gateways
22262024-12-21T01:44:39.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37927 req_id = 8818128c-8b2f-4d90-8ca3-cee46a2932f3 response_code = 204 uri = /vpc-routes
22272024-12-21T01:44:39.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35815
22282024-12-21T01:44:39.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22292024-12-21T01:44:39.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22302024-12-21T01:44:39.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35815 req_id = 13bce7d3-7164-499a-b709-beb4f208faab response_code = 204 uri = /switch-ports
22312024-12-21T01:44:39.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64257
22322024-12-21T01:44:39.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49142
22332024-12-21T01:44:39.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39985
22342024-12-21T01:44:39.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39985 req_id = e4e3ca78-16f6-45d0-9d73-4aec932b3523 response_code = 200 uri = /vpc-routes
22352024-12-21T01:44:39.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35815 req_id = 35f4b707-4f25-4a19-8afe-01a07ef96316 response_code = 200 uri = /network-bootstore-config
22362024-12-21T01:44:39.153ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22372024-12-21T01:44:39.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64257 req_id = f59af0fb-690a-4a15-9e13-80b691a775a7 response_code = 200 uri = /v2p
22382024-12-21T01:44:39.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22392024-12-21T01:44:39.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93834 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49142 req_id = 3cf485a0-f388-4a77-8560-3629a539e100 response_code = 204 uri = /switch-ports
22402024-12-21T01:44:39.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49142 req_id = bc31ee6c-19b4-4426-beb7-661fd62639df response_code = 200 uri = /network-bootstore-config
22412024-12-21T01:44:39.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64306
22422024-12-21T01:44:39.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64306 req_id = 3072608a-885a-4558-ac8d-ef92cb6371d1 response_code = 200 uri = /v2p
22432024-12-21T01:44:39.300ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22442024-12-21T01:44:39.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39985 req_id = 6baec71b-f1bb-4744-a74d-547f45476a82 response_code = 204 uri = /eip-gateways
22452024-12-21T01:44:39.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39985 req_id = 2a2a9581-48b0-421a-866d-105ec66968c7 response_code = 204 uri = /vpc-routes
22462024-12-21T01:44:39.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36143
22472024-12-21T01:44:39.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22482024-12-21T01:44:39.434ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22492024-12-21T01:44:39.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95882 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36143 req_id = 0d53c4c4-9e38-45ba-a1e6-53ca1b35b52a response_code = 204 uri = /switch-ports
22502024-12-21T01:44:39.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36143 req_id = 014a0286-0329-4018-856f-d78b7b0cc873 response_code = 200 uri = /network-bootstore-config
22512024-12-21T01:44:49.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8301 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 8fdf81f2-bc53-4efd-a596-99a5567b575b response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
22522024-12-21T01:44:55.198ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42992
22532024-12-21T01:44:55.199ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42992 req_id = ac6f96c6-cde6-4265-a034-e0b35720d2f4 response_code = 200 uri = /baseboard
22542024-12-21T01:45:08.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54910
22552024-12-21T01:45:08.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54910 req_id = 0e911823-471a-4a7f-ba4e-40fcb79ccaac response_code = 200 uri = /vpc-routes
22562024-12-21T01:45:08.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22572024-12-21T01:45:08.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54910 req_id = 613acb5e-d57e-4f2a-90c0-a2b3404ffb6a response_code = 204 uri = /eip-gateways
22582024-12-21T01:45:08.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54910 req_id = cb4b7528-e7a0-439b-9906-714f91c24440 response_code = 204 uri = /vpc-routes
22592024-12-21T01:45:08.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64431
22602024-12-21T01:45:08.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64431 req_id = 8bb0ba01-4119-48a5-a783-77f973d0f251 response_code = 200 uri = /v2p
22612024-12-21T01:45:08.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56497
22622024-12-21T01:45:08.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22632024-12-21T01:45:08.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22642024-12-21T01:45:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56497 req_id = 559342fb-8feb-43b5-8892-e3d2ada2c745 response_code = 204 uri = /switch-ports
22652024-12-21T01:45:08.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48168
22662024-12-21T01:45:08.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34520
22672024-12-21T01:45:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56497 req_id = 55751ecd-45a2-4210-af89-540280aac005 response_code = 200 uri = /network-bootstore-config
22682024-12-21T01:45:08.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34520 req_id = 43b7345c-d49a-489a-9a7c-a4a411a06c1a response_code = 200 uri = /vpc-routes
22692024-12-21T01:45:08.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48168 req_id = 0dbc6b2c-b292-4c1c-a8aa-ffa58591ac56 response_code = 200 uri = /v2p
22702024-12-21T01:45:08.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53078
22712024-12-21T01:45:08.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22722024-12-21T01:45:08.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22732024-12-21T01:45:08.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53078 req_id = f37b4329-2039-4831-91ff-4f4bd0564c45 response_code = 204 uri = /switch-ports
22742024-12-21T01:45:08.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22752024-12-21T01:45:08.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34520 req_id = 4e0d67e0-f166-4608-ad57-936c02b0437e response_code = 204 uri = /eip-gateways
22762024-12-21T01:45:08.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53078 req_id = 95d3c2fe-cfec-482f-8857-2c62dac5c613 response_code = 200 uri = /network-bootstore-config
22772024-12-21T01:45:08.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34520 req_id = 7214b39b-9881-4741-98bf-5808294aebd9 response_code = 204 uri = /vpc-routes
22782024-12-21T01:45:08.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39123
22792024-12-21T01:45:08.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39123 req_id = 989af87a-6ac5-4f37-a4a9-f58b9fd29173 response_code = 200 uri = /vpc-routes
22802024-12-21T01:45:09.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22812024-12-21T01:45:09.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39123 req_id = 03b2406b-97d0-4df0-b15e-426012dd10b3 response_code = 204 uri = /eip-gateways
22822024-12-21T01:45:09.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39123 req_id = e00f496f-a4cd-4828-940e-b1edb1433d9e response_code = 204 uri = /vpc-routes
22832024-12-21T01:45:09.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44249
22842024-12-21T01:45:09.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44249 req_id = 46e2cdd5-04b2-4786-a165-e0621ed074ed response_code = 200 uri = /v2p
22852024-12-21T01:45:09.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35972
22862024-12-21T01:45:09.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22872024-12-21T01:45:09.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22882024-12-21T01:45:09.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87517 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35972 req_id = 8408eab6-2e47-4ff6-be5c-4ec9a61d3b4b response_code = 204 uri = /switch-ports
22892024-12-21T01:45:09.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35972 req_id = 4659e3d1-e465-4847-b5f8-9eee7be069e6 response_code = 200 uri = /network-bootstore-config
22902024-12-21T01:45:19.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7726 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 1624a557-cb19-4273-8ac7-5a5de634a769 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
22912024-12-21T01:45:25.230ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44639
22922024-12-21T01:45:25.230ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44639 req_id = d1fb894b-10d2-4371-877c-6b70cbfc178d response_code = 200 uri = /baseboard
22932024-12-21T01:45:38.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53092
22942024-12-21T01:45:38.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53092 req_id = f6edbdb9-c113-4ff6-8d00-3dce6123e5ac response_code = 200 uri = /vpc-routes
22952024-12-21T01:45:38.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
22962024-12-21T01:45:38.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53092 req_id = 4f313276-1852-45a1-86a8-ae9fbd9c087d response_code = 204 uri = /eip-gateways
22972024-12-21T01:45:38.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53092 req_id = 4fa961a3-d27c-48de-a718-f5af939e8d34 response_code = 204 uri = /vpc-routes
22982024-12-21T01:45:38.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54668
22992024-12-21T01:45:38.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54668 req_id = 4b89ffb4-5a32-4cce-b2a9-9dd9262c43b4 response_code = 200 uri = /vpc-routes
23002024-12-21T01:45:38.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60260
23012024-12-21T01:45:38.899ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23022024-12-21T01:45:38.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23032024-12-21T01:45:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129937 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60260 req_id = 0015d755-14ff-49df-95bc-c57892d24769 response_code = 204 uri = /switch-ports
23042024-12-21T01:45:39.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38564
23052024-12-21T01:45:39.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23062024-12-21T01:45:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54668 req_id = 743dfb48-9506-4fbd-8186-4a0639e5203d response_code = 204 uri = /eip-gateways
23072024-12-21T01:45:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60260 req_id = 010dbb8d-980e-4fcb-a47e-2489c2eca830 response_code = 200 uri = /network-bootstore-config
23082024-12-21T01:45:39.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38564 req_id = 0bbb0513-c7bc-49c6-b88a-c6c4fea30d9e response_code = 200 uri = /v2p
23092024-12-21T01:45:39.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40435
23102024-12-21T01:45:39.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40435 req_id = ac596a9c-babd-4e63-8a4e-28cab9ea0479 response_code = 200 uri = /v2p
23112024-12-21T01:45:39.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54668 req_id = 8460769d-6bb0-47df-a8b0-9f3802454fed response_code = 204 uri = /vpc-routes
23122024-12-21T01:45:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33717
23132024-12-21T01:45:39.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23142024-12-21T01:45:39.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23152024-12-21T01:45:39.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33717 req_id = 8640d44f-251e-405c-b78d-219546027ed6 response_code = 204 uri = /switch-ports
23162024-12-21T01:45:39.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55974
23172024-12-21T01:45:39.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55974 req_id = d1c70f93-e0c1-405d-8b86-674766790769 response_code = 200 uri = /vpc-routes
23182024-12-21T01:45:39.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33717 req_id = 18d61611-4911-4965-8ac0-2154df2f5600 response_code = 200 uri = /network-bootstore-config
23192024-12-21T01:45:39.190ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23202024-12-21T01:45:39.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55974 req_id = be0b3010-6d74-461d-b9cc-84d241e08ac4 response_code = 204 uri = /eip-gateways
23212024-12-21T01:45:39.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55974 req_id = 423e58e9-33ff-4842-8cbe-e5910fff0df7 response_code = 204 uri = /vpc-routes
23222024-12-21T01:45:39.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32874
23232024-12-21T01:45:39.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32874 req_id = 6e4f85c6-0a0e-47c2-ab7f-509055581084 response_code = 200 uri = /v2p
23242024-12-21T01:45:39.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43167
23252024-12-21T01:45:39.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23262024-12-21T01:45:39.363ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23272024-12-21T01:45:39.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98975 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43167 req_id = 61e98444-ce1b-4181-910b-73af945e6a1f response_code = 204 uri = /switch-ports
23282024-12-21T01:45:39.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43167 req_id = d3a835af-0939-478b-bb30-7e0da6a246d6 response_code = 200 uri = /network-bootstore-config
23292024-12-21T01:45:49.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8044 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 692a8d12-9ffd-4be8-b616-9406a7e0097b response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
23302024-12-21T01:45:55.264ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62504
23312024-12-21T01:45:55.264ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62504 req_id = d458703f-699d-410f-83d4-ee94733e13fd response_code = 200 uri = /baseboard
23322024-12-21T01:46:08.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64533
23332024-12-21T01:46:08.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64533 req_id = 4c270ea7-4ca8-4bbc-8c29-05017c57b1a3 response_code = 200 uri = /vpc-routes
23342024-12-21T01:46:08.577ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23352024-12-21T01:46:08.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64533 req_id = 8e996955-e1fe-4fff-b7d9-91db36c73224 response_code = 204 uri = /eip-gateways
23362024-12-21T01:46:08.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54968
23372024-12-21T01:46:08.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54968 req_id = 2c5010d4-fd7a-4147-a9da-40bcf6e46929 response_code = 200 uri = /v2p
23382024-12-21T01:46:08.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64533 req_id = 5d8d8b6c-96b6-45ef-bfe2-12cec11dd249 response_code = 204 uri = /vpc-routes
23392024-12-21T01:46:08.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61589
23402024-12-21T01:46:08.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61589 req_id = 86ecfd24-bd71-4ef7-8630-48d2b81e99c5 response_code = 200 uri = /vpc-routes
23412024-12-21T01:46:08.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51740
23422024-12-21T01:46:08.695ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23432024-12-21T01:46:08.736ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23442024-12-21T01:46:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51740 req_id = 497411ee-7e40-4596-bf08-489dcab83279 response_code = 204 uri = /switch-ports
23452024-12-21T01:46:08.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40132
23462024-12-21T01:46:08.797ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23472024-12-21T01:46:08.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58222
23482024-12-21T01:46:08.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61589 req_id = bb7cec20-402f-43c8-87ea-c57e91ce5316 response_code = 204 uri = /eip-gateways
23492024-12-21T01:46:08.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23502024-12-21T01:46:08.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3961 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40132 req_id = c816638e-13e7-4f35-9d75-423b782b1cec response_code = 200 uri = /v2p
23512024-12-21T01:46:08.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51740 req_id = 37b6204c-d62c-4657-b541-12d29f50548a response_code = 200 uri = /network-bootstore-config
23522024-12-21T01:46:08.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61589 req_id = 0c77ec8c-1e02-4764-8766-fcb5cf96e75f response_code = 204 uri = /vpc-routes
23532024-12-21T01:46:08.843ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23542024-12-21T01:46:08.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58222 req_id = 89a31b1f-fac1-4d64-833b-e92802a6b14c response_code = 204 uri = /switch-ports
23552024-12-21T01:46:08.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58222 req_id = 686bcbe5-3a64-412b-be5c-47eb7d3142fb response_code = 200 uri = /network-bootstore-config
23562024-12-21T01:46:09.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65512
23572024-12-21T01:46:09.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65512 req_id = 73609cb0-242c-402d-a617-fb743207fdbe response_code = 200 uri = /vpc-routes
23582024-12-21T01:46:09.083ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23592024-12-21T01:46:09.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65512 req_id = 6d7b3fea-b018-4cf3-b36b-f8a20a6b9e24 response_code = 204 uri = /eip-gateways
23602024-12-21T01:46:09.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65512 req_id = 2f668aef-347a-42c8-b3ab-0ba133bc0677 response_code = 204 uri = /vpc-routes
23612024-12-21T01:46:09.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34605
23622024-12-21T01:46:09.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34605 req_id = 4c024232-6a30-4a9e-960b-1bbbe07599ef response_code = 200 uri = /v2p
23632024-12-21T01:46:09.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38617
23642024-12-21T01:46:09.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23652024-12-21T01:46:09.260ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23662024-12-21T01:46:09.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91209 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38617 req_id = 61a57887-f83d-4035-b274-23b29df888a9 response_code = 204 uri = /switch-ports
23672024-12-21T01:46:09.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38617 req_id = 2ce52f95-df97-49f0-843f-5237090e0d55 response_code = 200 uri = /network-bootstore-config
23682024-12-21T01:46:19.831ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8213 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 3ec9689e-31a8-4dd8-beb1-06e655cfaeb1 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
23692024-12-21T01:46:25.296ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49224
23702024-12-21T01:46:25.296ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49224 req_id = ad6f7c5e-4692-4401-a4da-1894621d61f0 response_code = 200 uri = /baseboard
23712024-12-21T01:46:31.287ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23722024-12-21T01:46:31.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23732024-12-21T01:46:31.318ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1836, tv_nsec: 603731756 } time_to_next_cleanup = 599.999996749s
23742024-12-21T01:46:38.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42999
23752024-12-21T01:46:38.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42999 req_id = 73b58798-55a5-4198-b9ec-fd824fcefbbe response_code = 200 uri = /vpc-routes
23762024-12-21T01:46:38.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23772024-12-21T01:46:38.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42999 req_id = 68fde6ec-7282-4e8f-8705-932f5c8b73d4 response_code = 204 uri = /eip-gateways
23782024-12-21T01:46:38.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42999 req_id = 05645500-b459-4475-a55c-f1a18d0a7bbc response_code = 204 uri = /vpc-routes
23792024-12-21T01:46:38.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38117
23802024-12-21T01:46:38.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38117 req_id = 38a9fc73-3f52-4f35-9ac0-6798b7f63d3a response_code = 200 uri = /v2p
23812024-12-21T01:46:38.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61918
23822024-12-21T01:46:38.838ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23832024-12-21T01:46:38.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23842024-12-21T01:46:38.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61918 req_id = 4174d4e9-9d44-4d96-91eb-375b0c753101 response_code = 204 uri = /switch-ports
23852024-12-21T01:46:38.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56359
23862024-12-21T01:46:38.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56359 req_id = 585a8b9f-2b0a-4a26-8336-999b897d9b44 response_code = 200 uri = /vpc-routes
23872024-12-21T01:46:38.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61918 req_id = 6ab26a7c-6674-497b-8a6f-f198f2861814 response_code = 200 uri = /network-bootstore-config
23882024-12-21T01:46:38.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
23892024-12-21T01:46:38.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56359 req_id = 725c3b98-dfc0-47f8-9954-71d0161b4584 response_code = 204 uri = /eip-gateways
23902024-12-21T01:46:39.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56359 req_id = 984b1f31-3c37-468f-8f6c-53f7e6790f5c response_code = 204 uri = /vpc-routes
23912024-12-21T01:46:39.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50434
23922024-12-21T01:46:39.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23932024-12-21T01:46:39.064ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23942024-12-21T01:46:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50434 req_id = d9f15548-95dc-455e-a952-46d5c4f208d8 response_code = 204 uri = /switch-ports
23952024-12-21T01:46:39.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46620
23962024-12-21T01:46:39.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44181
23972024-12-21T01:46:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50434 req_id = 59b14e1d-a933-48df-8da5-f768c0466567 response_code = 200 uri = /network-bootstore-config
23982024-12-21T01:46:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44181 req_id = 5b6f9f63-1b10-4d29-8c62-9b3c20d720bb response_code = 200 uri = /v2p
23992024-12-21T01:46:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46620 req_id = a5f9382a-2203-426f-baa1-b8eb9ac9dd25 response_code = 200 uri = /v2p
24002024-12-21T01:46:39.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51942
24012024-12-21T01:46:39.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51942 req_id = 058fefec-d504-4466-a4ee-bef94115ca2c response_code = 200 uri = /vpc-routes
24022024-12-21T01:46:39.149ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24032024-12-21T01:46:39.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51942 req_id = 796559ee-e53b-45cd-bf9b-dfa11f259234 response_code = 204 uri = /eip-gateways
24042024-12-21T01:46:39.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51942 req_id = 1b7ef3c5-f4da-4fd7-b335-4f8a5bb3c88b response_code = 204 uri = /vpc-routes
24052024-12-21T01:46:39.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50448
24062024-12-21T01:46:39.328ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24072024-12-21T01:46:39.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24082024-12-21T01:46:39.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94716 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50448 req_id = 4ed5a3e7-37ab-43af-85e9-ff62704b8ae4 response_code = 204 uri = /switch-ports
24092024-12-21T01:46:39.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50448 req_id = 3fb9619f-160f-4f22-8264-6794c9a8e2e4 response_code = 200 uri = /network-bootstore-config
24102024-12-21T01:46:45.296ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24112024-12-21T01:46:49.831ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7849 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 0447d35d-4822-41d6-bf4c-e344b9294fb5 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
24122024-12-21T01:46:55.329ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65284
24132024-12-21T01:46:55.329ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65284 req_id = cbecc0c3-dcfe-43a4-8521-57cc4204d38d response_code = 200 uri = /baseboard
24142024-12-21T01:47:08.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62763
24152024-12-21T01:47:08.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62763 req_id = 91129ab7-4c4c-49a1-a663-4959a602fd05 response_code = 200 uri = /v2p
24162024-12-21T01:47:08.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63907
24172024-12-21T01:47:08.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63907 req_id = f6a40b07-2648-43f8-a72b-f1eaa0f0f2de response_code = 200 uri = /vpc-routes
24182024-12-21T01:47:08.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24192024-12-21T01:47:08.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63907 req_id = 1ce73a5c-ed1d-4d42-86f0-34c219f866fb response_code = 204 uri = /eip-gateways
24202024-12-21T01:47:08.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63907 req_id = 5ddc8552-2944-4416-9278-57a7440d5509 response_code = 204 uri = /vpc-routes
24212024-12-21T01:47:08.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56395
24222024-12-21T01:47:08.672ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24232024-12-21T01:47:08.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24242024-12-21T01:47:08.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56395 req_id = 92d0dfa6-11a1-48cb-9c8e-f095b627ffbc response_code = 204 uri = /switch-ports
24252024-12-21T01:47:08.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47865
24262024-12-21T01:47:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56395 req_id = f0bce3ef-c963-4101-9bb6-c4f91c20dad0 response_code = 200 uri = /network-bootstore-config
24272024-12-21T01:47:08.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47865 req_id = 45ff9b5d-e549-43a0-aaaf-cfab50111214 response_code = 200 uri = /vpc-routes
24282024-12-21T01:47:08.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38659
24292024-12-21T01:47:08.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38659 req_id = c703d9de-a03b-423b-a6a9-8a651bc1ed17 response_code = 200 uri = /v2p
24302024-12-21T01:47:08.812ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24312024-12-21T01:47:08.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47865 req_id = 26c8e2f5-b05e-4d77-b744-5e471188a95b response_code = 204 uri = /eip-gateways
24322024-12-21T01:47:08.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 486 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47865 req_id = b176b7be-ec8d-4538-8695-711a808e790c response_code = 204 uri = /vpc-routes
24332024-12-21T01:47:08.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43019
24342024-12-21T01:47:08.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24352024-12-21T01:47:08.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24362024-12-21T01:47:08.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43019 req_id = 74e0eee5-1e1f-4382-8b39-69667ebfda02 response_code = 204 uri = /switch-ports
24372024-12-21T01:47:08.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43019 req_id = c0b2071f-f66f-462c-85a4-2474b15a118a response_code = 200 uri = /network-bootstore-config
24382024-12-21T01:47:09.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64558
24392024-12-21T01:47:09.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64558 req_id = 912f499d-330f-4399-8d60-9d512188d07d response_code = 200 uri = /vpc-routes
24402024-12-21T01:47:09.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58355
24412024-12-21T01:47:09.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58355 req_id = a8a2c0d1-1c5a-4a65-8807-def606c0f036 response_code = 200 uri = /v2p
24422024-12-21T01:47:09.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24432024-12-21T01:47:09.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64558 req_id = 463dfdff-d88d-4a14-bf30-4b9e23a90cd9 response_code = 204 uri = /eip-gateways
24442024-12-21T01:47:09.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64558 req_id = e0bd36eb-a692-41d3-b3ae-82fdc82f6103 response_code = 204 uri = /vpc-routes
24452024-12-21T01:47:09.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37334
24462024-12-21T01:47:09.188ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24472024-12-21T01:47:09.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24482024-12-21T01:47:09.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99116 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37334 req_id = 77cdd038-1b63-4b67-a053-ea7f455997e3 response_code = 204 uri = /switch-ports
24492024-12-21T01:47:09.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37334 req_id = bebfb00e-9a5c-4fa8-aadc-79ea2d5a3ebb response_code = 200 uri = /network-bootstore-config
24502024-12-21T01:47:19.832ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8306 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 33024b98-6beb-462d-82cb-4b4b8327cdb9 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
24512024-12-21T01:47:25.364ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48891
24522024-12-21T01:47:25.364ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48891 req_id = a43fdef6-d15e-4f20-a202-2a99ac88064d response_code = 200 uri = /baseboard
24532024-12-21T01:47:38.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55608
24542024-12-21T01:47:38.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55608 req_id = c1398208-4cb0-4e98-9e73-c6b728bf586b response_code = 200 uri = /vpc-routes
24552024-12-21T01:47:38.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24562024-12-21T01:47:38.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55608 req_id = 18c74ad1-5f2f-4460-b280-ba19ae097844 response_code = 204 uri = /eip-gateways
24572024-12-21T01:47:38.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33600
24582024-12-21T01:47:38.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33600 req_id = d586e7a9-ee28-4979-bfef-5f361c90f478 response_code = 200 uri = /vpc-routes
24592024-12-21T01:47:38.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57423
24602024-12-21T01:47:38.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57423 req_id = a8d70822-a249-4b76-a2d6-1266a0ed98bd response_code = 200 uri = /v2p
24612024-12-21T01:47:38.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55608 req_id = 7cf74e83-b5fd-4cb5-ac4d-e35930b86e0c response_code = 204 uri = /vpc-routes
24622024-12-21T01:47:38.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24632024-12-21T01:47:38.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33600 req_id = 53b8d79a-ce11-48ee-b8dd-b8602cb7c351 response_code = 204 uri = /eip-gateways
24642024-12-21T01:47:38.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33600 req_id = f60e9b8b-ff66-45b3-83ca-bcb4b4d22ef7 response_code = 204 uri = /vpc-routes
24652024-12-21T01:47:38.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57235
24662024-12-21T01:47:38.973ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24672024-12-21T01:47:39.017ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24682024-12-21T01:47:39.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108266 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57235 req_id = 099179a8-afe5-4e4d-8cef-95b17fa14403 response_code = 204 uri = /switch-ports
24692024-12-21T01:47:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61326
24702024-12-21T01:47:39.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57630
24712024-12-21T01:47:39.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57235 req_id = 3d259ab5-0c3f-4303-8bb7-62ef2ea1c418 response_code = 200 uri = /network-bootstore-config
24722024-12-21T01:47:39.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61326 req_id = 15e6ec30-7656-47d6-a617-1ce5489f92ad response_code = 200 uri = /v2p
24732024-12-21T01:47:39.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24742024-12-21T01:47:39.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37170
24752024-12-21T01:47:39.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37170 req_id = 66e51408-0a8d-4fcc-b6a2-d6ea46ea5c30 response_code = 200 uri = /vpc-routes
24762024-12-21T01:47:39.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24772024-12-21T01:47:39.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57630 req_id = 3a15b1e5-316a-429b-bcb8-21f1b9ddb608 response_code = 204 uri = /switch-ports
24782024-12-21T01:47:39.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57630 req_id = 12971a91-0095-4c0e-839b-e36d6d4cd9a3 response_code = 200 uri = /network-bootstore-config
24792024-12-21T01:47:39.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51065
24802024-12-21T01:47:39.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51065 req_id = a62b3209-0020-4d4a-9d8a-2eb6b32f5261 response_code = 200 uri = /v2p
24812024-12-21T01:47:39.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24822024-12-21T01:47:39.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37170 req_id = 1c89fd6f-3c4e-41ad-9c8c-ab489ddc92c6 response_code = 204 uri = /eip-gateways
24832024-12-21T01:47:39.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37170 req_id = c16e38f7-e873-4b30-8009-4e0d60a8eee6 response_code = 204 uri = /vpc-routes
24842024-12-21T01:47:39.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42527
24852024-12-21T01:47:39.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24862024-12-21T01:47:39.393ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24872024-12-21T01:47:39.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42527 req_id = 1245cafd-5e6c-4395-ad92-0d1ece418c86 response_code = 204 uri = /switch-ports
24882024-12-21T01:47:39.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42527 req_id = 7edfbc63-4bd0-421d-add3-e3d34ea7896b response_code = 200 uri = /network-bootstore-config
24892024-12-21T01:47:49.831ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7485 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 992ec6e9-9c2c-40f1-9eff-0488b6677f71 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
24902024-12-21T01:47:55.397ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53318
24912024-12-21T01:47:55.397ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53318 req_id = 5ce2ebbf-ef42-4526-b54e-a021b075c595 response_code = 200 uri = /baseboard
24922024-12-21T01:48:08.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34228
24932024-12-21T01:48:08.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34228 req_id = 4f0fc3a6-f8cf-4327-9d12-cf851aef6d17 response_code = 200 uri = /vpc-routes
24942024-12-21T01:48:08.612ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
24952024-12-21T01:48:08.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34228 req_id = 7e270828-1221-4f59-a12b-07fc2ca410fd response_code = 204 uri = /eip-gateways
24962024-12-21T01:48:08.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34228 req_id = b58f0ee1-5adb-4f20-a534-e62d998eb39b response_code = 204 uri = /vpc-routes
24972024-12-21T01:48:08.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57472
24982024-12-21T01:48:08.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57472 req_id = 67a58985-ce7b-406f-add9-8ed332294ccb response_code = 200 uri = /v2p
24992024-12-21T01:48:08.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52402
25002024-12-21T01:48:08.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25012024-12-21T01:48:08.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25022024-12-21T01:48:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111399 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52402 req_id = 335fad65-4f74-4812-8ab1-0adab66e2515 response_code = 204 uri = /switch-ports
25032024-12-21T01:48:08.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40091
25042024-12-21T01:48:08.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44143
25052024-12-21T01:48:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52402 req_id = 4ffb4775-c421-47f9-aff0-0c8b62e809f3 response_code = 200 uri = /network-bootstore-config
25062024-12-21T01:48:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40091 req_id = 4a3a6c90-b188-4bcd-a622-c44ae1e418bd response_code = 200 uri = /vpc-routes
25072024-12-21T01:48:08.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44143 req_id = 00928567-a0b9-4d3f-90e0-be0319b2fed6 response_code = 200 uri = /v2p
25082024-12-21T01:48:08.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34215
25092024-12-21T01:48:08.864ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25102024-12-21T01:48:08.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25112024-12-21T01:48:08.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34215 req_id = d4de022b-3856-4aad-8efe-b9875788bd44 response_code = 204 uri = /switch-ports
25122024-12-21T01:48:08.980ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
25132024-12-21T01:48:08.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40091 req_id = 00055a3e-d2f5-4b2b-8f70-d09f198e4bd1 response_code = 204 uri = /eip-gateways
25142024-12-21T01:48:08.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34215 req_id = 15f9dc4f-7247-42d7-962e-00675da43164 response_code = 200 uri = /network-bootstore-config
25152024-12-21T01:48:08.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40091 req_id = 38bfe563-6d7c-457a-b241-ee09333e13b3 response_code = 204 uri = /vpc-routes
25162024-12-21T01:48:08.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33745
25172024-12-21T01:48:08.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33745 req_id = 96cd8699-5453-4bec-b31d-3aa5658bc87d response_code = 200 uri = /vpc-routes
25182024-12-21T01:48:09.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
25192024-12-21T01:48:09.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33745 req_id = b68675c8-02d1-4a49-994b-5e29ad789077 response_code = 204 uri = /eip-gateways
25202024-12-21T01:48:09.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33745 req_id = aba737e4-bc06-409e-a09c-7387fc43414c response_code = 204 uri = /vpc-routes
25212024-12-21T01:48:09.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58034
25222024-12-21T01:48:09.075ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25232024-12-21T01:48:09.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25242024-12-21T01:48:09.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58034 req_id = d281d427-5226-4c53-aded-8d2592ce1779 response_code = 204 uri = /switch-ports
25252024-12-21T01:48:09.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54706
25262024-12-21T01:48:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58034 req_id = f3f70efd-0bef-426d-ad73-b523c348521d response_code = 200 uri = /network-bootstore-config
25272024-12-21T01:48:09.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54706 req_id = 87ba430a-0aa3-43dd-8fd7-b62375431da8 response_code = 200 uri = /v2p
25282024-12-21T01:48:19.832ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8117 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 230a6807-ba29-42cd-8d4c-24e0b9689b5d response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
25292024-12-21T01:48:25.431ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45193
25302024-12-21T01:48:25.431ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45193 req_id = 4c26d214-95b8-4b95-8d40-fd6ae3235a74 response_code = 200 uri = /baseboard
25312024-12-21T01:48:38.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47051
25322024-12-21T01:48:38.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47051 req_id = 4eacc5de-d243-45d0-9fe5-9ab4a6a4dcfa response_code = 200 uri = /vpc-routes
25332024-12-21T01:48:38.831ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
25342024-12-21T01:48:38.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47051 req_id = 024fe766-74f8-40eb-bcff-983a2322dc92 response_code = 204 uri = /eip-gateways
25352024-12-21T01:48:38.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47051 req_id = 2c424f06-1ef5-4034-a3c2-381c9d5b06a9 response_code = 204 uri = /vpc-routes
25362024-12-21T01:48:38.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47353
25372024-12-21T01:48:38.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47353 req_id = 4c15fd0a-56dd-4423-bf32-647dfd0a4845 response_code = 200 uri = /vpc-routes
25382024-12-21T01:48:38.956ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
25392024-12-21T01:48:38.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47353 req_id = 1211cb36-b61f-472f-a1a9-520c1cf3e4f3 response_code = 204 uri = /eip-gateways
25402024-12-21T01:48:38.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40035
25412024-12-21T01:48:38.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40035 req_id = 0a3bdb77-fb66-445a-b945-05da294336b0 response_code = 200 uri = /v2p
25422024-12-21T01:48:38.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47353 req_id = 3bd74303-c3e9-4f93-b73a-ed4751a0cb9a response_code = 204 uri = /vpc-routes
25432024-12-21T01:48:39.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54949
25442024-12-21T01:48:39.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25452024-12-21T01:48:39.000ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25462024-12-21T01:48:39.000ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
25472024-12-21T01:48:39.002ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
25482024-12-21T01:48:39.017ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25492024-12-21T01:48:39.017ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9
25502024-12-21T01:48:39.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63725
25512024-12-21T01:48:39.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25522024-12-21T01:48:39.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25532024-12-21T01:48:39.033ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
25542024-12-21T01:48:39.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34820
25552024-12-21T01:48:39.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63550
25562024-12-21T01:48:39.040ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
25572024-12-21T01:48:39.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25582024-12-21T01:48:39.049ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25592024-12-21T01:48:39.049ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593
25602024-12-21T01:48:39.066ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25612024-12-21T01:48:39.066ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9
25622024-12-21T01:48:39.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25632024-12-21T01:48:39.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25642024-12-21T01:48:39.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593
25652024-12-21T01:48:39.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25662024-12-21T01:48:39.111ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5
25672024-12-21T01:48:39.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51713
25682024-12-21T01:48:39.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 407 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51713 req_id = 60e8fcdd-9b64-47bf-860c-442ef77fa899 response_code = 200 uri = /v2p
25692024-12-21T01:48:39.137ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25702024-12-21T01:48:39.137ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5
25712024-12-21T01:48:39.154ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25722024-12-21T01:48:39.154ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5960098-1ada-427e-bb79-ca59165428b6
25732024-12-21T01:48:39.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39160
25742024-12-21T01:48:39.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39160 req_id = 31343bf3-e119-4f2f-81e0-faf38d8af9a6 response_code = 200 uri = /vpc-routes
25752024-12-21T01:48:39.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63550 req_id = 99681b99-d758-4d63-af8b-1ce026edc5ee response_code = 204 uri = /switch-ports
25762024-12-21T01:48:39.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25772024-12-21T01:48:39.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6463 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63550 req_id = 85dcc9c0-1d88-4631-9059-78cf2efee7f7 response_code = 200 uri = /network-bootstore-config
25782024-12-21T01:48:39.173ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25792024-12-21T01:48:39.173ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5960098-1ada-427e-bb79-ca59165428b6
25802024-12-21T01:48:39.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62675
25812024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25822024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25832024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25842024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25852024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25862024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25872024-12-21T01:48:39.189ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25882024-12-21T01:48:39.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 424 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62675 req_id = f7f09a3a-4aba-4f1e-a1aa-84dba8c13fbe response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25892024-12-21T01:48:39.206ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25902024-12-21T01:48:39.206ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0
25912024-12-21T01:48:39.212ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
25922024-12-21T01:48:39.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 627 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39160 req_id = 78485681-90fd-49c1-93cd-de7dcc0e9c09 response_code = 204 uri = /eip-gateways
25932024-12-21T01:48:39.218ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25942024-12-21T01:48:39.227ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25952024-12-21T01:48:39.227ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0
25962024-12-21T01:48:39.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15769 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39160 req_id = d5431227-d992-4658-8633-2e75196492b8 response_code = 204 uri = /vpc-routes
25972024-12-21T01:48:39.248ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25982024-12-21T01:48:39.248ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_335ed515-415f-4302-9f2a-54aed0987aee
25992024-12-21T01:48:39.268ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26002024-12-21T01:48:39.269ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_335ed515-415f-4302-9f2a-54aed0987aee
26012024-12-21T01:48:39.285ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26022024-12-21T01:48:39.285ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_130551aa-49ad-44d7-81d9-df8b0df41eec
26032024-12-21T01:48:39.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267763 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34820 req_id = 5bf34a71-b402-4fcd-b4f0-63d756f5673e response_code = 204 uri = /switch-ports
26042024-12-21T01:48:39.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34820 req_id = 05121ee9-d73a-4adf-bed3-73261290fa59 response_code = 200 uri = /network-bootstore-config
26052024-12-21T01:48:39.320ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26062024-12-21T01:48:39.320ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142
26072024-12-21T01:48:39.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26082024-12-21T01:48:39.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_130551aa-49ad-44d7-81d9-df8b0df41eec
26092024-12-21T01:48:39.361ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26102024-12-21T01:48:39.362ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e97d276e-ea54-4591-8041-1234166ccdea
26112024-12-21T01:48:39.378ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26122024-12-21T01:48:39.378ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142
26132024-12-21T01:48:39.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363942 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63725 req_id = 2c610252-b2d6-4f22-8163-d449ff63210d response_code = 200 uri = /inventory
26142024-12-21T01:48:39.401ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26152024-12-21T01:48:39.401ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e97d276e-ea54-4591-8041-1234166ccdea
26162024-12-21T01:48:39.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 413608 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54949 req_id = 5172aaef-d424-4258-afae-1346c5871d18 response_code = 200 uri = /inventory
26172024-12-21T01:48:39.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48497
26182024-12-21T01:48:39.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26192024-12-21T01:48:39.416ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26202024-12-21T01:48:39.416ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/config/omicron-zones.json file = common/src/ledger.rs:177
26212024-12-21T01:48:39.417ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/config/omicron-zones.json file = common/src/ledger.rs:177
26222024-12-21T01:48:39.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3542bf5c-dc3b-4a59-9add-ea0980f0bac9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26232024-12-21T01:48:39.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3542bf5c-dc3b-4a59-9add-ea0980f0bac9
26242024-12-21T01:48:39.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33999
26252024-12-21T01:48:39.453ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26262024-12-21T01:48:39.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26272024-12-21T01:48:39.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26282024-12-21T01:48:39.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26292024-12-21T01:48:39.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26302024-12-21T01:48:39.453ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26312024-12-21T01:48:39.454ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26322024-12-21T01:48:39.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33999 req_id = 003b5894-5fea-43f3-8cfc-381520915dfe response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26332024-12-21T01:48:39.460ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2dde69a7-0687-4778-8f1a-1187bd8d1593 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26342024-12-21T01:48:39.460ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2dde69a7-0687-4778-8f1a-1187bd8d1593
26352024-12-21T01:48:39.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38275
26362024-12-21T01:48:39.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38275 req_id = 28006426-ee5a-44b4-bc26-6b856ef8afb6 response_code = 200 uri = /v2p
26372024-12-21T01:48:39.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b249dd03-6268-47ac-a2ed-a4cd8425a0b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26382024-12-21T01:48:39.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b249dd03-6268-47ac-a2ed-a4cd8425a0b5
26392024-12-21T01:48:39.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46573
26402024-12-21T01:48:39.495ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26412024-12-21T01:48:39.517ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5960098-1ada-427e-bb79-ca59165428b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26422024-12-21T01:48:39.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5960098-1ada-427e-bb79-ca59165428b6
26432024-12-21T01:48:39.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26442024-12-21T01:48:39.544ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f0fdcb0c-f53c-4029-bf4a-9831cca302d0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26452024-12-21T01:48:39.544ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f0fdcb0c-f53c-4029-bf4a-9831cca302d0
26462024-12-21T01:48:39.570ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 335ed515-415f-4302-9f2a-54aed0987aee (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26472024-12-21T01:48:39.570ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_335ed515-415f-4302-9f2a-54aed0987aee
26482024-12-21T01:48:39.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45968
26492024-12-21T01:48:39.589ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 8fb8f97e-4c86-42b7-997e-8961d71e1163, kind: Service { id: 0ebacafa-86bf-4887-9449-555ff2475830 }, name: Name("external-dns-0ebacafa-86bf-4887-9449-555ff2475830"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e36a70fd-dcf2-4acc-9fd1-662c3a0549c7, kind: Service { id: 6dfd6dd4-a4da-48b2-a18e-56aed702d02b }, name: Name("external-dns-6dfd6dd4-a4da-48b2-a18e-56aed702d02b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 33116c21-33e6-43b8-a4f8-1583c25d84d8, kind: Service { id: 65c76d16-81e5-4dc4-a11f-07cac6693dca }, name: Name("nexus-65c76d16-81e5-4dc4-a11f-07cac6693dca"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 127])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dab685ac-a34b-4ca7-8fdd-f562f27caf3c, kind: Service { id: 329ee834-a5be-43de-9495-a0167e01a5cc }, name: Name("nexus-329ee834-a5be-43de-9495-a0167e01a5cc"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ff3ee4f6-30a5-4564-8a83-35f6d23e125e, kind: Service { id: 4c22d3c5-4241-430e-a780-0dd847f2622b }, name: Name("nexus-4c22d3c5-4241-430e-a780-0dd847f2622b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26502024-12-21T01:48:39.589ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26512024-12-21T01:48:39.589ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26522024-12-21T01:48:39.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26532024-12-21T01:48:39.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26542024-12-21T01:48:39.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26552024-12-21T01:48:39.590ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26562024-12-21T01:48:39.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 775 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45968 req_id = 798b90fc-920a-43b3-952f-9d53c9cb261f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26572024-12-21T01:48:39.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 130551aa-49ad-44d7-81d9-df8b0df41eec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26582024-12-21T01:48:39.597ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_130551aa-49ad-44d7-81d9-df8b0df41eec
26592024-12-21T01:48:39.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110721 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46573 req_id = ae886f65-d011-4999-858d-aff8960ad715 response_code = 204 uri = /switch-ports
26602024-12-21T01:48:39.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46573 req_id = 875d1a88-8fb1-4672-850d-4218be956acc response_code = 200 uri = /network-bootstore-config
26612024-12-21T01:48:39.622ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 762fcdb3-a5af-4b22-aa0d-558dd0672142 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26622024-12-21T01:48:39.622ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_762fcdb3-a5af-4b22-aa0d-558dd0672142
26632024-12-21T01:48:39.646ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e97d276e-ea54-4591-8041-1234166ccdea (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26642024-12-21T01:48:39.646ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e97d276e-ea54-4591-8041-1234166ccdea
26652024-12-21T01:48:39.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48497 req_id = 13c3d8b1-a3d6-4abf-a552-8f5612b21341 response_code = 200 uri = /inventory
26662024-12-21T01:48:49.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8710 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = eeb70642-e2c1-417a-86a4-26533f8f4930 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
26672024-12-21T01:48:55.465ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43199
26682024-12-21T01:48:55.465ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43199 req_id = 3b08db5e-3de1-4a06-bff0-880d426fd469 response_code = 200 uri = /baseboard
26692024-12-21T01:49:08.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37558
26702024-12-21T01:49:08.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37558 req_id = 68f8b59d-5d15-4569-b87a-69311c419f37 response_code = 200 uri = /vpc-routes
26712024-12-21T01:49:08.752ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
26722024-12-21T01:49:08.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37558 req_id = 248d1d80-6888-42e0-80cf-14ac5ce0c601 response_code = 204 uri = /eip-gateways
26732024-12-21T01:49:08.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49192
26742024-12-21T01:49:08.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49192 req_id = 573cd3ef-db44-4666-938d-7dc8b5293964 response_code = 200 uri = /vpc-routes
26752024-12-21T01:49:08.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37558 req_id = 8520ba54-d32a-49e2-8c0a-4be5ce2d5393 response_code = 204 uri = /vpc-routes
26762024-12-21T01:49:08.804ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
26772024-12-21T01:49:08.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49192 req_id = 20dedb1a-3a84-4146-9e80-ae9d39187bcf response_code = 204 uri = /eip-gateways
26782024-12-21T01:49:08.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49192 req_id = a3f0d61d-7adf-4483-bc74-75e7e1703661 response_code = 204 uri = /vpc-routes
26792024-12-21T01:49:08.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45909
26802024-12-21T01:49:08.856ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26812024-12-21T01:49:08.909ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26822024-12-21T01:49:08.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130705 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45909 req_id = cbfe7a44-e42e-417b-9ca6-52d8316e936a response_code = 204 uri = /switch-ports
26832024-12-21T01:49:08.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52273
26842024-12-21T01:49:08.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63972
26852024-12-21T01:49:08.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45909 req_id = 3c77f4f1-e45c-4e06-a46f-ab1674b3859b response_code = 200 uri = /network-bootstore-config
26862024-12-21T01:49:08.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26872024-12-21T01:49:08.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52273 req_id = 27ed1a88-5640-488b-9403-dd0507c57aae response_code = 200 uri = /v2p
26882024-12-21T01:49:09.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26892024-12-21T01:49:09.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63843
26902024-12-21T01:49:09.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63843 req_id = 7b92db71-7356-4f70-b83c-e6f9a75c2af6 response_code = 200 uri = /v2p
26912024-12-21T01:49:09.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105661 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63972 req_id = 758b4350-9f89-4fcf-9ddf-9e3b3c031901 response_code = 204 uri = /switch-ports
26922024-12-21T01:49:09.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63972 req_id = deee6ee3-98a8-4af2-8df9-65f6c830374a response_code = 200 uri = /network-bootstore-config
26932024-12-21T01:49:09.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41310
26942024-12-21T01:49:09.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41310 req_id = 3fe1dc0a-0567-43af-844b-acb4676f1f4e response_code = 200 uri = /vpc-routes
26952024-12-21T01:49:09.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60734
26962024-12-21T01:49:09.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60734 req_id = cf9b9f93-9e1b-4c29-9f4d-8499c2c54d0f response_code = 200 uri = /v2p
26972024-12-21T01:49:09.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
26982024-12-21T01:49:09.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41310 req_id = 368ed502-6c15-4c21-a43b-6d3dec010de0 response_code = 204 uri = /eip-gateways
26992024-12-21T01:49:09.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41310 req_id = c9a58c94-b2d8-4cc3-844e-9c3fc80e38a7 response_code = 204 uri = /vpc-routes
27002024-12-21T01:49:09.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43635
27012024-12-21T01:49:09.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27022024-12-21T01:49:09.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27032024-12-21T01:49:09.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43635 req_id = f74be0b1-b3fd-4729-a93b-897881230f05 response_code = 204 uri = /switch-ports
27042024-12-21T01:49:09.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43635 req_id = 8687a067-b31f-40ad-a713-2524b78ef5db response_code = 200 uri = /network-bootstore-config
27052024-12-21T01:49:19.835ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10840 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 7aa8a74b-a4ec-4d30-885c-259415f738e9 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
27062024-12-21T01:49:25.499ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41920
27072024-12-21T01:49:25.499ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41920 req_id = c5dc1fa3-7f50-495f-a5ac-bb9597b662f2 response_code = 200 uri = /baseboard
27082024-12-21T01:49:38.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64149
27092024-12-21T01:49:38.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64149 req_id = 7af42762-a714-4c89-b8dd-212e68f05fbe response_code = 200 uri = /vpc-routes
27102024-12-21T01:49:38.875ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
27112024-12-21T01:49:38.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64149 req_id = 9d7f810f-0309-434f-a51e-9a613ae164c7 response_code = 204 uri = /eip-gateways
27122024-12-21T01:49:38.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45630
27132024-12-21T01:49:38.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45630 req_id = 6198f4ad-6948-42b5-8dea-b895024dac76 response_code = 200 uri = /vpc-routes
27142024-12-21T01:49:38.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64149 req_id = 665c60fb-4c12-4e55-b857-5ac2ba04a7a5 response_code = 204 uri = /vpc-routes
27152024-12-21T01:49:38.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56844
27162024-12-21T01:49:38.950ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27172024-12-21T01:49:38.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27182024-12-21T01:49:39.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56844 req_id = 642aea8f-453e-4175-a4b3-9de9d05ed35c response_code = 204 uri = /switch-ports
27192024-12-21T01:49:39.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34559
27202024-12-21T01:49:39.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43424
27212024-12-21T01:49:39.067ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
27222024-12-21T01:49:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45630 req_id = 02f6dbe4-387d-4ade-ac7e-187247f77d8c response_code = 204 uri = /eip-gateways
27232024-12-21T01:49:39.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62338
27242024-12-21T01:49:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56844 req_id = 78e63085-9040-4179-b442-d5d271e3c66f response_code = 200 uri = /network-bootstore-config
27252024-12-21T01:49:39.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43424 req_id = a6ec383e-420f-4a28-87c7-ccf3e7cc3c1c response_code = 200 uri = /v2p
27262024-12-21T01:49:39.067ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27272024-12-21T01:49:39.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34559 req_id = 5390dd76-9c97-476d-a5d1-c277befa7ce1 response_code = 200 uri = /v2p
27282024-12-21T01:49:39.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45630 req_id = 432f5a0c-d3c4-47c1-ba71-2eeff5c48a2c response_code = 204 uri = /vpc-routes
27292024-12-21T01:49:39.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27302024-12-21T01:49:39.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62338 req_id = 880a4312-a873-4c49-a80a-1bdbcd08cad7 response_code = 204 uri = /switch-ports
27312024-12-21T01:49:39.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62338 req_id = c6f1daba-a0a9-4ce4-8b38-d12c92466904 response_code = 200 uri = /network-bootstore-config
27322024-12-21T01:49:39.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42484
27332024-12-21T01:49:39.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42484 req_id = 375dae63-f07c-463a-86a4-d4fc3b7afdaf response_code = 200 uri = /vpc-routes
27342024-12-21T01:49:39.285ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
27352024-12-21T01:49:39.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42484 req_id = 6a681546-b5a9-4bb8-9eb2-ecdf8a7d65b3 response_code = 204 uri = /eip-gateways
27362024-12-21T01:49:39.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42484 req_id = 2f7c1fcc-efac-4d29-a20a-eb882eab3a07 response_code = 204 uri = /vpc-routes
27372024-12-21T01:49:39.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65116
27382024-12-21T01:49:39.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65116 req_id = 3785b3c6-d163-46e1-9598-527a1a5f93ff response_code = 200 uri = /v2p
27392024-12-21T01:49:39.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49222
27402024-12-21T01:49:39.522ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27412024-12-21T01:49:39.560ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27422024-12-21T01:49:39.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49222 req_id = 6da8d4c1-f811-4516-a604-6be80b6b4245 response_code = 204 uri = /switch-ports
27432024-12-21T01:49:39.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49222 req_id = 655dba83-a2b9-4a71-86b7-392c1d518670 response_code = 200 uri = /network-bootstore-config
27442024-12-21T01:49:49.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7556 local_addr = [fd00:1122:3344:101::1]:57402 method = GET remote_addr = [fd00:1122:3344:101::d]:48810 req_id = 6ab54260-baea-404f-9988-8a7d5aec2e95 response_code = 200 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 uri = /402798b1-2357-48f5-992b-b9e53d91bbe0
27452024-12-21T01:49:52.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48807
27462024-12-21T01:49:52.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48807 req_id = c6096df4-569f-4fcd-af30-7f3d4323c385 response_code = 200 uri = /v2p
27472024-12-21T01:49:52.897ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(11373199) }
27482024-12-21T01:49:52.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48807 req_id = 1a58f266-b7ed-472a-b0bd-b3f5f734d836 response_code = 204 uri = /v2p
27492024-12-21T01:49:53.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40521
27502024-12-21T01:49:53.074ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11373199))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-ac66b184331", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: b44d3bc7-832a-4c0f-b463-117459c2ab83, read_only_parent: Some(Volume { block_size: 512, id: 2cf393ab-baff-4247-b03b-6d4aa4cbb629, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b3c56b34-7bd1-453d-a665-a5b45d74cd87, key: Some("K+xHEoHWya++arDoLJmYjcQECo4MPgUwAorXv3OiBIw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b44d3bc7-832a-4c0f-b463-117459c2ab83, key: Some("l/Dv8RtZ6vaCjN+KEKqy3PHcpFLhzzDvIs6ZBE8hUDw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::18]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-ac66b184331" }] }), cloud_init_bytes: Some(..) } instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c metadata = InstanceMetadata { silo_id: d64816ee-68af-466a-9a95-6d6b20472ad0, project_id: 22cd4b2d-01a8-4098-81b8-97b2dea742e5 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T01:49:53.072241826Z }
27512024-12-21T01:49:53.074ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c migration_id = None propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27522024-12-21T01:49:53.075ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c migration_id = None propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11373199))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 197f8389-f92b-4584-8aef-4b2b6c55c204, kind: Instance { id: 557f62e3-56bd-4ce0-a2be-bdf56ee7013c }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11373199), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-ac66b184331", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: b44d3bc7-832a-4c0f-b463-117459c2ab83, read_only_parent: Some(Volume { block_size: 512, id: 2cf393ab-baff-4247-b03b-6d4aa4cbb629, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b3c56b34-7bd1-453d-a665-a5b45d74cd87, key: Some("K+xHEoHWya++arDoLJmYjcQECo4MPgUwAorXv3OiBIw="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b44d3bc7-832a-4c0f-b463-117459c2ab83, key: Some("l/Dv8RtZ6vaCjN+KEKqy3PHcpFLhzzDvIs6ZBE8hUDw="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::18]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-ac66b184331" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T01:49:53.072241826Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27532024-12-21T01:49:53.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3663 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40521 req_id = a61c90cd-b111-46a4-b358-48b651182e14 response_code = 200 uri = /vmms/9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27542024-12-21T01:49:53.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39056
27552024-12-21T01:49:53.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 470 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39056 req_id = 2454a788-0072-48e9-a6e3-235a0719a3e0 response_code = 200 uri = /vmms/9cd770f6-1d4b-4450-b32d-a60fd2140ffd/state
27562024-12-21T01:49:53.154ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 11373199 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27572024-12-21T01:49:53.154ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27582024-12-21T01:49:53.196ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd file = illumos-utils/src/zone.rs:325 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27592024-12-21T01:49:53.220ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd file = illumos-utils/src/zone.rs:363 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27602024-12-21T01:49:53.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61886
27612024-12-21T01:49:53.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61886 req_id = 509766b8-a2cc-433d-a605-4d83a9ac139b response_code = 200 uri = /vpc-routes
27622024-12-21T01:49:53.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {197f8389-f92b-4584-8aef-4b2b6c55c204: {10.151.1.175: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}, 10.151.1.176: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}}} }
27632024-12-21T01:49:54.511ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27642024-12-21T01:49:54.511ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone file = illumos-utils/src/running_zone.rs:488 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27652024-12-21T01:49:54.783ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 51.756356ms file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27662024-12-21T01:49:54.846ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 106.556392ms file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27672024-12-21T01:49:54.969ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 251.51594ms file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27682024-12-21T01:49:55.236ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 418.07536ms file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27692024-12-21T01:49:55.536ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58948
27702024-12-21T01:49:55.536ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58948 req_id = f27f6ea9-3c41-4fb8-bb26-63a4982c7eca response_code = 200 uri = /baseboard
27712024-12-21T01:49:55.672ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 880.697909ms file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27722024-12-21T01:49:56.566ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 1.071442985s file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27732024-12-21T01:49:57.649ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 1.28918937s file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27742024-12-21T01:49:58.949ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd") failed: Property not found. retry in 1.256918625s file = illumos-utils/src/svc.rs:36 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd zone = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27752024-12-21T01:50:00.236ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd file = sled-agent/src/instance.rs:1786 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27762024-12-21T01:50:00.245ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27772024-12-21T01:50:00.282ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27782024-12-21T01:50:00.423ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27792024-12-21T01:50:00.424ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
27802024-12-21T01:50:00.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7176234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61886 req_id = 93acc703-c38e-4357-a1d8-1eebae8cea1b response_code = 204 uri = /eip-gateways
27812024-12-21T01:50:00.424ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T01:50:00.424768043Z } file = sled-agent/src/instance.rs:780 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27822024-12-21T01:50:00.424ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T01:50:00.424768043Z } propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27832024-12-21T01:50:00.424ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T01:50:00.424768043Z }, migration_in: None, migration_out: None }
27842024-12-21T01:50:00.454ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T01:50:00.454458434Z } file = sled-agent/src/instance.rs:780 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27852024-12-21T01:50:00.454ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T01:50:00.454458434Z } propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
27862024-12-21T01:50:00.454ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T01:50:00.454458434Z }, migration_in: None, migration_out: None }
27872024-12-21T01:50:00.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61886 req_id = fd83c0df-13ce-44b1-901c-538928941977 response_code = 204 uri = /vpc-routes
27882024-12-21T01:50:08.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63123
27892024-12-21T01:50:08.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63123 req_id = 3bd7e0e1-bd8c-4ee3-a41a-bc3bd0c22bb8 response_code = 200 uri = /vmms/9cd770f6-1d4b-4450-b32d-a60fd2140ffd/state
27902024-12-21T01:50:08.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48921
27912024-12-21T01:50:08.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48921 req_id = 9ef19329-8ae1-4a7e-9ec2-c0a28d602510 response_code = 200 uri = /vpc-routes
27922024-12-21T01:50:08.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {197f8389-f92b-4584-8aef-4b2b6c55c204: {10.151.1.176: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}, 10.151.1.175: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}}} }
27932024-12-21T01:50:08.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48921 req_id = cfff7ec8-989b-4d9f-9bf6-d5a03a349e45 response_code = 204 uri = /eip-gateways
27942024-12-21T01:50:08.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48921 req_id = e4a97ae7-4dd4-4255-b244-29fe015a5bb7 response_code = 204 uri = /vpc-routes
27952024-12-21T01:50:08.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33495
27962024-12-21T01:50:08.702ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27972024-12-21T01:50:08.740ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27982024-12-21T01:50:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93131 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33495 req_id = 359f0b04-4cbd-4a77-a369-8fdf8f4f1cda response_code = 204 uri = /switch-ports
27992024-12-21T01:50:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62940
28002024-12-21T01:50:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34521
28012024-12-21T01:50:08.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41802
28022024-12-21T01:50:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41802 req_id = ed8c338c-2f7f-4798-b06b-f7aefd7c100c response_code = 200 uri = /vpc-routes
28032024-12-21T01:50:08.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62940 req_id = 099222ed-f000-4aa0-85d5-ed2ba7f9f6ac response_code = 200 uri = /v2p
28042024-12-21T01:50:08.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33495 req_id = cc26de10-dff4-4909-be32-71f9c87bdbec response_code = 200 uri = /network-bootstore-config
28052024-12-21T01:50:08.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34521 req_id = 6a2a0395-1d2b-477c-a611-19d0e429bc0c response_code = 200 uri = /vmms/9cd770f6-1d4b-4450-b32d-a60fd2140ffd/state
28062024-12-21T01:50:08.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {197f8389-f92b-4584-8aef-4b2b6c55c204: {10.151.1.176: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}, 10.151.1.175: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}}} }
28072024-12-21T01:50:08.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41802 req_id = 4fbab3a9-0e31-42fe-bdf7-e9922a39ed67 response_code = 204 uri = /eip-gateways
28082024-12-21T01:50:08.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43359
28092024-12-21T01:50:08.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43359 req_id = f1f8d00e-c416-4737-8e7b-b456650d2bce response_code = 200 uri = /v2p
28102024-12-21T01:50:08.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59454
28112024-12-21T01:50:08.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59454 req_id = 96af5538-04ab-4e24-b109-672aa84a7783 response_code = 200 uri = /vpc-routes
28122024-12-21T01:50:08.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41802 req_id = 0f21dcef-837c-4ac4-9698-b86d413a2939 response_code = 204 uri = /vpc-routes
28132024-12-21T01:50:08.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41577
28142024-12-21T01:50:08.948ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28152024-12-21T01:50:08.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28162024-12-21T01:50:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41577 req_id = ef6ec4df-667d-43b1-8e57-9a4232850128 response_code = 204 uri = /switch-ports
28172024-12-21T01:50:09.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53170
28182024-12-21T01:50:09.059ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {197f8389-f92b-4584-8aef-4b2b6c55c204: {10.151.1.176: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}, 10.151.1.175: {789cd0d4-d2e3-47ae-9c89-77b55310f5c2}}} }
28192024-12-21T01:50:09.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59454 req_id = 8b58ee7e-494a-4043-8de4-d16cb4a88277 response_code = 204 uri = /eip-gateways
28202024-12-21T01:50:09.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41577 req_id = 31516fbd-2a80-4ac9-9966-0588024a8330 response_code = 200 uri = /network-bootstore-config
28212024-12-21T01:50:09.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53170 req_id = 83c6fd7e-5879-49e4-acc4-688192280215 response_code = 200 uri = /vmms/9cd770f6-1d4b-4450-b32d-a60fd2140ffd/state
28222024-12-21T01:50:09.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58889
28232024-12-21T01:50:09.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
28242024-12-21T01:50:09.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
28252024-12-21T01:50:09.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95483 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58889 req_id = 3446922a-4a3e-4aae-b6b8-99f0e2b40e3a response_code = 204 uri = /switch-ports
28262024-12-21T01:50:09.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49736
28272024-12-21T01:50:09.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58889 req_id = d1485cdd-ecd7-4dfc-8ec0-c678335a744b response_code = 200 uri = /network-bootstore-config
28282024-12-21T01:50:09.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49736 req_id = cdb1aff5-919e-4a7a-a30b-d89ae3e35337 response_code = 200 uri = /v2p
28292024-12-21T01:50:09.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 593 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59454 req_id = 3f5a557e-fb53-4d42-ba24-ade4792b9dee response_code = 204 uri = /vpc-routes
28302024-12-21T01:50:10.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36847
28312024-12-21T01:50:10.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36847 req_id = 7e4be7b6-43fa-4433-8c00-027ec5483c99 response_code = 200 uri = /vmms/9cd770f6-1d4b-4450-b32d-a60fd2140ffd/state
28322024-12-21T01:50:10.660ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T01:50:10.660709485Z } file = sled-agent/src/instance.rs:780 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28332024-12-21T01:50:10.660ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T01:50:10.660709485Z } propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28342024-12-21T01:50:10.660ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T01:50:10.660709485Z }, migration_in: None, migration_out: None }
28352024-12-21T01:50:10.702ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T01:50:10.702823757Z } file = sled-agent/src/instance.rs:780 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28362024-12-21T01:50:10.702ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T01:50:10.702823757Z } propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28372024-12-21T01:50:10.702ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28382024-12-21T01:50:10.702ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28392024-12-21T01:50:10.702ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 5234421091193182088 n_samples = 6 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
28402024-12-21T01:50:10.703ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28412024-12-21T01:50:10.703ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/7dc7dd1f-faf1-44a0-bded-f21c01fb1c73/debug/bundle/zone", "/pool/int/b96d83ac-d68d-40e0-9691-01eb0216fb08/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/3542bf5c-dc3b-4a59-9add-ea0980f0bac9/crypt/debug", "/pool/ext/2dde69a7-0687-4778-8f1a-1187bd8d1593/crypt/debug", "/pool/ext/b249dd03-6268-47ac-a2ed-a4cd8425a0b5/crypt/debug", "/pool/ext/b5960098-1ada-427e-bb79-ca59165428b6/crypt/debug", "/pool/ext/f0fdcb0c-f53c-4029-bf4a-9831cca302d0/crypt/debug", "/pool/ext/335ed515-415f-4302-9f2a-54aed0987aee/crypt/debug", "/pool/ext/130551aa-49ad-44d7-81d9-df8b0df41eec/crypt/debug", "/pool/ext/762fcdb3-a5af-4b22-aa0d-558dd0672142/crypt/debug", "/pool/ext/e97d276e-ea54-4591-8041-1234166ccdea/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28422024-12-21T01:50:10.703ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10403656984536642211 n_samples = 6 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
28432024-12-21T01:50:11.345ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd", bundle_id: bda4a23e-341e-477f-81f7-ddf560c39fc6 }, time_created: 2024-12-21T01:50:10.704048579Z, version: 0, cause: TerminatedInstance }
28442024-12-21T01:50:11.345ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_9cd770f6-1d4b-4450-b32d-a60fd2140ffd file = sled-agent/src/instance.rs:1032 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28452024-12-21T01:50:13.113ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28462024-12-21T01:50:13.130ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11373199), kind: System }
28472024-12-21T01:50:13.130ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11373199), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28482024-12-21T01:50:13.130ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T01:50:13.130559673Z }, migration_in: None, migration_out: None }
28492024-12-21T01:50:13.158ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T01:50:13.130559673Z }, migration_in: None, migration_out: None }
28502024-12-21T01:50:13.163ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 557f62e3-56bd-4ce0-a2be-bdf56ee7013c propolis_id = 9cd770f6-1d4b-4450-b32d-a60fd2140ffd
28512024-12-21T01:50:13.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35735
28522024-12-21T01:50:13.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35735 req_id = 8a8f2d73-73cb-4a44-b783-82ce895dbd06 response_code = 200 uri = /vpc-routes
28532024-12-21T01:50:13.653ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
28542024-12-21T01:50:13.653ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0
28552024-12-21T01:50:13.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35735 req_id = f4c70ade-ae0e-48f4-9c03-d4c5753b543d response_code = 204 uri = /eip-gateways
28562024-12-21T01:50:13.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 391 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35735 req_id = 256baa4c-1704-4830-94b2-47fcc88712f0 response_code = 204 uri = /vpc-routes
28572024-12-21T01:50:13.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39488
28582024-12-21T01:50:13.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39488 req_id = b1ca3f00-c67d-435d-b053-231bb9b49ac7 response_code = 200 uri = /v2p
28592024-12-21T01:50:14.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48624
28602024-12-21T01:50:14.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48624 req_id = eaa63180-6ae4-42c1-9e31-bfdbe0ab7b83 response_code = 200 uri = /v2p
28612024-12-21T01:50:14.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42902
28622024-12-21T01:50:14.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42902 req_id = b191f9c4-4c16-4bde-b5ab-39c02a173566 response_code = 200 uri = /vpc-routes
28632024-12-21T01:50:14.296ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
28642024-12-21T01:50:14.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42902 req_id = 1f9aef19-fb13-48e4-bcd2-9f03722fccec response_code = 204 uri = /eip-gateways
28652024-12-21T01:50:14.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42902 req_id = c6d14801-6a59-40c3-a887-b307ee7266f6 response_code = 204 uri = /vpc-routes
28662024-12-21T01:50:14.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42351
28672024-12-21T01:50:14.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42351 req_id = f1fb3a98-c8fd-4452-90bc-9ac264516e5c response_code = 200 uri = /vpc-routes
28682024-12-21T01:50:14.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 402798b1-2357-48f5-992b-b9e53d91bbe0 values = ExternalIpGatewayMap { mappings: {} }
28692024-12-21T01:50:14.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42351 req_id = 714797b2-6f14-4471-b0e7-f72129af8c0c response_code = 204 uri = /eip-gateways
28702024-12-21T01:50:14.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42351 req_id = d1e0caae-d23f-46ec-bc5f-0d69cf674f24 response_code = 204 uri = /vpc-routes