Max level shown:
1 [ Nov 22 05:50:09 Enabled. ]
2 [ Nov 22 05:50:09 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Nov 22 05:50:09 Method "start" exited with status 0. ]
4 [ Nov 22 05:50:09 Rereading configuration. ]
5 [ Nov 22 05:50:09 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-11-22T05:50:09.260ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-11-22T05:50:09.260ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-11-22T05:50:09.314ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-11-22T05:50:09.314ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-11-22T05:50:09.428ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-11-22T05:50:09.437ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-11-22T05:50:09.445ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-11-22T05:50:10.048ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-11-22T05:50:10.191ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-11-22T05:50:10.191ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-11-22T05:50:10.191ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-11-22T05:50:10.191ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-11-22T05:50:10.191ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-11-22T05:50:10.191ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-11-22T05:50:10.194ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-11-22T05:50:10.194ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-11-22T05:50:10.194ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-11-22T05:50:10.194ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-11-22T05:50:10.194ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-11-22T05:50:10.195ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-11-22T05:50:10.195ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-11-22T05:50:10.195ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-11-22T05:50:10.195ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-11-22T05:50:10.207ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-11-22T05:50:10.207ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool)
322024-11-22T05:50:10.303ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal }
332024-11-22T05:50:10.780ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-11-22T05:50:10.780ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-11-22T05:50:10.780ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-11-22T05:50:10.780ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-11-22T05:50:10.780ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-11-22T05:50:10.780ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-11-22T05:50:10.780ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-11-22T05:50:10.789ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-11-22T05:50:10.789ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool)
422024-11-22T05:50:10.875ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal }
432024-11-22T05:50:11.359ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-11-22T05:50:11.359ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-11-22T05:50:11.359ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-11-22T05:50:11.359ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-11-22T05:50:11.359ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-11-22T05:50:11.359ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-11-22T05:50:11.359ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-11-22T05:50:11.359ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-11-22T05:50:11.359ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-11-22T05:50:11.359ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592024-11-22T05:50:11.359ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
602024-11-22T05:50:11.359ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-11-22T05:50:11.359ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-11-22T05:50:11.359ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-11-22T05:50:11.359ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-11-22T05:50:11.359ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-11-22T05:50:11.359ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-11-22T05:50:11.359ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-11-22T05:50:11.359ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-11-22T05:50:11.360ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
712024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
722024-11-22T05:50:11.360ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-11-22T05:50:11.360ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-11-22T05:50:11.360ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-11-22T05:50:11.360ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-11-22T05:50:11.360ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-11-22T05:50:11.360ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-11-22T05:50:11.360ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-11-22T05:50:11.360ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
822024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
832024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
842024-11-22T05:50:11.360ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-11-22T05:50:11.360ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-11-22T05:50:11.360ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-11-22T05:50:11.360ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
882024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
892024-11-22T05:50:11.360ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
902024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-11-22T05:50:11.360ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-11-22T05:50:11.360ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952024-11-22T05:50:11.360ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
962024-11-22T05:50:11.360ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-11-22T05:50:11.360ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-11-22T05:50:11.360ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-11-22T05:50:11.360ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-11-22T05:50:11.360ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-11-22T05:50:11.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-11-22T05:50:11.360ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-11-22T05:50:11.360ZINFOSledAgent (bootstore): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1052024-11-22T05:50:11.360ZINFOSledAgent (bootstore): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1062024-11-22T05:50:11.360ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-11-22T05:50:11.360ZINFOSledAgent (bootstore): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1082024-11-22T05:50:11.360ZINFOSledAgent (bootstore): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/cluster/bootstore-network-config.json file = common/src/ledger.rs:189 peer_id = pc-buskin-i86pc
1092024-11-22T05:50:11.360ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-11-22T05:50:11.360ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-11-22T05:50:11.360ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-11-22T05:50:11.371ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:743
1132024-11-22T05:50:11.371ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1354, tv_nsec: 325657362 } time_to_next_cleanup = 599.999924867s
1142024-11-22T05:50:11.371ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
1152024-11-22T05:50:11.371ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-11-22T05:50:11.374ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/sled-agent-request.json file = common/src/ledger.rs:189
1172024-11-22T05:50:11.374ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/sled-agent-request.json file = common/src/ledger.rs:189
1182024-11-22T05:50:11.375ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-11-22T05:50:11.376ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-11-22T05:50:11.377ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1200
1212024-11-22T05:50:11.377ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-11-22T05:50:11.377ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-11-22T05:50:11.377ZINFOSledAgent (RSS): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1242024-11-22T05:50:11.377ZINFOSledAgent (RSS): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/rss-plan-completed.marker file = common/src/ledger.rs:189
1252024-11-22T05:50:11.377ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1263
1262024-11-22T05:50:11.377ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-11-22T05:50:11.377ZINFOSledAgent (RSS): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/rss-sled-plan.json file = common/src/ledger.rs:189
1282024-11-22T05:50:11.377ZINFOSledAgent (RSS): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/rss-sled-plan.json file = common/src/ledger.rs:189
1292024-11-22T05:50:11.377ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1305
1302024-11-22T05:50:11.377ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-11-22T05:50:11.377ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-11-22T05:50:11.377ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1332024-11-22T05:50:11.377ZINFOSledAgent (RSS): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1342024-11-22T05:50:11.378ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/rss-sled-plan.json"
1352024-11-22T05:50:11.378ZINFOSledAgent (RSS): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:200
1362024-11-22T05:50:11.378ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/rss-sled-plan.json"
1372024-11-22T05:50:11.378ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: bc798e4e-a9f0-45a6-90cf-a2cdd3f22375, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 (sled), rack_id: bc798e4e-a9f0-45a6-90cf-a2cdd3f22375, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1382024-11-22T05:50:11.378ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1339
1392024-11-22T05:50:11.378ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1402024-11-22T05:50:11.378ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1412024-11-22T05:50:11.378ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1422024-11-22T05:50:11.378ZINFOSledAgent (bootstore): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
1432024-11-22T05:50:11.378ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4302
1442024-11-22T05:50:11.378ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
1452024-11-22T05:50:11.378ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1462024-11-22T05:50:11.378ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4702
1472024-11-22T05:50:11.378ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 (sled), rack_id: bc798e4e-a9f0-45a6-90cf-a2cdd3f22375, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1482024-11-22T05:50:11.383ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1492024-11-22T05:50:11.389ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1502024-11-22T05:50:11.389ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1512024-11-22T05:50:11.394ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1522024-11-22T05:50:11.394ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1532024-11-22T05:50:11.394ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:34964
1542024-11-22T05:50:11.394ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 (sled), rack_id: bc798e4e-a9f0-45a6-90cf-a2cdd3f22375, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1552024-11-22T05:50:11.394ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1562024-11-22T05:50:11.394ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1572024-11-22T05:50:11.394ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1582024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1592024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1602024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1612024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = load_disks_ledger
1622024-11-22T05:50:11.394ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1632024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1642024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1652024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1662024-11-22T05:50:11.394ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1672024-11-22T05:50:11.394ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1682024-11-22T05:50:11.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1692024-11-22T05:50:11.432ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1702024-11-22T05:50:11.446ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:407 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
1712024-11-22T05:50:11.446ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1722024-11-22T05:50:11.446ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:419 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
1732024-11-22T05:50:11.446ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-11-22T05:50:11.449ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1752024-11-22T05:50:11.452ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 65.68016ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2aaa9031-61d0-4c69-b107-c30ff193708a", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2aaa9031-61d0-4c69-b107-c30ff193708a" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-11-22T05:50:11.460ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_7611e6e5-6a68-4a9f-8263-186d30fed23e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-11-22T05:50:11.484ZINFOSledAgent: successfully created encrypted zvol: name="oxi_7611e6e5-6a68-4a9f-8263-186d30fed23e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-11-22T05:50:11.484ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_7611e6e5-6a68-4a9f-8263-186d30fed23e/swap" file = sled-agent/src/swap_device.rs:96
1792024-11-22T05:50:11.489ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:434 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
1802024-11-22T05:50:11.489ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1812024-11-22T05:50:11.489ZINFOSledAgent (BackingFs): Ensuring dataset oxi_7611e6e5-6a68-4a9f-8263-186d30fed23e/backing/fmd file = sled-agent/src/backing_fs.rs:138
1822024-11-22T05:50:11.519ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-11-22T05:50:11.522ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 177.062469ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0684fc10-279c-4a99-9b64-75d9aab37a8d", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0684fc10-279c-4a99-9b64-75d9aab37a8d" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-11-22T05:50:11.585ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1852024-11-22T05:50:11.700ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-11-22T05:50:11.700ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 120.382094ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c5161de3-6fcc-44d4-bf2c-cd26a22a84ed", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c5161de3-6fcc-44d4-bf2c-cd26a22a84ed" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-11-22T05:50:11.804ZINFOSledAgent (BackingFs): Mounting oxi_7611e6e5-6a68-4a9f-8263-186d30fed23e/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1882024-11-22T05:50:11.817ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1892024-11-22T05:50:11.817ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1902024-11-22T05:50:11.817ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1912024-11-22T05:50:11.817ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1922024-11-22T05:50:11.822ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-11-22T05:50:11.822ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.862357ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fc74f38c-6467-4290-a66e-edafdce50184", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fc74f38c-6467-4290-a66e-edafdce50184" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-11-22T05:50:11.927ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-11-22T05:50:11.928ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 109.181728ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0ff3f0ac-4369-403d-8bff-6a7f67f18f19", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0ff3f0ac-4369-403d-8bff-6a7f67f18f19" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-11-22T05:50:12.038ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-11-22T05:50:12.041ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.010226ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f8c5c865-8cc2-434a-a28e-2e7a49592ee5", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f8c5c865-8cc2-434a-a28e-2e7a49592ee5" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-11-22T05:50:12.175ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-11-22T05:50:12.175ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 215.803804ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6b81b33b-c0f8-41dc-bba4-370425a707fd", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6b81b33b-c0f8-41dc-bba4-370425a707fd" } file = clients/ddm-admin-client/src/lib.rs:177
2002024-11-22T05:50:12.392ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012024-11-22T05:50:12.392ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 464.760963ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dc800fc2-6741-4646-aaf5-14a34db16243", "content-length": "124", "date": "Fri, 22 Nov 2024 05:50:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dc800fc2-6741-4646-aaf5-14a34db16243" } file = clients/ddm-admin-client/src/lib.rs:177
2022024-11-22T05:50:12.566ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2032024-11-22T05:50:12.572ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:40649 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2042024-11-22T05:50:12.572ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2052024-11-22T05:50:12.572ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:40649 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2062024-11-22T05:50:12.573ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 231.925033ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2072024-11-22T05:50:12.574ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2082024-11-22T05:50:12.574ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2092024-11-22T05:50:12.574ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:927 underlay_address = fd00:1122:3344:101::1
2102024-11-22T05:50:12.574ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2112024-11-22T05:50:12.807ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 422.600927ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2122024-11-22T05:50:12.858ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2132024-11-22T05:50:13.230ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.189434201s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2142024-11-22T05:50:14.422ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.538861574s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2152024-11-22T05:50:15.080ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2676
2162024-11-22T05:50:15.080ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2921
2172024-11-22T05:50:15.080ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2546
2182024-11-22T05:50:15.080ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2593
2192024-11-22T05:50:15.080ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3002
2202024-11-22T05:50:15.080ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3047
2212024-11-22T05:50:15.082ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2846
2222024-11-22T05:50:15.084ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2587
2232024-11-22T05:50:15.084ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='17286167-dd73-465f-a75b-b28db2251b15'/> <propval type="astring" name="rack_id" value='bc798e4e-a9f0-45a6-90cf-a2cdd3f22375'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe50:e4f8'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='bc798e4e-a9f0-45a6-90cf-a2cdd3f22375'/> <propval type="astring" name="sled_id" value='94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9'/> <propval type="astring" name="rack_uuid" value='bc798e4e-a9f0-45a6-90cf-a2cdd3f22375'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9'/> <propval type="astring" name="rack_uuid" value='bc798e4e-a9f0-45a6-90cf-a2cdd3f22375'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2242024-11-22T05:50:15.084ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2252024-11-22T05:50:15.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 34.000084ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-11-22T05:50:15.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 80.963015ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-11-22T05:50:15.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 147.71839ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282024-11-22T05:50:15.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 246.285552ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-11-22T05:50:15.963ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.699282583s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2302024-11-22T05:50:16.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.036983584s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-11-22T05:50:17.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.19082943s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2322024-11-22T05:50:18.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 788.840439ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2332024-11-22T05:50:19.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.171745715s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2342024-11-22T05:50:20.664ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.654485848s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2352024-11-22T05:50:21.193ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2362024-11-22T05:50:21.193ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2372024-11-22T05:50:21.195ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2382024-11-22T05:50:21.195ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2392024-11-22T05:50:21.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2402024-11-22T05:50:21.195ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2412024-11-22T05:50:21.195ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/sled-agent-request.json"
2422024-11-22T05:50:21.195ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:200
2432024-11-22T05:50:21.195ZINFOSledAgent (SledAgentMain): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/sled-agent-request.json"
2442024-11-22T05:50:21.195ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2452024-11-22T05:50:21.195ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2462024-11-22T05:50:21.195ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:4005
2472024-11-22T05:50:21.195ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:34964
2482024-11-22T05:50:21.396ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2492024-11-22T05:50:21.396ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2502024-11-22T05:50:21.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-11-22T05:50:21.396ZINFOSledAgent (RSS): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2522024-11-22T05:50:21.396ZINFOSledAgent (RSS): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/rss-service-plan-v5.json file = common/src/ledger.rs:189
2532024-11-22T05:50:21.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2542024-11-22T05:50:21.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2552024-11-22T05:50:21.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2562024-11-22T05:50:21.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2572024-11-22T05:50:21.400ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4326 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2582024-11-22T05:50:21.400ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4342
2592024-11-22T05:50:21.400ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2602024-11-22T05:50:21.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59165
2612024-11-22T05:50:21.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2622024-11-22T05:50:21.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2632024-11-22T05:50:21.675ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:189
2642024-11-22T05:50:21.675ZINFOSledAgent (ServiceManager): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:189
2652024-11-22T05:50:21.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59165 req_id = 1286b00d-e6f0-4505-b506-7f897969f3ed response_code = 200 uri = /inventory
2662024-11-22T05:50:21.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43984
2672024-11-22T05:50:21.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43984 req_id = b0410a2c-444c-4551-a37d-617dbadda851 response_code = 200 uri = /sled-role
2682024-11-22T05:50:21.709ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2692024-11-22T05:50:21.709ZINFOSledAgent (RSS): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2702024-11-22T05:50:21.710ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/rss-service-plan-v5.json"
2712024-11-22T05:50:21.710ZINFOSledAgent (RSS): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:200
2722024-11-22T05:50:21.710ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/rss-service-plan-v5.json"
2732024-11-22T05:50:21.710ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:980
2742024-11-22T05:50:21.742ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f3dcc6fa-5099-42aa-bdbd-040b5d2a3887, pool_id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a354975e-fbfd-4bb2-aed1-4eb7a1e859bb, pool_id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 50f74488-91f8-47df-b65f-f3eb737fe9b3, pool_id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 332c913e-4287-4886-89bf-9fa65ec57190, pool_id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 7ed0ac72-0468-4dfc-b27d-33304451f478, pool_id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: afbf2060-5d39-44e2-a8d2-5880f6fd01b2, pool_id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: daf839e5-3e9c-4083-9151-e8957e38f197, pool_id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 540b80da-ba80-4213-9ada-a397551c2e3f, pool_id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 17774756-626f-45d4-b6e6-64c75cf71e1e, pool_id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool) }] } file = sled-agent/src/rack_setup/service.rs:382 sled_address = [fd00:1122:3344:101::1]:12345
2752024-11-22T05:50:21.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59748
2762024-11-22T05:50:21.742ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:884 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2772024-11-22T05:50:21.742ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: f3dcc6fa-5099-42aa-bdbd-040b5d2a3887, pool_id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: a354975e-fbfd-4bb2-aed1-4eb7a1e859bb, pool_id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 50f74488-91f8-47df-b65f-f3eb737fe9b3, pool_id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 332c913e-4287-4886-89bf-9fa65ec57190, pool_id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 7ed0ac72-0468-4dfc-b27d-33304451f478, pool_id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: afbf2060-5d39-44e2-a8d2-5880f6fd01b2, pool_id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: daf839e5-3e9c-4083-9151-e8957e38f197, pool_id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 540b80da-ba80-4213-9ada-a397551c2e3f, pool_id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 17774756-626f-45d4-b6e6-64c75cf71e1e, pool_id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2782024-11-22T05:50:21.742ZINFOSledAgent (StorageManager): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2792024-11-22T05:50:21.742ZINFOSledAgent (StorageManager): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-physical-disks.json file = common/src/ledger.rs:189 request = omicron_physical_disks_ensure
2802024-11-22T05:50:21.742ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1175 request = omicron_physical_disks_ensure
2812024-11-22T05:50:21.742ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2822024-11-22T05:50:21.742ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2832024-11-22T05:50:21.742ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-11-22T05:50:21.742ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2852024-11-22T05:50:21.885ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2862024-11-22T05:50:21.885ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool)
2872024-11-22T05:50:22.337ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2882024-11-22T05:50:22.545ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2892024-11-22T05:50:22.576ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2902024-11-22T05:50:22.576ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
2912024-11-22T05:50:22.595ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }
2922024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2932024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2942024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2952024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2962024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2972024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2982024-11-22T05:50:22.603ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2992024-11-22T05:50:22.639ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3002024-11-22T05:50:22.647ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone file = sled-storage/src/dataset.rs:303
3012024-11-22T05:50:22.818ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 file = sled-storage/src/dataset.rs:389
3022024-11-22T05:50:22.824ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
3032024-11-22T05:50:22.824ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
3042024-11-22T05:50:22.824ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
3052024-11-22T05:50:22.824ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3062024-11-22T05:50:22.824ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
3072024-11-22T05:50:22.834ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
3082024-11-22T05:50:22.834ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool)
3092024-11-22T05:50:22.930ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }
3102024-11-22T05:50:22.938ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
3112024-11-22T05:50:22.939ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
3122024-11-22T05:50:22.939ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
3132024-11-22T05:50:22.939ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
3142024-11-22T05:50:22.939ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3152024-11-22T05:50:22.939ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3162024-11-22T05:50:22.939ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3172024-11-22T05:50:22.975ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3182024-11-22T05:50:22.983ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone file = sled-storage/src/dataset.rs:303
3192024-11-22T05:50:23.157ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5011025a-5007-4e18-bad6-3b867e3bc813 file = sled-storage/src/dataset.rs:389
3202024-11-22T05:50:23.166ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3212024-11-22T05:50:23.166ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3222024-11-22T05:50:23.166ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3232024-11-22T05:50:23.166ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3242024-11-22T05:50:23.166ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3252024-11-22T05:50:23.175ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3262024-11-22T05:50:23.175ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f4e28855-9173-4d42-9164-2e22168b6a5d (zpool)
3272024-11-22T05:50:23.270ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }
3282024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3292024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3302024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3312024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3322024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3332024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3342024-11-22T05:50:23.278ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3352024-11-22T05:50:23.314ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3362024-11-22T05:50:23.322ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone file = sled-storage/src/dataset.rs:303
3372024-11-22T05:50:23.340ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
3382024-11-22T05:50:23.499ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f4e28855-9173-4d42-9164-2e22168b6a5d file = sled-storage/src/dataset.rs:389
3392024-11-22T05:50:23.507ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3402024-11-22T05:50:23.507ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3412024-11-22T05:50:23.507ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3422024-11-22T05:50:23.507ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3432024-11-22T05:50:23.507ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3442024-11-22T05:50:23.518ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3452024-11-22T05:50:23.518ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool)
3462024-11-22T05:50:23.612ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }
3472024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3482024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3492024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3502024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3512024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3522024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3532024-11-22T05:50:23.620ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3542024-11-22T05:50:23.656ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3552024-11-22T05:50:23.663ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone file = sled-storage/src/dataset.rs:303
3562024-11-22T05:50:23.832ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 file = sled-storage/src/dataset.rs:389
3572024-11-22T05:50:23.839ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3582024-11-22T05:50:23.839ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3592024-11-22T05:50:23.839ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3602024-11-22T05:50:23.839ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3612024-11-22T05:50:23.839ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3622024-11-22T05:50:23.848ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3632024-11-22T05:50:23.848ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool)
3642024-11-22T05:50:23.939ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }
3652024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3662024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3672024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3682024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3692024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3702024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3712024-11-22T05:50:23.947ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3722024-11-22T05:50:23.982ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3732024-11-22T05:50:23.990ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone file = sled-storage/src/dataset.rs:303
3742024-11-22T05:50:24.172ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e file = sled-storage/src/dataset.rs:389
3752024-11-22T05:50:24.180ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3762024-11-22T05:50:24.180ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3772024-11-22T05:50:24.180ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3782024-11-22T05:50:24.180ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3792024-11-22T05:50:24.180ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3802024-11-22T05:50:24.190ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3812024-11-22T05:50:24.190ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool)
3822024-11-22T05:50:24.290ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }
3832024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3842024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3852024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3862024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3872024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3882024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3892024-11-22T05:50:24.298ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3902024-11-22T05:50:24.333ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912024-11-22T05:50:24.342ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone file = sled-storage/src/dataset.rs:303
3922024-11-22T05:50:24.345ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
3932024-11-22T05:50:24.520ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_38f500bf-3a39-433c-8745-e20b3ab66215 file = sled-storage/src/dataset.rs:389
3942024-11-22T05:50:24.528ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3952024-11-22T05:50:24.528ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3962024-11-22T05:50:24.528ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3972024-11-22T05:50:24.528ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3982024-11-22T05:50:24.528ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3992024-11-22T05:50:24.538ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
4002024-11-22T05:50:24.538ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool)
4012024-11-22T05:50:24.632ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }
4022024-11-22T05:50:24.640ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
4032024-11-22T05:50:24.640ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
4042024-11-22T05:50:24.640ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
4052024-11-22T05:50:24.640ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
4062024-11-22T05:50:24.640ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-11-22T05:50:24.641ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
4082024-11-22T05:50:24.641ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4092024-11-22T05:50:24.680ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4102024-11-22T05:50:24.688ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone file = sled-storage/src/dataset.rs:303
4112024-11-22T05:50:24.868ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9 file = sled-storage/src/dataset.rs:389
4122024-11-22T05:50:24.881ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4132024-11-22T05:50:24.881ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4142024-11-22T05:50:24.881ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4152024-11-22T05:50:24.881ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4162024-11-22T05:50:24.881ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4172024-11-22T05:50:24.893ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4182024-11-22T05:50:24.893ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool)
4192024-11-22T05:50:24.995ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }
4202024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4212024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4222024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4232024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4242024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4262024-11-22T05:50:25.003ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4272024-11-22T05:50:25.040ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282024-11-22T05:50:25.049ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone file = sled-storage/src/dataset.rs:303
4292024-11-22T05:50:25.228ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d file = sled-storage/src/dataset.rs:389
4302024-11-22T05:50:25.239ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4312024-11-22T05:50:25.239ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4322024-11-22T05:50:25.239ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4332024-11-22T05:50:25.239ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4342024-11-22T05:50:25.239ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4352024-11-22T05:50:25.250ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4362024-11-22T05:50:25.250ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 633ab940-354c-4903-be3d-50b19510ea4f (zpool)
4372024-11-22T05:50:25.347ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }
4382024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4392024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4402024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4412024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4422024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4432024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4442024-11-22T05:50:25.356ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4452024-11-22T05:50:25.359ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4462024-11-22T05:50:25.394ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4472024-11-22T05:50:25.402ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_633ab940-354c-4903-be3d-50b19510ea4f/crypt/zone file = sled-storage/src/dataset.rs:303
4482024-11-22T05:50:25.576ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_633ab940-354c-4903-be3d-50b19510ea4f file = sled-storage/src/dataset.rs:389
4492024-11-22T05:50:25.584ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4502024-11-22T05:50:25.584ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4512024-11-22T05:50:25.584ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4522024-11-22T05:50:25.584ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7611e6e5-6a68-4a9f-8263-186d30fed23e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11576e0f-ec9d-409a-acd8-2416d9925a5d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4532024-11-22T05:50:25.584ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4542024-11-22T05:50:25.584ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4552024-11-22T05:50:25.584ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4562024-11-22T05:50:25.584ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:200 request = omicron_physical_disks_ensure
4572024-11-22T05:50:25.584ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-physical-disks.json" request = omicron_physical_disks_ensure
4582024-11-22T05:50:25.585ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:888 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4592024-11-22T05:50:25.585ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4602024-11-22T05:50:25.585ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:914 generation = Generation(1) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4612024-11-22T05:50:25.585ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:919 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4622024-11-22T05:50:25.585ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:924 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4632024-11-22T05:50:25.585ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4642024-11-22T05:50:25.585ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:930 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4652024-11-22T05:50:25.585ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4662024-11-22T05:50:25.585ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:935 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4672024-11-22T05:50:25.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3843070 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59748 req_id = 82ce2ec4-ca05-44d2-b5f5-502d43b0fe91 response_code = 200 uri = /omicron-physical-disks
4682024-11-22T05:50:25.616ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0b32c95b-52e6-4075-a824-5eed76613df2 (dataset): DatasetConfig { id: 0b32c95b-52e6-4075-a824-5eed76613df2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c84b262-7c48-4f00-b39b-9dd597b916f3 (dataset): DatasetConfig { id: 0c84b262-7c48-4f00-b39b-9dd597b916f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e0487c3-12f1-4c8f-b1c5-c05882a4a57f (dataset): DatasetConfig { id: 0e0487c3-12f1-4c8f-b1c5-c05882a4a57f (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e40dfba-3930-404b-8e4b-ae448122a1ed (dataset): DatasetConfig { id: 0e40dfba-3930-404b-8e4b-ae448122a1ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 122a4e40-ee66-4a0f-a2eb-bb5173af7843 (dataset): DatasetConfig { id: 122a4e40-ee66-4a0f-a2eb-bb5173af7843 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13a29bf5-8497-453a-a598-8d5c28e91ca1 (dataset): DatasetConfig { id: 13a29bf5-8497-453a-a598-8d5c28e91ca1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d6c7e7b-7963-41b6-83f3-d68d4aea97f8 (dataset): DatasetConfig { id: 1d6c7e7b-7963-41b6-83f3-d68d4aea97f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2299bf92-1ee9-4b73-998f-5d30fee922d4 (dataset): DatasetConfig { id: 2299bf92-1ee9-4b73-998f-5d30fee922d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25311c90-de5f-4516-81c0-0786b599c71d (dataset): DatasetConfig { id: 25311c90-de5f-4516-81c0-0786b599c71d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 25e85320-4621-48c0-845c-6dfede659147 (dataset): DatasetConfig { id: 25e85320-4621-48c0-845c-6dfede659147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 294dd82c-67fd-4662-8f06-6182c976906a (dataset): DatasetConfig { id: 294dd82c-67fd-4662-8f06-6182c976906a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 296bc432-29f0-4b54-99ef-e834e0968251 (dataset): DatasetConfig { id: 296bc432-29f0-4b54-99ef-e834e0968251 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a7a226c-aec6-40c5-825a-d6e1b705be18 (dataset): DatasetConfig { id: 2a7a226c-aec6-40c5-825a-d6e1b705be18 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ab17185-a596-479a-a673-6a6e5aa1610d (dataset): DatasetConfig { id: 2ab17185-a596-479a-a673-6a6e5aa1610d (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d9577b7-3e45-4e7b-9639-99861b7d5d46 (dataset): DatasetConfig { id: 2d9577b7-3e45-4e7b-9639-99861b7d5d46 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2dad3444-a76f-4b50-bd20-3d2eae138a06 (dataset): DatasetConfig { id: 2dad3444-a76f-4b50-bd20-3d2eae138a06 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e6dceac-01ce-4224-8e2f-ce6debe66301 (dataset): DatasetConfig { id: 2e6dceac-01ce-4224-8e2f-ce6debe66301 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32b613c2-ddfd-4da4-9983-76c9c6dd24be (dataset): DatasetConfig { id: 32b613c2-ddfd-4da4-9983-76c9c6dd24be (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 368765c1-6d90-46f6-b1fd-93727f8abb00 (dataset): DatasetConfig { id: 368765c1-6d90-46f6-b1fd-93727f8abb00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38e1ec93-9774-454e-9891-6c9a7a97730f (dataset): DatasetConfig { id: 38e1ec93-9774-454e-9891-6c9a7a97730f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45ddcc07-657e-41be-916f-620706e731f3 (dataset): DatasetConfig { id: 45ddcc07-657e-41be-916f-620706e731f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a160a9f-be26-404a-bbc1-16a277f6dca4 (dataset): DatasetConfig { id: 4a160a9f-be26-404a-bbc1-16a277f6dca4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af45c01-e2c7-4fff-8551-62ffc34cc99a (dataset): DatasetConfig { id: 4af45c01-e2c7-4fff-8551-62ffc34cc99a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d42719c-686e-4518-9fee-602434dbd4e7 (dataset): DatasetConfig { id: 4d42719c-686e-4518-9fee-602434dbd4e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e309b15-6eae-479d-b24a-a559e3f98326 (dataset): DatasetConfig { id: 4e309b15-6eae-479d-b24a-a559e3f98326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54486cbb-f436-42d5-95ba-65d23da1b69c (dataset): DatasetConfig { id: 54486cbb-f436-42d5-95ba-65d23da1b69c (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 557228a3-dc86-4d43-b416-b37748ebf0af (dataset): DatasetConfig { id: 557228a3-dc86-4d43-b416-b37748ebf0af (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 582ca867-abc1-4e94-940d-e62fdbd8c2a5 (dataset): DatasetConfig { id: 582ca867-abc1-4e94-940d-e62fdbd8c2a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b0f56c4-fb59-4366-8354-911bdeb8f023 (dataset): DatasetConfig { id: 5b0f56c4-fb59-4366-8354-911bdeb8f023 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6464853d-5ae9-4e33-9765-c0049559cf09 (dataset): DatasetConfig { id: 6464853d-5ae9-4e33-9765-c0049559cf09 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64f129a9-63c6-4bec-855e-b74f478d9efd (dataset): DatasetConfig { id: 64f129a9-63c6-4bec-855e-b74f478d9efd (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a969093-b2bc-4340-8358-db7ceda1041f (dataset): DatasetConfig { id: 6a969093-b2bc-4340-8358-db7ceda1041f (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ba9f391-c35d-45b5-a30e-5ee42a6b4329 (dataset): DatasetConfig { id: 6ba9f391-c35d-45b5-a30e-5ee42a6b4329 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72bb6f06-114b-41ca-9330-b0335b124996 (dataset): DatasetConfig { id: 72bb6f06-114b-41ca-9330-b0335b124996 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 760b1d20-7b11-43ef-b7b5-bff426c06e6c (dataset): DatasetConfig { id: 760b1d20-7b11-43ef-b7b5-bff426c06e6c (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ae04735-9ad9-4d72-b5a1-19bc53a8202b (dataset): DatasetConfig { id: 7ae04735-9ad9-4d72-b5a1-19bc53a8202b (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e7d580c-c750-4a79-a15c-266d236f405b (dataset): DatasetConfig { id: 8e7d580c-c750-4a79-a15c-266d236f405b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 906b9d59-4cd3-4910-83cc-857efe69de66 (dataset): DatasetConfig { id: 906b9d59-4cd3-4910-83cc-857efe69de66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92de9c74-1927-4362-bcdd-4891b8f9cf5d (dataset): DatasetConfig { id: 92de9c74-1927-4362-bcdd-4891b8f9cf5d (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9805face-dd25-4f8d-9366-7b1833743f94 (dataset): DatasetConfig { id: 9805face-dd25-4f8d-9366-7b1833743f94 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98958e4d-aa0a-4ca2-af26-41adc607e0eb (dataset): DatasetConfig { id: 98958e4d-aa0a-4ca2-af26-41adc607e0eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a547cbc2-ec02-4b60-b3d4-7106252329f5 (dataset): DatasetConfig { id: a547cbc2-ec02-4b60-b3d4-7106252329f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a84eb44e-c9bc-4d39-93b2-81429d20f9f1 (dataset): DatasetConfig { id: a84eb44e-c9bc-4d39-93b2-81429d20f9f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9f42f29-b3bd-42a1-b7fa-bbba58d4383a (dataset): DatasetConfig { id: a9f42f29-b3bd-42a1-b7fa-bbba58d4383a (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad4e6d50-a026-4646-91d4-6949669e6628 (dataset): DatasetConfig { id: ad4e6d50-a026-4646-91d4-6949669e6628 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae22ac48-62be-415a-acf8-01218b68169a (dataset): DatasetConfig { id: ae22ac48-62be-415a-acf8-01218b68169a (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b3c353b3-ae34-40bc-a722-68f7debd5afe (dataset): DatasetConfig { id: b3c353b3-ae34-40bc-a722-68f7debd5afe (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b61ecbc3-3507-4039-92d1-fb01a329afa2 (dataset): DatasetConfig { id: b61ecbc3-3507-4039-92d1-fb01a329afa2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b63ae942-8da5-4152-9f50-6280266c7b10 (dataset): DatasetConfig { id: b63ae942-8da5-4152-9f50-6280266c7b10 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b864b86a-acb4-4ba9-93ae-4c378a136580 (dataset): DatasetConfig { id: b864b86a-acb4-4ba9-93ae-4c378a136580 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6f864b1-42d2-41b7-b140-d97bec14c2ba (dataset): DatasetConfig { id: c6f864b1-42d2-41b7-b140-d97bec14c2ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c97d4f1c-bcc0-464d-9d7c-7449307682cb (dataset): DatasetConfig { id: c97d4f1c-bcc0-464d-9d7c-7449307682cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce2a934a-ee1c-4652-9116-02ef62158f79 (dataset): DatasetConfig { id: ce2a934a-ee1c-4652-9116-02ef62158f79 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d08ca22b-5260-4ed1-85fb-8f3ea89bf8ba (dataset): DatasetConfig { id: d08ca22b-5260-4ed1-85fb-8f3ea89bf8ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d1b9a0af-a3f9-45c8-bb71-bd6614f6ec72 (dataset): DatasetConfig { id: d1b9a0af-a3f9-45c8-bb71-bd6614f6ec72 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d57a59fd-c156-40df-85f6-d1b78be6d815 (dataset): DatasetConfig { id: d57a59fd-c156-40df-85f6-d1b78be6d815 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dae8cd35-dce1-4285-b3fa-63438f670043 (dataset): DatasetConfig { id: dae8cd35-dce1-4285-b3fa-63438f670043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db7595d9-3d30-46c0-bdec-902ac47b16b2 (dataset): DatasetConfig { id: db7595d9-3d30-46c0-bdec-902ac47b16b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db86c181-9bc9-4a8e-8e2c-aa43524dba52 (dataset): DatasetConfig { id: db86c181-9bc9-4a8e-8e2c-aa43524dba52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4fc99d2-306f-4261-8ee2-19dc9ae3b1e3 (dataset): DatasetConfig { id: e4fc99d2-306f-4261-8ee2-19dc9ae3b1e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f103314e-c8a0-4149-862f-dbfb61fcdd83 (dataset): DatasetConfig { id: f103314e-c8a0-4149-862f-dbfb61fcdd83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f15985f8-51e8-4608-b63f-b5ed59da36f3 (dataset): DatasetConfig { id: f15985f8-51e8-4608-b63f-b5ed59da36f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4e5a888-9bcd-40fb-8eb7-64e2adbed7e5 (dataset): DatasetConfig { id: f4e5a888-9bcd-40fb-8eb7-64e2adbed7e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa7d022b-d2d8-4797-ad73-7663f5247551 (dataset): DatasetConfig { id: fa7d022b-d2d8-4797-ad73-7663f5247551 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa9c2a3c-58d3-4563-af22-899762738602 (dataset): DatasetConfig { id: fa9c2a3c-58d3-4563-af22-899762738602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe106e70-4c40-40fb-9df4-25eec0de2fb9 (dataset): DatasetConfig { id: fe106e70-4c40-40fb-9df4-25eec0de2fb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:457 sled_address = [fd00:1122:3344:101::1]:12345
4692024-11-22T05:50:25.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61075
4702024-11-22T05:50:25.617ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:850 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4712024-11-22T05:50:25.617ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0b32c95b-52e6-4075-a824-5eed76613df2 (dataset): DatasetConfig { id: 0b32c95b-52e6-4075-a824-5eed76613df2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0c84b262-7c48-4f00-b39b-9dd597b916f3 (dataset): DatasetConfig { id: 0c84b262-7c48-4f00-b39b-9dd597b916f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e0487c3-12f1-4c8f-b1c5-c05882a4a57f (dataset): DatasetConfig { id: 0e0487c3-12f1-4c8f-b1c5-c05882a4a57f (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e40dfba-3930-404b-8e4b-ae448122a1ed (dataset): DatasetConfig { id: 0e40dfba-3930-404b-8e4b-ae448122a1ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 122a4e40-ee66-4a0f-a2eb-bb5173af7843 (dataset): DatasetConfig { id: 122a4e40-ee66-4a0f-a2eb-bb5173af7843 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13a29bf5-8497-453a-a598-8d5c28e91ca1 (dataset): DatasetConfig { id: 13a29bf5-8497-453a-a598-8d5c28e91ca1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1d6c7e7b-7963-41b6-83f3-d68d4aea97f8 (dataset): DatasetConfig { id: 1d6c7e7b-7963-41b6-83f3-d68d4aea97f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2299bf92-1ee9-4b73-998f-5d30fee922d4 (dataset): DatasetConfig { id: 2299bf92-1ee9-4b73-998f-5d30fee922d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25311c90-de5f-4516-81c0-0786b599c71d (dataset): DatasetConfig { id: 25311c90-de5f-4516-81c0-0786b599c71d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 25e85320-4621-48c0-845c-6dfede659147 (dataset): DatasetConfig { id: 25e85320-4621-48c0-845c-6dfede659147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 294dd82c-67fd-4662-8f06-6182c976906a (dataset): DatasetConfig { id: 294dd82c-67fd-4662-8f06-6182c976906a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 296bc432-29f0-4b54-99ef-e834e0968251 (dataset): DatasetConfig { id: 296bc432-29f0-4b54-99ef-e834e0968251 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a7a226c-aec6-40c5-825a-d6e1b705be18 (dataset): DatasetConfig { id: 2a7a226c-aec6-40c5-825a-d6e1b705be18 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2ab17185-a596-479a-a673-6a6e5aa1610d (dataset): DatasetConfig { id: 2ab17185-a596-479a-a673-6a6e5aa1610d (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2d9577b7-3e45-4e7b-9639-99861b7d5d46 (dataset): DatasetConfig { id: 2d9577b7-3e45-4e7b-9639-99861b7d5d46 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2dad3444-a76f-4b50-bd20-3d2eae138a06 (dataset): DatasetConfig { id: 2dad3444-a76f-4b50-bd20-3d2eae138a06 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e6dceac-01ce-4224-8e2f-ce6debe66301 (dataset): DatasetConfig { id: 2e6dceac-01ce-4224-8e2f-ce6debe66301 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32b613c2-ddfd-4da4-9983-76c9c6dd24be (dataset): DatasetConfig { id: 32b613c2-ddfd-4da4-9983-76c9c6dd24be (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 368765c1-6d90-46f6-b1fd-93727f8abb00 (dataset): DatasetConfig { id: 368765c1-6d90-46f6-b1fd-93727f8abb00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 38e1ec93-9774-454e-9891-6c9a7a97730f (dataset): DatasetConfig { id: 38e1ec93-9774-454e-9891-6c9a7a97730f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45ddcc07-657e-41be-916f-620706e731f3 (dataset): DatasetConfig { id: 45ddcc07-657e-41be-916f-620706e731f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a160a9f-be26-404a-bbc1-16a277f6dca4 (dataset): DatasetConfig { id: 4a160a9f-be26-404a-bbc1-16a277f6dca4 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af45c01-e2c7-4fff-8551-62ffc34cc99a (dataset): DatasetConfig { id: 4af45c01-e2c7-4fff-8551-62ffc34cc99a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d42719c-686e-4518-9fee-602434dbd4e7 (dataset): DatasetConfig { id: 4d42719c-686e-4518-9fee-602434dbd4e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e309b15-6eae-479d-b24a-a559e3f98326 (dataset): DatasetConfig { id: 4e309b15-6eae-479d-b24a-a559e3f98326 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54486cbb-f436-42d5-95ba-65d23da1b69c (dataset): DatasetConfig { id: 54486cbb-f436-42d5-95ba-65d23da1b69c (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 557228a3-dc86-4d43-b416-b37748ebf0af (dataset): DatasetConfig { id: 557228a3-dc86-4d43-b416-b37748ebf0af (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 582ca867-abc1-4e94-940d-e62fdbd8c2a5 (dataset): DatasetConfig { id: 582ca867-abc1-4e94-940d-e62fdbd8c2a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5b0f56c4-fb59-4366-8354-911bdeb8f023 (dataset): DatasetConfig { id: 5b0f56c4-fb59-4366-8354-911bdeb8f023 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6464853d-5ae9-4e33-9765-c0049559cf09 (dataset): DatasetConfig { id: 6464853d-5ae9-4e33-9765-c0049559cf09 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64f129a9-63c6-4bec-855e-b74f478d9efd (dataset): DatasetConfig { id: 64f129a9-63c6-4bec-855e-b74f478d9efd (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a969093-b2bc-4340-8358-db7ceda1041f (dataset): DatasetConfig { id: 6a969093-b2bc-4340-8358-db7ceda1041f (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ba9f391-c35d-45b5-a30e-5ee42a6b4329 (dataset): DatasetConfig { id: 6ba9f391-c35d-45b5-a30e-5ee42a6b4329 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72bb6f06-114b-41ca-9330-b0335b124996 (dataset): DatasetConfig { id: 72bb6f06-114b-41ca-9330-b0335b124996 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 760b1d20-7b11-43ef-b7b5-bff426c06e6c (dataset): DatasetConfig { id: 760b1d20-7b11-43ef-b7b5-bff426c06e6c (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ae04735-9ad9-4d72-b5a1-19bc53a8202b (dataset): DatasetConfig { id: 7ae04735-9ad9-4d72-b5a1-19bc53a8202b (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e7d580c-c750-4a79-a15c-266d236f405b (dataset): DatasetConfig { id: 8e7d580c-c750-4a79-a15c-266d236f405b (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 906b9d59-4cd3-4910-83cc-857efe69de66 (dataset): DatasetConfig { id: 906b9d59-4cd3-4910-83cc-857efe69de66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92de9c74-1927-4362-bcdd-4891b8f9cf5d (dataset): DatasetConfig { id: 92de9c74-1927-4362-bcdd-4891b8f9cf5d (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9805face-dd25-4f8d-9366-7b1833743f94 (dataset): DatasetConfig { id: 9805face-dd25-4f8d-9366-7b1833743f94 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 98958e4d-aa0a-4ca2-af26-41adc607e0eb (dataset): DatasetConfig { id: 98958e4d-aa0a-4ca2-af26-41adc607e0eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a547cbc2-ec02-4b60-b3d4-7106252329f5 (dataset): DatasetConfig { id: a547cbc2-ec02-4b60-b3d4-7106252329f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a84eb44e-c9bc-4d39-93b2-81429d20f9f1 (dataset): DatasetConfig { id: a84eb44e-c9bc-4d39-93b2-81429d20f9f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9f42f29-b3bd-42a1-b7fa-bbba58d4383a (dataset): DatasetConfig { id: a9f42f29-b3bd-42a1-b7fa-bbba58d4383a (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad4e6d50-a026-4646-91d4-6949669e6628 (dataset): DatasetConfig { id: ad4e6d50-a026-4646-91d4-6949669e6628 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae22ac48-62be-415a-acf8-01218b68169a (dataset): DatasetConfig { id: ae22ac48-62be-415a-acf8-01218b68169a (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b3c353b3-ae34-40bc-a722-68f7debd5afe (dataset): DatasetConfig { id: b3c353b3-ae34-40bc-a722-68f7debd5afe (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b61ecbc3-3507-4039-92d1-fb01a329afa2 (dataset): DatasetConfig { id: b61ecbc3-3507-4039-92d1-fb01a329afa2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b63ae942-8da5-4152-9f50-6280266c7b10 (dataset): DatasetConfig { id: b63ae942-8da5-4152-9f50-6280266c7b10 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b864b86a-acb4-4ba9-93ae-4c378a136580 (dataset): DatasetConfig { id: b864b86a-acb4-4ba9-93ae-4c378a136580 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6f864b1-42d2-41b7-b140-d97bec14c2ba (dataset): DatasetConfig { id: c6f864b1-42d2-41b7-b140-d97bec14c2ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c97d4f1c-bcc0-464d-9d7c-7449307682cb (dataset): DatasetConfig { id: c97d4f1c-bcc0-464d-9d7c-7449307682cb (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ce2a934a-ee1c-4652-9116-02ef62158f79 (dataset): DatasetConfig { id: ce2a934a-ee1c-4652-9116-02ef62158f79 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d08ca22b-5260-4ed1-85fb-8f3ea89bf8ba (dataset): DatasetConfig { id: d08ca22b-5260-4ed1-85fb-8f3ea89bf8ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d1b9a0af-a3f9-45c8-bb71-bd6614f6ec72 (dataset): DatasetConfig { id: d1b9a0af-a3f9-45c8-bb71-bd6614f6ec72 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d57a59fd-c156-40df-85f6-d1b78be6d815 (dataset): DatasetConfig { id: d57a59fd-c156-40df-85f6-d1b78be6d815 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dae8cd35-dce1-4285-b3fa-63438f670043 (dataset): DatasetConfig { id: dae8cd35-dce1-4285-b3fa-63438f670043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db7595d9-3d30-46c0-bdec-902ac47b16b2 (dataset): DatasetConfig { id: db7595d9-3d30-46c0-bdec-902ac47b16b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db86c181-9bc9-4a8e-8e2c-aa43524dba52 (dataset): DatasetConfig { id: db86c181-9bc9-4a8e-8e2c-aa43524dba52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4fc99d2-306f-4261-8ee2-19dc9ae3b1e3 (dataset): DatasetConfig { id: e4fc99d2-306f-4261-8ee2-19dc9ae3b1e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f103314e-c8a0-4149-862f-dbfb61fcdd83 (dataset): DatasetConfig { id: f103314e-c8a0-4149-862f-dbfb61fcdd83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f15985f8-51e8-4608-b63f-b5ed59da36f3 (dataset): DatasetConfig { id: f15985f8-51e8-4608-b63f-b5ed59da36f3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4e5a888-9bcd-40fb-8eb7-64e2adbed7e5 (dataset): DatasetConfig { id: f4e5a888-9bcd-40fb-8eb7-64e2adbed7e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa7d022b-d2d8-4797-ad73-7663f5247551 (dataset): DatasetConfig { id: fa7d022b-d2d8-4797-ad73-7663f5247551 (dataset), name: DatasetName { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa9c2a3c-58d3-4563-af22-899762738602 (dataset): DatasetConfig { id: fa9c2a3c-58d3-4563-af22-899762738602 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe106e70-4c40-40fb-9df4-25eec0de2fb9 (dataset): DatasetConfig { id: fe106e70-4c40-40fb-9df4-25eec0de2fb9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4722024-11-22T05:50:25.617ZINFOSledAgent (StorageManager): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4732024-11-22T05:50:25.617ZINFOSledAgent (StorageManager): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-datasets.json file = common/src/ledger.rs:189 request = datasets_ensure
4742024-11-22T05:50:25.617ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:906 request = datasets_ensure
4752024-11-22T05:50:25.617ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4762024-11-22T05:50:25.617ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/633ab940-354c-4903-be3d-50b19510ea4f/crypt/zone/oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec"), full_name: "oxp_633ab940-354c-4903-be3d-50b19510ea4f/crypt/zone/oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec" } file = sled-storage/src/manager.rs:1338
4772024-11-22T05:50:25.718ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4782024-11-22T05:50:25.718ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/debug"), full_name: "oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/debug" } file = sled-storage/src/manager.rs:1338
4792024-11-22T05:50:25.786ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4802024-11-22T05:50:25.786ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crucible" } file = sled-storage/src/manager.rs:1338
4812024-11-22T05:50:25.875ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4822024-11-22T05:50:25.875ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/633ab940-354c-4903-be3d-50b19510ea4f/crypt/debug"), full_name: "oxp_633ab940-354c-4903-be3d-50b19510ea4f/crypt/debug" } file = sled-storage/src/manager.rs:1338
4832024-11-22T05:50:25.944ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4842024-11-22T05:50:25.944ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crucible" } file = sled-storage/src/manager.rs:1338
4852024-11-22T05:50:26.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4862024-11-22T05:50:26.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551" } file = sled-storage/src/manager.rs:1338
4872024-11-22T05:50:26.131ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4882024-11-22T05:50:26.131ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone" } file = sled-storage/src/manager.rs:1338
4892024-11-22T05:50:26.198ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4902024-11-22T05:50:26.198ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone"), full_name: "oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone" } file = sled-storage/src/manager.rs:1338
4912024-11-22T05:50:26.267ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4922024-11-22T05:50:26.267ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/debug"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/debug" } file = sled-storage/src/manager.rs:1338
4932024-11-22T05:50:26.336ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4942024-11-22T05:50:26.336ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d" } file = sled-storage/src/manager.rs:1338
4952024-11-22T05:50:26.361ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
4962024-11-22T05:50:26.437ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4972024-11-22T05:50:26.437ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
4982024-11-22T05:50:26.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
4992024-11-22T05:50:26.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crucible" } file = sled-storage/src/manager.rs:1338
5002024-11-22T05:50:26.619ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5012024-11-22T05:50:26.619ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone/oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63"), full_name: "oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone/oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63" } file = sled-storage/src/manager.rs:1338
5022024-11-22T05:50:26.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5032024-11-22T05:50:26.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crucible" } file = sled-storage/src/manager.rs:1338
5042024-11-22T05:50:26.811ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5052024-11-22T05:50:26.811ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362" } file = sled-storage/src/manager.rs:1338
5062024-11-22T05:50:26.916ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5072024-11-22T05:50:26.916ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone" } file = sled-storage/src/manager.rs:1338
5082024-11-22T05:50:26.985ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5092024-11-22T05:50:26.985ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5" } file = sled-storage/src/manager.rs:1338
5102024-11-22T05:50:27.085ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5112024-11-22T05:50:27.085ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crucible" } file = sled-storage/src/manager.rs:1338
5122024-11-22T05:50:27.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5132024-11-22T05:50:27.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone" } file = sled-storage/src/manager.rs:1338
5142024-11-22T05:50:27.237ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5152024-11-22T05:50:27.237ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b" } file = sled-storage/src/manager.rs:1338
5162024-11-22T05:50:27.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5172024-11-22T05:50:27.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5182024-11-22T05:50:27.365ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
5192024-11-22T05:50:27.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5202024-11-22T05:50:27.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5212024-11-22T05:50:27.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5222024-11-22T05:50:27.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5232024-11-22T05:50:27.607ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5242024-11-22T05:50:27.607ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/debug"), full_name: "oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/debug" } file = sled-storage/src/manager.rs:1338
5252024-11-22T05:50:27.676ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5262024-11-22T05:50:27.676ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527" } file = sled-storage/src/manager.rs:1338
5272024-11-22T05:50:27.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5282024-11-22T05:50:27.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone"), full_name: "oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone" } file = sled-storage/src/manager.rs:1338
5292024-11-22T05:50:27.846ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5302024-11-22T05:50:27.846ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85" } file = sled-storage/src/manager.rs:1338
5312024-11-22T05:50:27.946ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5322024-11-22T05:50:27.946ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/debug"), full_name: "oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/debug" } file = sled-storage/src/manager.rs:1338
5332024-11-22T05:50:28.015ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5342024-11-22T05:50:28.015ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38f500bf-3a39-433c-8745-e20b3ab66215/crypt/debug"), full_name: "oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crypt/debug" } file = sled-storage/src/manager.rs:1338
5352024-11-22T05:50:28.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5362024-11-22T05:50:28.083ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5372024-11-22T05:50:28.172ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5382024-11-22T05:50:28.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838" } file = sled-storage/src/manager.rs:1338
5392024-11-22T05:50:28.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5402024-11-22T05:50:28.273ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone/oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7"), full_name: "oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone/oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7" } file = sled-storage/src/manager.rs:1338
5412024-11-22T05:50:28.367ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
5422024-11-22T05:50:28.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5432024-11-22T05:50:28.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone" } file = sled-storage/src/manager.rs:1338
5442024-11-22T05:50:28.443ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5452024-11-22T05:50:28.443ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone/oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone/oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802" } file = sled-storage/src/manager.rs:1338
5462024-11-22T05:50:28.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5472024-11-22T05:50:28.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5482024-11-22T05:50:28.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5492024-11-22T05:50:28.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf" } file = sled-storage/src/manager.rs:1338
5502024-11-22T05:50:28.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5512024-11-22T05:50:28.729ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d" } file = sled-storage/src/manager.rs:1338
5522024-11-22T05:50:28.827ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5532024-11-22T05:50:28.827ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5542024-11-22T05:50:28.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5552024-11-22T05:50:28.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone"), full_name: "oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone" } file = sled-storage/src/manager.rs:1338
5562024-11-22T05:50:28.996ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5572024-11-22T05:50:28.996ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone/oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e"), full_name: "oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone/oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e" } file = sled-storage/src/manager.rs:1338
5582024-11-22T05:50:29.097ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5592024-11-22T05:50:29.097ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crucible" } file = sled-storage/src/manager.rs:1338
5602024-11-22T05:50:29.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5612024-11-22T05:50:29.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone/oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36"), full_name: "oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone/oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36" } file = sled-storage/src/manager.rs:1338
5622024-11-22T05:50:29.286ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5632024-11-22T05:50:29.286ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/633ab940-354c-4903-be3d-50b19510ea4f/crypt/zone"), full_name: "oxp_633ab940-354c-4903-be3d-50b19510ea4f/crypt/zone" } file = sled-storage/src/manager.rs:1338
5642024-11-22T05:50:29.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5652024-11-22T05:50:29.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone/oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone/oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a" } file = sled-storage/src/manager.rs:1338
5662024-11-22T05:50:29.370ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
5672024-11-22T05:50:29.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5682024-11-22T05:50:29.459ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/zone/oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede" } file = sled-storage/src/manager.rs:1338
5692024-11-22T05:50:29.561ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5702024-11-22T05:50:29.561ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/debug"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/debug" } file = sled-storage/src/manager.rs:1338
5712024-11-22T05:50:29.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5722024-11-22T05:50:29.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone/oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6"), full_name: "oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone/oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6" } file = sled-storage/src/manager.rs:1338
5732024-11-22T05:50:29.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5742024-11-22T05:50:29.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/external_dns" } file = sled-storage/src/manager.rs:1338
5752024-11-22T05:50:29.827ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5762024-11-22T05:50:29.827ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone/oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/zone/oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756" } file = sled-storage/src/manager.rs:1338
5772024-11-22T05:50:29.931ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5782024-11-22T05:50:29.931ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/zone/oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09" } file = sled-storage/src/manager.rs:1338
5792024-11-22T05:50:30.033ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5802024-11-22T05:50:30.033ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone"), full_name: "oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone" } file = sled-storage/src/manager.rs:1338
5812024-11-22T05:50:30.102ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5822024-11-22T05:50:30.102ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/clickhouse" } file = sled-storage/src/manager.rs:1338
5832024-11-22T05:50:30.195ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5842024-11-22T05:50:30.195ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone/oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891"), full_name: "oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/zone/oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891" } file = sled-storage/src/manager.rs:1338
5852024-11-22T05:50:30.374ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
5862024-11-22T05:50:30.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5872024-11-22T05:50:30.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/debug"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/debug" } file = sled-storage/src/manager.rs:1338
5882024-11-22T05:50:30.516ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5892024-11-22T05:50:30.516ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crucible" } file = sled-storage/src/manager.rs:1338
5902024-11-22T05:50:30.648ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5912024-11-22T05:50:30.648ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1338
5922024-11-22T05:50:30.783ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5932024-11-22T05:50:30.783ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_633ab940-354c-4903-be3d-50b19510ea4f/crucible" } file = sled-storage/src/manager.rs:1338
5942024-11-22T05:50:30.919ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5952024-11-22T05:50:30.919ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crucible" } file = sled-storage/src/manager.rs:1338
5962024-11-22T05:50:31.069ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
5972024-11-22T05:50:31.069ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1338
5982024-11-22T05:50:31.165ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
5992024-11-22T05:50:31.165ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6002024-11-22T05:50:31.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6012024-11-22T05:50:31.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone/oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19"), full_name: "oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone/oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19" } file = sled-storage/src/manager.rs:1338
6022024-11-22T05:50:31.320ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.312192338s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6032024-11-22T05:50:31.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6042024-11-22T05:50:31.362ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75" } file = sled-storage/src/manager.rs:1338
6052024-11-22T05:50:31.376ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6062024-11-22T05:50:31.407ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4350
6072024-11-22T05:50:31.407ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4360 gateway = fd00:1122:3344:101::1
6082024-11-22T05:50:31.414ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4374 gateway = fd00:1122:3344:101::1
6092024-11-22T05:50:31.414ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4439
6102024-11-22T05:50:31.518ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6112024-11-22T05:50:31.518ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/zone/oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea" } file = sled-storage/src/manager.rs:1338
6122024-11-22T05:50:31.566ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4505
6132024-11-22T05:50:31.566ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4532
6142024-11-22T05:50:31.609ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4545
6152024-11-22T05:50:31.609ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4391
6162024-11-22T05:50:31.665ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4433
6172024-11-22T05:50:31.665ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4512 rack_subnet = fd00:1122:3344::
6182024-11-22T05:50:31.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6192024-11-22T05:50:31.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone/oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938"), full_name: "oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/zone/oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938" } file = sled-storage/src/manager.rs:1338
6202024-11-22T05:50:31.688ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4523
6212024-11-22T05:50:31.688ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4565
6222024-11-22T05:50:31.758ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4597
6232024-11-22T05:50:31.758ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4603
6242024-11-22T05:50:31.824ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6252024-11-22T05:50:31.824ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone/oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab"), full_name: "oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/zone/oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab" } file = sled-storage/src/manager.rs:1338
6262024-11-22T05:50:31.850ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4644
6272024-11-22T05:50:31.850ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6282024-11-22T05:50:31.889ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/nexus.rs:530 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6292024-11-22T05:50:31.889ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
6302024-11-22T05:50:31.890ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/nexus.rs:530 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6312024-11-22T05:50:31.928ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
6322024-11-22T05:50:31.928ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:731
6332024-11-22T05:50:31.928ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:734 uptime = 0
6342024-11-22T05:50:31.928ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
6352024-11-22T05:50:31.971ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6362024-11-22T05:50:31.971ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone/oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c"), full_name: "oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crypt/zone/oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c" } file = sled-storage/src/manager.rs:1338
6372024-11-22T05:50:31.978ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
6382024-11-22T05:50:32.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:952 request = datasets_ensure
6392024-11-22T05:50:32.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/debug"), full_name: "oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/debug" } file = sled-storage/src/manager.rs:1338
6402024-11-22T05:50:32.211ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6412024-11-22T05:50:32.212ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-datasets.json" request = datasets_ensure
6422024-11-22T05:50:32.212ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:200 request = datasets_ensure
6432024-11-22T05:50:32.212ZINFOSledAgent (StorageManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-datasets.json" request = datasets_ensure
6442024-11-22T05:50:32.212ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6452024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6462024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6472024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6482024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6492024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6502024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6512024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6522024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6532024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6542024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6552024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6562024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6572024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6582024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6592024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6602024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6612024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6622024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6632024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6642024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6652024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6662024-11-22T05:50:32.212ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6672024-11-22T05:50:32.212ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:852 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6682024-11-22T05:50:32.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6595814 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61075 req_id = c8b80885-fe22-4b5c-bb0b-262b8b69ba8d response_code = 200 uri = /datasets
6692024-11-22T05:50:32.244ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7fc67bd8-3bce-4136-97e2-a241117205c5 (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 336dbcec-2e95-4fc0-995c-7b91a9a7306b (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e99ff863-9db0-4841-b5df-4a4467bf0756 (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
6702024-11-22T05:50:32.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58145
6712024-11-22T05:50:32.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6722024-11-22T05:50:32.245ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:189
6732024-11-22T05:50:32.245ZINFOSledAgent (ServiceManager): No ledger in /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:189
6742024-11-22T05:50:32.245ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
6752024-11-22T05:50:32.245ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6762024-11-22T05:50:32.245ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
6772024-11-22T05:50:32.245ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
6782024-11-22T05:50:32.245ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6792024-11-22T05:50:32.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6802024-11-22T05:50:32.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6812024-11-22T05:50:32.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6822024-11-22T05:50:32.350ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756 file = illumos-utils/src/zone.rs:325
6832024-11-22T05:50:32.355ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5 file = illumos-utils/src/zone.rs:325
6842024-11-22T05:50:32.358ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b file = illumos-utils/src/zone.rs:325
6852024-11-22T05:50:32.370ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756 file = illumos-utils/src/zone.rs:363
6862024-11-22T05:50:32.375ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5 file = illumos-utils/src/zone.rs:363
6872024-11-22T05:50:32.379ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b file = illumos-utils/src/zone.rs:363
6882024-11-22T05:50:32.383ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6892024-11-22T05:50:32.578ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6902024-11-22T05:50:32.578ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6912024-11-22T05:50:33.385ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9) file = sled-agent/src/probe_manager.rs:231 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
6922024-11-22T05:50:34.048ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6932024-11-22T05:50:34.049ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6942024-11-22T05:50:34.528ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952024-11-22T05:50:34.528ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
6962024-11-22T05:50:34.531ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6972024-11-22T05:50:35.015ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6982024-11-22T05:50:35.015ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
6992024-11-22T05:50:35.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 30.272716ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7002024-11-22T05:50:35.032ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7012024-11-22T05:50:35.032ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7022024-11-22T05:50:35.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 134.820088ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7032024-11-22T05:50:35.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 34.804931ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7042024-11-22T05:50:35.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 27.13988ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7052024-11-22T05:50:35.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 100.532075ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7062024-11-22T05:50:35.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 68.118043ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7072024-11-22T05:50:35.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 181.168064ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7082024-11-22T05:50:35.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 249.086993ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7092024-11-22T05:50:35.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 222.882395ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7102024-11-22T05:50:35.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 228.574314ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7112024-11-22T05:50:35.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 596.797586ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7122024-11-22T05:50:35.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 215.334893ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7132024-11-22T05:50:35.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 637.704883ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7142024-11-22T05:50:35.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 1.177834956s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7152024-11-22T05:50:36.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 958.262908ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7162024-11-22T05:50:36.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 509.090212ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7172024-11-22T05:50:36.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 1.244673262s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7182024-11-22T05:50:37.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 1.438486214s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7192024-11-22T05:50:37.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 688.772719ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7202024-11-22T05:50:37.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 1.255953782s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7212024-11-22T05:50:38.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 1.145869372s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7222024-11-22T05:50:38.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 1.295235744s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7232024-11-22T05:50:39.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 700.603618ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7242024-11-22T05:50:39.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 1.239126137s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7252024-11-22T05:50:39.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5") failed: Property not found. retry in 1.432654779s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7262024-11-22T05:50:39.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756") failed: Property not found. retry in 1.258216808s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7272024-11-22T05:50:40.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b") failed: Property not found. retry in 831.199178ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7282024-11-22T05:50:41.167ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
7292024-11-22T05:50:41.167ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
7302024-11-22T05:50:41.365ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_e99ff863-9db0-4841-b5df-4a4467bf0756
7312024-11-22T05:50:41.365ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_7fc67bd8-3bce-4136-97e2-a241117205c5
7322024-11-22T05:50:41.365ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_internal_dns_336dbcec-2e95-4fc0-995c-7b91a9a7306b
7332024-11-22T05:50:41.365ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7342024-11-22T05:50:41.365ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json"
7352024-11-22T05:50:41.365ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7362024-11-22T05:50:41.366ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json"
7372024-11-22T05:50:41.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9121250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58145 req_id = ebe7de3e-9cde-47b5-afc6-843a20e159ca response_code = 204 uri = /omicron-zones
7382024-11-22T05:50:41.368ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7392024-11-22T05:50:42.573ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 102.801916ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7402024-11-22T05:50:42.580ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
7412024-11-22T05:50:42.580ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
7422024-11-22T05:50:42.711ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7432024-11-22T05:50:42.741ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 107.942711ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:675
7442024-11-22T05:50:42.895ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:655
7452024-11-22T05:50:42.987ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:691
7462024-11-22T05:50:42.987ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7472024-11-22T05:50:43.018ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7482024-11-22T05:50:43.019ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7492024-11-22T05:50:43.019ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7502024-11-22T05:50:43.049ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7fc67bd8-3bce-4136-97e2-a241117205c5 (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 336dbcec-2e95-4fc0-995c-7b91a9a7306b (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e99ff863-9db0-4841-b5df-4a4467bf0756 (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ea5cfd3d-bbee-46fc-a024-09faa54a9d85 (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0e1559af-66d9-4fac-bbf5-0cbac58ccf44, kind: Service { id: ea5cfd3d-bbee-46fc-a024-09faa54a9d85 }, name: Name("ntp-ea5cfd3d-bbee-46fc-a024-09faa54a9d85"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 19])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
7512024-11-22T05:50:43.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61205
7522024-11-22T05:50:43.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7532024-11-22T05:50:43.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
7542024-11-22T05:50:43.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
7552024-11-22T05:50:43.049ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
7562024-11-22T05:50:43.049ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7572024-11-22T05:50:43.050ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
7582024-11-22T05:50:43.050ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
7592024-11-22T05:50:43.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7602024-11-22T05:50:43.063ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7612024-11-22T05:50:43.095ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7622024-11-22T05:50:43.095ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7632024-11-22T05:50:43.095ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7642024-11-22T05:50:43.125ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 177, 19]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7652024-11-22T05:50:43.125ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = boundary_ntp
7662024-11-22T05:50:43.125ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7672024-11-22T05:50:43.125ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7682024-11-22T05:50:43.126ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7692024-11-22T05:50:43.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7702024-11-22T05:50:43.152ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85 file = illumos-utils/src/zone.rs:325
7712024-11-22T05:50:43.171ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85 file = illumos-utils/src/zone.rs:363
7722024-11-22T05:50:43.778ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7732024-11-22T05:50:43.778ZINFOSledAgent (ServiceManager): Booting oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7742024-11-22T05:50:43.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 62.34557ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7752024-11-22T05:50:43.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 76.686369ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7762024-11-22T05:50:44.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 280.292579ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7772024-11-22T05:50:44.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 441.659379ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7782024-11-22T05:50:44.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 603.636213ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7792024-11-22T05:50:45.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 561.037664ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7802024-11-22T05:50:46.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 719.069645ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7812024-11-22T05:50:46.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 790.51568ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7822024-11-22T05:50:47.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 1.384998573s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7832024-11-22T05:50:48.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 653.69125ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7842024-11-22T05:50:49.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85") failed: Property not found. retry in 1.42085272s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7852024-11-22T05:50:51.035ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85
7862024-11-22T05:50:51.035ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7872024-11-22T05:50:51.035ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json"
7882024-11-22T05:50:51.035ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
7892024-11-22T05:50:51.036ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json"
7902024-11-22T05:50:51.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7986967 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61205 req_id = 6db59007-5c6d-415a-8afd-d19e6d3c96d1 response_code = 204 uri = /omicron-zones
7912024-11-22T05:50:51.038ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:732
7922024-11-22T05:50:51.068ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7932024-11-22T05:50:51.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49447
7942024-11-22T05:50:51.077ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
7952024-11-22T05:50:51.077ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49447 req_id = 01af6d5e-12a5-4db6-bd5c-8520433248c9 response_code = 500 uri = /timesync
7962024-11-22T05:50:51.079ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
7972024-11-22T05:50:51.135ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
7982024-11-22T05:50:51.168ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
7992024-11-22T05:50:51.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47464
8002024-11-22T05:50:51.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8012024-11-22T05:50:51.169ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8022024-11-22T05:50:51.260ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8032024-11-22T05:50:51.367ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8042024-11-22T05:50:52.582ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8052024-11-22T05:50:52.582ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8062024-11-22T05:50:55.177ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8072024-11-22T05:50:55.177ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47464 req_id = 4151b6f5-a802-44ff-9a30-32093760ff4d response_code = 500 uri = /timesync
8082024-11-22T05:50:55.179ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8092024-11-22T05:50:55.375ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8102024-11-22T05:50:55.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61643
8112024-11-22T05:50:55.384ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8122024-11-22T05:50:55.384ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8881 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61643 req_id = 1afbfd81-7364-406d-b1d2-04d76a9df149 response_code = 500 uri = /timesync
8132024-11-22T05:50:55.387ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8142024-11-22T05:50:55.511ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8152024-11-22T05:50:55.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36322
8162024-11-22T05:50:59.531ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ea5cfd3d-bbee-46fc-a024-09faa54a9d85': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3958
8172024-11-22T05:50:59.531ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009039 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36322 req_id = e6e8d5e9-20dd-41cb-a6d3-75868bda2014 response_code = 500 uri = /timesync
8182024-11-22T05:50:59.535ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8192024-11-22T05:50:59.536ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 254.974501ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8202024-11-22T05:50:59.660ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8212024-11-22T05:50:59.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44695
8222024-11-22T05:50:59.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44695 req_id = a9d7a86c-1f87-45ac-a808-afd7132b1e4c response_code = 200 uri = /timesync
8232024-11-22T05:50:59.672ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.259162843 } file = sled-agent/src/rack_setup/service.rs:740
8242024-11-22T05:50:59.672ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8252024-11-22T05:50:59.852ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8262024-11-22T05:50:59.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40552
8272024-11-22T05:50:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9096 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40552 req_id = 67e62b9f-02d3-4912-90d9-97b0d635e5f0 response_code = 200 uri = /timesync
8282024-11-22T05:50:59.864ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.258640677 } file = sled-agent/src/rack_setup/service.rs:740
8292024-11-22T05:50:59.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8302024-11-22T05:51:00.064ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8312024-11-22T05:51:00.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48182
8322024-11-22T05:51:00.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48182 req_id = 525c045b-f81f-4c26-9262-4284b77acbba response_code = 200 uri = /timesync
8332024-11-22T05:51:00.076ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.258064508 } file = sled-agent/src/rack_setup/service.rs:740
8342024-11-22T05:51:00.076ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8352024-11-22T05:51:00.523ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8362024-11-22T05:51:00.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45660
8372024-11-22T05:51:00.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45660 req_id = 40b2b586-4f07-47ce-bf97-55dfbdcc68af response_code = 200 uri = /timesync
8382024-11-22T05:51:00.533ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.258144945 } file = sled-agent/src/rack_setup/service.rs:740
8392024-11-22T05:51:00.533ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8402024-11-22T05:51:01.053ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8412024-11-22T05:51:01.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36654
8422024-11-22T05:51:01.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8432024-11-22T05:51:01.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8442024-11-22T05:51:01.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8456 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 657d0268-4137-4c32-9a8c-f3ac4358b4ac response_code = 200 uri = /timesync
8452024-11-22T05:51:01.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.256696582 } file = sled-agent/src/rack_setup/service.rs:740
8462024-11-22T05:51:01.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8472024-11-22T05:51:01.144ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8482024-11-22T05:51:01.177ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8492024-11-22T05:51:01.177ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8502024-11-22T05:51:01.267ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8512024-11-22T05:51:01.374ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8522024-11-22T05:51:01.620ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8532024-11-22T05:51:01.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42081
8542024-11-22T05:51:01.626ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41850
8552024-11-22T05:51:01.626ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41850 req_id = 51fc9d68-45fd-47f2-bed3-0d243c11ca55 response_code = 200 uri = /baseboard
8562024-11-22T05:51:01.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8327 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42081 req_id = a6d3aa79-69c7-4202-a02f-9aaa91250ec2 response_code = 200 uri = /timesync
8572024-11-22T05:51:01.630ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.255158514 } file = sled-agent/src/rack_setup/service.rs:740
8582024-11-22T05:51:01.630ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8592024-11-22T05:51:01.944ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8602024-11-22T05:51:01.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46024
8612024-11-22T05:51:01.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8917 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46024 req_id = dad6feb0-e80e-4646-b937-a2f6210c6517 response_code = 200 uri = /timesync
8622024-11-22T05:51:01.955ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.254311651 } file = sled-agent/src/rack_setup/service.rs:740
8632024-11-22T05:51:01.955ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8642024-11-22T05:51:02.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8652024-11-22T05:51:02.586ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
8662024-11-22T05:51:02.681ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8672024-11-22T05:51:02.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45962
8682024-11-22T05:51:02.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45962 req_id = a3da71f8-58db-4487-beab-2c68cc642b2b response_code = 200 uri = /timesync
8692024-11-22T05:51:02.693ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.252313167 } file = sled-agent/src/rack_setup/service.rs:740
8702024-11-22T05:51:02.693ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8712024-11-22T05:51:03.706ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8722024-11-22T05:51:03.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54430
8732024-11-22T05:51:03.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54430 req_id = 7db57662-870d-44f8-a95c-279818ee1101 response_code = 200 uri = /timesync
8742024-11-22T05:51:03.719ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1732254658.2352524, correction: -0.24959816 } file = sled-agent/src/rack_setup/service.rs:740
8752024-11-22T05:51:03.719ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8762024-11-22T05:51:04.807ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8772024-11-22T05:51:04.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56459
8782024-11-22T05:51:04.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8435 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56459 req_id = ec53facc-297d-4109-82f4-062f576b240c response_code = 200 uri = /timesync
8792024-11-22T05:51:04.818ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254663.580545, correction: -0.246211588 } file = sled-agent/src/rack_setup/service.rs:740
8802024-11-22T05:51:04.818ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8812024-11-22T05:51:05.667ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8822024-11-22T05:51:05.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34292
8832024-11-22T05:51:05.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34292 req_id = 53414e99-f09a-461a-b311-7186af0edbeb response_code = 200 uri = /timesync
8842024-11-22T05:51:05.678ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254663.580545, correction: -0.243874863 } file = sled-agent/src/rack_setup/service.rs:740
8852024-11-22T05:51:05.678ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8862024-11-22T05:51:07.200ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8872024-11-22T05:51:07.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37149
8882024-11-22T05:51:07.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9021 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37149 req_id = ea0f109f-323b-4bd8-9ab5-6e6f37c31843 response_code = 200 uri = /timesync
8892024-11-22T05:51:07.211ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254666.1147945, correction: -0.239707515 } file = sled-agent/src/rack_setup/service.rs:740
8902024-11-22T05:51:07.211ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8912024-11-22T05:51:08.538ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8922024-11-22T05:51:08.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53926
8932024-11-22T05:51:08.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53926 req_id = bc89d55a-1548-41e5-bc9c-9e59d767422c response_code = 200 uri = /timesync
8942024-11-22T05:51:08.550ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254667.3698697, correction: -0.236044377 } file = sled-agent/src/rack_setup/service.rs:740
8952024-11-22T05:51:08.550ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
8962024-11-22T05:51:10.429ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
8972024-11-22T05:51:10.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36270
8982024-11-22T05:51:10.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8740 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36270 req_id = bc1f56af-103c-4376-a2f7-19dbb91816fc response_code = 200 uri = /timesync
8992024-11-22T05:51:10.440ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254669.1299138, correction: -0.230932564 } file = sled-agent/src/rack_setup/service.rs:740
9002024-11-22T05:51:10.440ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9012024-11-22T05:51:11.032ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9022024-11-22T05:51:11.032ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9032024-11-22T05:51:11.117ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9042024-11-22T05:51:11.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9052024-11-22T05:51:11.152ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9062024-11-22T05:51:11.241ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9072024-11-22T05:51:11.348ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9082024-11-22T05:51:12.561ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9092024-11-22T05:51:12.561ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9102024-11-22T05:51:13.742ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9112024-11-22T05:51:13.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36906
9122024-11-22T05:51:13.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36906 req_id = 38a3cc6c-cbc0-4cc8-8b88-d6f7febe8d6b response_code = 200 uri = /timesync
9132024-11-22T05:51:13.752ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254671.6925583, correction: -0.221946537 } file = sled-agent/src/rack_setup/service.rs:740
9142024-11-22T05:51:13.752ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9152024-11-22T05:51:14.784ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 595.798687ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9162024-11-22T05:51:15.132ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9172024-11-22T05:51:15.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39748
9182024-11-22T05:51:15.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9002 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39748 req_id = a0d09d98-e0f8-4027-9cd1-13955ce43b6d response_code = 200 uri = /timesync
9192024-11-22T05:51:15.143ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254674.4880176, correction: -0.218196318 } file = sled-agent/src/rack_setup/service.rs:740
9202024-11-22T05:51:15.143ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9212024-11-22T05:51:18.232ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9222024-11-22T05:51:18.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54703
9232024-11-22T05:51:18.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54703 req_id = aff1aae2-73db-4022-9b53-80cd42161966 response_code = 200 uri = /timesync
9242024-11-22T05:51:18.244ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254677.2119513, correction: -0.209815487 } file = sled-agent/src/rack_setup/service.rs:740
9252024-11-22T05:51:18.244ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9262024-11-22T05:51:21.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9272024-11-22T05:51:21.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9282024-11-22T05:51:21.092ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9292024-11-22T05:51:21.126ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9302024-11-22T05:51:21.126ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9312024-11-22T05:51:21.215ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9322024-11-22T05:51:21.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9332024-11-22T05:51:22.112ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9342024-11-22T05:51:22.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51328
9352024-11-22T05:51:22.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8963 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51328 req_id = f0d47f0f-5eac-43c8-9fa6-0dbad3f5a804 response_code = 200 uri = /timesync
9362024-11-22T05:51:22.123ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254681.583584, correction: -0.199330807 } file = sled-agent/src/rack_setup/service.rs:740
9372024-11-22T05:51:22.123ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9382024-11-22T05:51:22.537ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9392024-11-22T05:51:22.537ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9402024-11-22T05:51:25.622ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9412024-11-22T05:51:25.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65326
9422024-11-22T05:51:25.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8720 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65326 req_id = 4a8f1eb9-0e0b-4e33-934e-95e0158586f0 response_code = 200 uri = /timesync
9432024-11-22T05:51:25.634ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254682.7798157, correction: -0.189791232 } file = sled-agent/src/rack_setup/service.rs:740
9442024-11-22T05:51:25.634ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9452024-11-22T05:51:30.373ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.055216989s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9462024-11-22T05:51:30.982ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9472024-11-22T05:51:30.982ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9482024-11-22T05:51:31.066ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9492024-11-22T05:51:31.100ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 7103930914284151781 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9502024-11-22T05:51:31.101ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 649815541436059987 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9512024-11-22T05:51:31.189ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9522024-11-22T05:51:31.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9532024-11-22T05:51:31.410ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9542024-11-22T05:51:31.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55282
9552024-11-22T05:51:31.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9674 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55282 req_id = e7860417-e911-43b4-b6d3-b49be4b17729 response_code = 200 uri = /timesync
9562024-11-22T05:51:31.423ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254689.5706573, correction: -0.174092934 } file = sled-agent/src/rack_setup/service.rs:740
9572024-11-22T05:51:31.423ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9582024-11-22T05:51:31.578ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41716
9592024-11-22T05:51:31.578ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41716 req_id = d17b8d29-ae56-4475-9025-f24a11a307ee response_code = 200 uri = /baseboard
9602024-11-22T05:51:32.513ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9612024-11-22T05:51:32.513ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9622024-11-22T05:51:38.115ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9632024-11-22T05:51:38.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54840
9642024-11-22T05:51:38.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54840 req_id = 5b128536-bd07-4b48-ab99-2d01554ed25e response_code = 200 uri = /timesync
9652024-11-22T05:51:38.127ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254697.8090348, correction: -0.155904219 } file = sled-agent/src/rack_setup/service.rs:740
9662024-11-22T05:51:38.127ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9672024-11-22T05:51:40.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9682024-11-22T05:51:40.957ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9692024-11-22T05:51:41.040ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9702024-11-22T05:51:41.162ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9712024-11-22T05:51:41.271ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9722024-11-22T05:51:42.488ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9732024-11-22T05:51:42.488ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9742024-11-22T05:51:46.420ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.474554121s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9752024-11-22T05:51:47.172ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9762024-11-22T05:51:47.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37238
9772024-11-22T05:51:47.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9067 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37238 req_id = fc5880ce-7d98-4bec-89ed-2ea50e0b5261 response_code = 200 uri = /timesync
9782024-11-22T05:51:47.184ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254705.0823746, correction: -0.131292984 } file = sled-agent/src/rack_setup/service.rs:740
9792024-11-22T05:51:47.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9802024-11-22T05:51:50.932ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9812024-11-22T05:51:50.932ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9822024-11-22T05:51:51.015ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1153397789515856586 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9832024-11-22T05:51:51.137ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13413178857342567069 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9842024-11-22T05:51:51.245ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5911241559332578840 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9852024-11-22T05:51:52.462ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9862024-11-22T05:51:52.463ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9872024-11-22T05:51:55.304ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
9882024-11-22T05:51:55.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44329
9892024-11-22T05:51:55.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44329 req_id = 0c9d3671-98cf-4f77-a34c-98722a2fed5d response_code = 200 uri = /timesync
9902024-11-22T05:51:55.316ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254713.7147057, correction: -0.109224096 } file = sled-agent/src/rack_setup/service.rs:740
9912024-11-22T05:51:55.316ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
9922024-11-22T05:52:00.907ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12410215498329845647 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9932024-11-22T05:52:00.907ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6328834226645073307 reason = Duration(60s) sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9942024-11-22T05:52:01.530ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38591
9952024-11-22T05:52:01.530ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38591 req_id = 6f5f1407-f345-4707-a771-ed3a457437b5 response_code = 200 uri = /baseboard
9962024-11-22T05:52:02.438ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9972024-11-22T05:52:02.438ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9982024-11-22T05:52:03.884ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.91786038s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
9992024-11-22T05:52:07.533ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10002024-11-22T05:52:07.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47936
10012024-11-22T05:52:07.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47936 req_id = e5765fd8-2bc7-4cc1-833c-190dde885883 response_code = 200 uri = /timesync
10022024-11-22T05:52:07.545ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254722.1128469, correction: -0.076010317 } file = sled-agent/src/rack_setup/service.rs:740
10032024-11-22T05:52:07.545ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:762
10042024-11-22T05:52:12.413ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10052024-11-22T05:52:12.413ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10062024-11-22T05:52:22.387ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2590224426435166261 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10072024-11-22T05:52:22.388ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9626348519081004760 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10082024-11-22T05:52:22.785ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.054828755s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10092024-11-22T05:52:23.114ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:712
10102024-11-22T05:52:23.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36694
10112024-11-22T05:52:23.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21519 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36694 req_id = 3d52b917-9b0f-4e28-bc84-551d98773b8b response_code = 200 uri = /timesync
10122024-11-22T05:52:23.137ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:51:51.015354338Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1153397789515856586 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10132024-11-22T05:52:23.137ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:51:51.137578647Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13413178857342567069 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10142024-11-22T05:52:23.138ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:52:00.907367885Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6328834226645073307 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10152024-11-22T05:52:23.138ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:51:31.101109338Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 649815541436059987 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10162024-11-22T05:52:23.138ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:51:51.245722843Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5911241559332578840 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10172024-11-22T05:52:23.138ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:51:31.100508302Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 7103930914284151781 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10182024-11-22T05:52:23.139ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-11-22T05:52:00.907025946Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12410215498329845647 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
10192024-11-22T05:52:23.141ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3330918944, ip_addr: 198.137.202.32, stratum: 3, ref_time: 1732254737.764494, correction: -0.033694956 } file = sled-agent/src/rack_setup/service.rs:740
10202024-11-22T05:52:23.141ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1425
10212024-11-22T05:52:23.172ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7fc67bd8-3bce-4136-97e2-a241117205c5 (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 336dbcec-2e95-4fc0-995c-7b91a9a7306b (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e99ff863-9db0-4841-b5df-4a4467bf0756 (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ea5cfd3d-bbee-46fc-a024-09faa54a9d85 (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0e1559af-66d9-4fac-bbf5-0cbac58ccf44, kind: Service { id: ea5cfd3d-bbee-46fc-a024-09faa54a9d85 }, name: Name("ntp-ea5cfd3d-bbee-46fc-a024-09faa54a9d85"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 19])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bf63067f-b97c-4f5e-884c-05d081af7b8d (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9aa7cdd9-01ea-4fb3-aa94-93b9475e9527 (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3eac57e6-424f-4037-96ed-ac1be9a36a5a (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } } } }, OmicronZoneConfig { id: 068c97f9-2364-48f0-9e79-9702240d3838 (service), filesystem_pool: Some(ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External } } } }, OmicronZoneConfig { id: f9e57c73-6d62-42a9-964e-d797f65c4938 (service), filesystem_pool: Some(ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
10222024-11-22T05:52:23.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64463
10232024-11-22T05:52:23.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10242024-11-22T05:52:23.173ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
10252024-11-22T05:52:23.173ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
10262024-11-22T05:52:23.173ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
10272024-11-22T05:52:23.173ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10282024-11-22T05:52:23.173ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
10292024-11-22T05:52:23.173ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
10302024-11-22T05:52:23.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10312024-11-22T05:52:23.259ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10322024-11-22T05:52:23.260ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10332024-11-22T05:52:23.260ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10342024-11-22T05:52:23.260ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10352024-11-22T05:52:23.260ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10362024-11-22T05:52:23.354ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 file = illumos-utils/src/zone.rs:325
10372024-11-22T05:52:23.358ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d file = illumos-utils/src/zone.rs:325
10382024-11-22T05:52:23.363ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938 file = illumos-utils/src/zone.rs:325
10392024-11-22T05:52:23.367ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527 file = illumos-utils/src/zone.rs:325
10402024-11-22T05:52:23.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a file = illumos-utils/src/zone.rs:325
10412024-11-22T05:52:23.376ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 file = illumos-utils/src/zone.rs:363
10422024-11-22T05:52:23.381ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d file = illumos-utils/src/zone.rs:363
10432024-11-22T05:52:23.385ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938 file = illumos-utils/src/zone.rs:363
10442024-11-22T05:52:23.389ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527 file = illumos-utils/src/zone.rs:363
10452024-11-22T05:52:23.394ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a file = illumos-utils/src/zone.rs:363
10462024-11-22T05:52:26.277ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='068c97f9-2364-48f0-9e79-9702240d3838'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10472024-11-22T05:52:26.277ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10482024-11-22T05:52:26.370ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f9e57c73-6d62-42a9-964e-d797f65c4938'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10492024-11-22T05:52:26.370ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3eac57e6-424f-4037-96ed-ac1be9a36a5a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10502024-11-22T05:52:26.370ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10512024-11-22T05:52:26.375ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10522024-11-22T05:52:26.404ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9aa7cdd9-01ea-4fb3-aa94-93b9475e9527'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10532024-11-22T05:52:26.405ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10542024-11-22T05:52:26.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 63.559105ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10552024-11-22T05:52:26.446ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='bf63067f-b97c-4f5e-884c-05d081af7b8d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562024-11-22T05:52:26.446ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10572024-11-22T05:52:26.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 125.849691ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10582024-11-22T05:52:26.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 28.90759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10592024-11-22T05:52:26.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 49.174585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10602024-11-22T05:52:26.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 80.021704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10612024-11-22T05:52:26.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 34.464625ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10622024-11-22T05:52:26.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 233.753488ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10632024-11-22T05:52:27.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 32.303151ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10642024-11-22T05:52:27.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 284.627855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10652024-11-22T05:52:27.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 147.114032ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10662024-11-22T05:52:27.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 140.749485ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10672024-11-22T05:52:27.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 230.444361ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10682024-11-22T05:52:27.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 65.429715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10692024-11-22T05:52:27.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 248.424152ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10702024-11-22T05:52:27.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 567.621413ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10712024-11-22T05:52:27.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 248.378413ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10722024-11-22T05:52:27.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 147.646202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10732024-11-22T05:52:27.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 791.17815ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10742024-11-22T05:52:27.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 472.325972ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10752024-11-22T05:52:27.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 472.262159ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10762024-11-22T05:52:28.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 508.849862ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10772024-11-22T05:52:28.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 914.742543ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10782024-11-22T05:52:28.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 461.132056ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10792024-11-22T05:52:28.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 882.264907ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10802024-11-22T05:52:28.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 996.898968ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10812024-11-22T05:52:28.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.330581243s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10822024-11-22T05:52:28.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 744.046531ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10832024-11-22T05:52:29.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.128804302s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10842024-11-22T05:52:29.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 1.153288181s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10852024-11-22T05:52:29.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 1.142100173s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10862024-11-22T05:52:29.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 891.526374ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10872024-11-22T05:52:29.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 551.897222ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10882024-11-22T05:52:30.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.018522698s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10892024-11-22T05:52:30.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 759.99077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10902024-11-22T05:52:30.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 846.539332ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10912024-11-22T05:52:30.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 1.327479923s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10922024-11-22T05:52:30.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 1.420481054s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
10932024-11-22T05:52:31.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.373606261s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
10942024-11-22T05:52:31.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.292677166s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
10952024-11-22T05:52:31.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 1.415762403s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
10962024-11-22T05:52:31.487ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32768
10972024-11-22T05:52:31.487ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32768 req_id = 18c9a055-1eaf-4d68-8132-79d50d52ce6d response_code = 200 uri = /baseboard
10982024-11-22T05:52:31.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 845.760173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
10992024-11-22T05:52:32.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 867.18832ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
11002024-11-22T05:52:32.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.227691819s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11012024-11-22T05:52:32.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.159244035s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11022024-11-22T05:52:32.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 1.306440341s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
11032024-11-22T05:52:32.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 938.261138ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
11042024-11-22T05:52:32.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 827.942986ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
11052024-11-22T05:52:33.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 866.655536ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
11062024-11-22T05:52:33.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.025226225s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11072024-11-22T05:52:33.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.144875506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11082024-11-22T05:52:33.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 623.815845ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
11092024-11-22T05:52:34.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 886.816344ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
11102024-11-22T05:52:34.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527") failed: Property not found. retry in 747.401053ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
11112024-11-22T05:52:34.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d") failed: Property not found. retry in 1.158788293s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
11122024-11-22T05:52:34.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 709.907067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11132024-11-22T05:52:34.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a") failed: Property not found. retry in 1.103657429s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
11142024-11-22T05:52:35.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 803.441145ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11152024-11-22T05:52:35.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 818.483956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11162024-11-22T05:52:35.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 911.603556ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11172024-11-22T05:52:36.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 670.363138ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11182024-11-22T05:52:36.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 736.696191ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11192024-11-22T05:52:37.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.425553651s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11202024-11-22T05:52:37.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 988.191125ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11212024-11-22T05:52:38.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.093661653s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11222024-11-22T05:52:39.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 828.279724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11232024-11-22T05:52:39.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.176531924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11242024-11-22T05:52:40.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 771.664929ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11252024-11-22T05:52:40.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 821.459785ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11262024-11-22T05:52:41.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.234329302s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11272024-11-22T05:52:41.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.136509978s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11282024-11-22T05:52:42.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.247794662s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11292024-11-22T05:52:42.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.134452498s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11302024-11-22T05:52:43.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 1.301222829s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11312024-11-22T05:52:44.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838") failed: Property not found. retry in 1.477644296s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11322024-11-22T05:52:44.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938") failed: Property not found. retry in 869.466848ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11332024-11-22T05:52:45.737ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838
11342024-11-22T05:52:45.737ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_bf63067f-b97c-4f5e-884c-05d081af7b8d
11352024-11-22T05:52:45.737ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_f9e57c73-6d62-42a9-964e-d797f65c4938
11362024-11-22T05:52:45.737ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_9aa7cdd9-01ea-4fb3-aa94-93b9475e9527
11372024-11-22T05:52:45.737ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_cockroachdb_3eac57e6-424f-4037-96ed-ac1be9a36a5a
11382024-11-22T05:52:45.737ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11392024-11-22T05:52:45.738ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json"
11402024-11-22T05:52:45.738ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
11412024-11-22T05:52:45.738ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json"
11422024-11-22T05:52:45.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22599761 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64463 req_id = 2a59c7a3-45a7-4d60-b392-8734bb1c9437 response_code = 204 uri = /omicron-zones
11432024-11-22T05:52:45.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47483
11442024-11-22T05:52:45.801ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28814 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 6e7b9b6f-3127-461a-a7e3-3db35f7298af response_code = 500 uri = /cockroachdb
11452024-11-22T05:52:45.802ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e7b9b6f-3127-461a-a7e3-3db35f7298af", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e7b9b6f-3127-461a-a7e3-3db35f7298af" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 65.484393ms
11462024-11-22T05:52:45.895ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26310 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 29038c67-8d03-43b5-8345-583ee2392890 response_code = 500 uri = /cockroachdb
11472024-11-22T05:52:45.895ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "29038c67-8d03-43b5-8345-583ee2392890", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "29038c67-8d03-43b5-8345-583ee2392890" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 105.043949ms
11482024-11-22T05:52:46.028ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 1b5a86d1-74d2-4c7a-b42a-224f37546ce3 response_code = 500 uri = /cockroachdb
11492024-11-22T05:52:46.029ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1b5a86d1-74d2-4c7a-b42a-224f37546ce3", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1b5a86d1-74d2-4c7a-b42a-224f37546ce3" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 76.990393ms
11502024-11-22T05:52:46.133ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = b73fd720-b654-47e9-b861-7ef849ea29cc response_code = 500 uri = /cockroachdb
11512024-11-22T05:52:46.133ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b73fd720-b654-47e9-b861-7ef849ea29cc", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b73fd720-b654-47e9-b861-7ef849ea29cc" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 208.990156ms
11522024-11-22T05:52:46.368ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25179 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = aede7a52-82ea-44a5-b91d-a545e9065505 response_code = 500 uri = /cockroachdb
11532024-11-22T05:52:46.368ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aede7a52-82ea-44a5-b91d-a545e9065505", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aede7a52-82ea-44a5-b91d-a545e9065505" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 171.117161ms
11542024-11-22T05:52:46.566ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 9930b473-5421-40ef-a722-c29730c5d592 response_code = 500 uri = /cockroachdb
11552024-11-22T05:52:46.566ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9930b473-5421-40ef-a722-c29730c5d592", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9930b473-5421-40ef-a722-c29730c5d592" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 363.321701ms
11562024-11-22T05:52:46.956ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 7c22328f-7126-4d0a-a874-90bf4aac0c75 response_code = 500 uri = /cockroachdb
11572024-11-22T05:52:46.956ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7c22328f-7126-4d0a-a874-90bf4aac0c75", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7c22328f-7126-4d0a-a874-90bf4aac0c75" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 400.126156ms
11582024-11-22T05:52:47.384ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_068c97f9-2364-48f0-9e79-9702240d3838 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 88349c59-bcd6-4c8b-bfd6-3d19bc1133aa response_code = 500 uri = /cockroachdb
11592024-11-22T05:52:47.384ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88349c59-bcd6-4c8b-bfd6-3d19bc1133aa", "content-length": "124", "date": "Fri, 22 Nov 2024 05:52:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88349c59-bcd6-4c8b-bfd6-3d19bc1133aa" } file = sled-agent/src/rack_setup/service.rs:1154 retry_after = 406.039283ms
11602024-11-22T05:52:47.821ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3801
11612024-11-22T05:52:53.456ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3819
11622024-11-22T05:52:58.669ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3842
11632024-11-22T05:52:58.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10877486 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47483 req_id = 9a1ef1bc-5dda-4c42-ac03-c8dbce3ce399 response_code = 204 uri = /cockroachdb
11642024-11-22T05:52:58.676ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.932515524s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
11652024-11-22T05:52:58.706ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7fc67bd8-3bce-4136-97e2-a241117205c5 (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 336dbcec-2e95-4fc0-995c-7b91a9a7306b (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e99ff863-9db0-4841-b5df-4a4467bf0756 (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ea5cfd3d-bbee-46fc-a024-09faa54a9d85 (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 0e1559af-66d9-4fac-bbf5-0cbac58ccf44, kind: Service { id: ea5cfd3d-bbee-46fc-a024-09faa54a9d85 }, name: Name("ntp-ea5cfd3d-bbee-46fc-a024-09faa54a9d85"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 19])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bf63067f-b97c-4f5e-884c-05d081af7b8d (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9aa7cdd9-01ea-4fb3-aa94-93b9475e9527 (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3eac57e6-424f-4037-96ed-ac1be9a36a5a (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } } } }, OmicronZoneConfig { id: 068c97f9-2364-48f0-9e79-9702240d3838 (service), filesystem_pool: Some(ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External } } } }, OmicronZoneConfig { id: f9e57c73-6d62-42a9-964e-d797f65c4938 (service), filesystem_pool: Some(ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External } } } }, OmicronZoneConfig { id: 6652103c-533e-477f-853d-d5a6ff146362 (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e40af71f-a5c0-473a-94dd-6fd1db818ede (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c (service), filesystem_pool: Some(ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 (service), filesystem_pool: Some(ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 944dfa82-0d31-483c-9606-a464ddba8f2e (service), filesystem_pool: Some(ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 263bd4c5-59af-44f0-9ab7-249049492f75 (service), filesystem_pool: Some(ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 5eb957e5-fc6c-4d3e-abdb-1ff615308d09 (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 04ec7037-23ad-463c-89a4-3c11e29fdc19 (service), filesystem_pool: Some(ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: db656b86-f032-4326-8a6e-14de8692fccf (service), filesystem_pool: Some(ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5d531444-6ead-44c7-80f4-b62f0be40891 (service), filesystem_pool: Some(ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 7ac3407d-cb8c-4509-86e6-086558a7517d (service), filesystem_pool: Some(ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4f88574d-a32e-4791-b5ee-4e32fd4d5551 (service), filesystem_pool: Some(ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External } } } }, OmicronZoneConfig { id: 25fb7e03-cb6e-490e-94ae-52c4ba6cf802 (service), filesystem_pool: Some(ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External } } } }, OmicronZoneConfig { id: 7290d2a3-c0f3-43f5-af40-c91be1504bea (service), filesystem_pool: Some(ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0a3ea476-f35b-40d9-868b-7b4f4c438bf7 (service), filesystem_pool: Some(ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External } } } }, OmicronZoneConfig { id: c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6 (service), filesystem_pool: Some(ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85574770-42a5-4426-840d-937ee2fe59ab (service), filesystem_pool: Some(ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3e41278f-c6d6-455d-9155-b44af9aafa63 (service), filesystem_pool: Some(ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External } } } }, OmicronZoneConfig { id: 26ea84d1-4927-431e-a6b1-ff34cee0e2ec (service), filesystem_pool: Some(ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:538 sled_address = [fd00:1122:3344:101::1]:12345
11662024-11-22T05:52:58.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41076
11672024-11-22T05:52:58.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11682024-11-22T05:52:58.707ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
11692024-11-22T05:52:58.707ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
11702024-11-22T05:52:58.707ZINFOSledAgent (StorageManager): Received DatasetsConfigList { tx: ... } file = sled-storage/src/manager.rs:603
11712024-11-22T05:52:58.707ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11722024-11-22T05:52:58.708ZINFOSledAgent (StorageManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-datasets.json file = common/src/ledger.rs:178 request = datasets_config_list
11732024-11-22T05:52:58.709ZINFOSledAgent (StorageManager): Found ledger on internal storage file = sled-storage/src/manager.rs:992 request = datasets_config_list
11742024-11-22T05:52:58.709ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11752024-11-22T05:52:58.862ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11762024-11-22T05:52:58.862ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11772024-11-22T05:52:58.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11782024-11-22T05:52:58.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11792024-11-22T05:52:58.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11802024-11-22T05:52:58.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11812024-11-22T05:52:58.890ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11822024-11-22T05:52:58.890ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11832024-11-22T05:52:58.891ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11842024-11-22T05:52:58.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11852024-11-22T05:52:59.068ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11862024-11-22T05:52:59.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11872024-11-22T05:52:59.085ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11882024-11-22T05:52:59.085ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11892024-11-22T05:52:59.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11902024-11-22T05:52:59.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11912024-11-22T05:52:59.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11922024-11-22T05:52:59.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11932024-11-22T05:52:59.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11942024-11-22T05:52:59.141ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75 file = illumos-utils/src/zone.rs:325
11952024-11-22T05:52:59.147ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec file = illumos-utils/src/zone.rs:325
11962024-11-22T05:52:59.153ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea file = illumos-utils/src/zone.rs:325
11972024-11-22T05:52:59.158ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7 file = illumos-utils/src/zone.rs:325
11982024-11-22T05:52:59.163ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf file = illumos-utils/src/zone.rs:325
11992024-11-22T05:52:59.169ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63 file = illumos-utils/src/zone.rs:325
12002024-11-22T05:52:59.174ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19 file = illumos-utils/src/zone.rs:325
12012024-11-22T05:52:59.326ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75 file = illumos-utils/src/zone.rs:363
12022024-11-22T05:52:59.330ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec file = illumos-utils/src/zone.rs:363
12032024-11-22T05:52:59.335ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea file = illumos-utils/src/zone.rs:363
12042024-11-22T05:52:59.339ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7 file = illumos-utils/src/zone.rs:363
12052024-11-22T05:52:59.344ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf file = illumos-utils/src/zone.rs:363
12062024-11-22T05:52:59.349ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63 file = illumos-utils/src/zone.rs:363
12072024-11-22T05:52:59.355ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19 file = illumos-utils/src/zone.rs:363
12082024-11-22T05:52:59.360ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802 file = illumos-utils/src/zone.rs:325
12092024-11-22T05:52:59.365ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d file = illumos-utils/src/zone.rs:325
12102024-11-22T05:52:59.371ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6 file = illumos-utils/src/zone.rs:325
12112024-11-22T05:52:59.377ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab file = illumos-utils/src/zone.rs:325
12122024-11-22T05:52:59.383ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891 file = illumos-utils/src/zone.rs:325
12132024-11-22T05:52:59.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09 file = illumos-utils/src/zone.rs:325
12142024-11-22T05:52:59.396ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551 file = illumos-utils/src/zone.rs:325
12152024-11-22T05:52:59.404ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802 file = illumos-utils/src/zone.rs:363
12162024-11-22T05:52:59.412ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d file = illumos-utils/src/zone.rs:363
12172024-11-22T05:52:59.421ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6 file = illumos-utils/src/zone.rs:363
12182024-11-22T05:52:59.429ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab file = illumos-utils/src/zone.rs:363
12192024-11-22T05:52:59.436ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891 file = illumos-utils/src/zone.rs:363
12202024-11-22T05:52:59.445ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09 file = illumos-utils/src/zone.rs:363
12212024-11-22T05:52:59.461ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551 file = illumos-utils/src/zone.rs:363
12222024-11-22T05:52:59.535ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12232024-11-22T05:52:59.589ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12242024-11-22T05:52:59.643ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12252024-11-22T05:52:59.698ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12262024-11-22T05:52:59.753ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12272024-11-22T05:52:59.755ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12282024-11-22T05:52:59.756ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12292024-11-22T05:52:59.808ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 227, 76]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12302024-11-22T05:52:59.808ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12312024-11-22T05:52:59.810ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12322024-11-22T05:52:59.810ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12332024-11-22T05:52:59.862ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 217, 237]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12342024-11-22T05:52:59.862ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12352024-11-22T05:52:59.864ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12362024-11-22T05:52:59.864ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12372024-11-22T05:52:59.917ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 225, 209]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12382024-11-22T05:52:59.917ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12392024-11-22T05:52:59.919ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12402024-11-22T05:52:59.919ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12412024-11-22T05:52:59.972ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 229, 171]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12422024-11-22T05:52:59.972ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = external_dns
12432024-11-22T05:52:59.974ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12442024-11-22T05:52:59.974ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12452024-11-22T05:53:00.028ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 163, 93]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12462024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1271 zone_type = nexus
12472024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12482024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12492024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12502024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12512024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12522024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12532024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12542024-11-22T05:53:00.028ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12552024-11-22T05:53:00.029ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12562024-11-22T05:53:00.032ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12572024-11-22T05:53:00.032ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12582024-11-22T05:53:00.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12592024-11-22T05:53:00.032ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12602024-11-22T05:53:00.034ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12612024-11-22T05:53:00.036ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12622024-11-22T05:53:00.037ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12632024-11-22T05:53:00.037ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12642024-11-22T05:53:00.096ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12652024-11-22T05:53:00.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12662024-11-22T05:53:00.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12672024-11-22T05:53:00.221ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede file = illumos-utils/src/zone.rs:325
12682024-11-22T05:53:00.260ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e file = illumos-utils/src/zone.rs:325
12692024-11-22T05:53:00.267ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362 file = illumos-utils/src/zone.rs:325
12702024-11-22T05:53:00.273ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36 file = illumos-utils/src/zone.rs:325
12712024-11-22T05:53:00.279ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede file = illumos-utils/src/zone.rs:363
12722024-11-22T05:53:00.286ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c file = illumos-utils/src/zone.rs:325
12732024-11-22T05:53:00.292ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e file = illumos-utils/src/zone.rs:363
12742024-11-22T05:53:00.299ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362 file = illumos-utils/src/zone.rs:363
12752024-11-22T05:53:00.306ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36 file = illumos-utils/src/zone.rs:363
12762024-11-22T05:53:00.314ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c file = illumos-utils/src/zone.rs:363
12772024-11-22T05:53:11.499ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782024-11-22T05:53:11.501ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
12792024-11-22T05:53:11.546ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802024-11-22T05:53:11.546ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
12812024-11-22T05:53:11.568ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='040e3f14-6f59-4a1c-8bcc-31e955f4079d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12822024-11-22T05:53:11.568ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b14685c9-627a-4771-88d8-2e711b8d9599'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-11-22T05:53:11.569ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4e22dedb-c75a-474b-99c5-71a921526312'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12842024-11-22T05:53:11.569ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_38f500bf-3a39-433c-8745-e20b3ab66215/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5ead1ebd-8a51-4f08-a5c8-94b42d3dda94'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852024-11-22T05:53:11.569ZINFOSledAgent (ServiceManager): Booting oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
12862024-11-22T05:53:11.578ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
12872024-11-22T05:53:11.586ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
12882024-11-22T05:53:11.704ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f4e28855-9173-4d42-9164-2e22168b6a5d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f0c484c9-bf00-4473-b207-efc39cc5c2d1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12892024-11-22T05:53:11.704ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
12902024-11-22T05:53:11.730ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_633ab940-354c-4903-be3d-50b19510ea4f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='67443ab1-dc2e-409d-8e3b-92cae287a281'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12912024-11-22T05:53:11.730ZINFOSledAgent (ServiceManager): Booting oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
12922024-11-22T05:53:11.747ZINFOSledAgent (ServiceManager): Booting oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
12932024-11-22T05:53:11.798ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ce4a8c36-92c2-4d33-9c26-0b3e805be593'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12942024-11-22T05:53:11.798ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
12952024-11-22T05:53:12.652ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12962024-11-22T05:53:12.653ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
12972024-11-22T05:53:12.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 68.425845ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
12982024-11-22T05:53:12.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 74.650281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
12992024-11-22T05:53:12.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 30.360096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13002024-11-22T05:53:12.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 48.469517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
13012024-11-22T05:53:12.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 67.984196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13022024-11-22T05:53:12.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 57.524936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13032024-11-22T05:53:12.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 26.86218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13042024-11-22T05:53:12.897ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='263bd4c5-59af-44f0-9ab7-249049492f75'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13052024-11-22T05:53:12.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 25.246059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13062024-11-22T05:53:12.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 62.579029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13072024-11-22T05:53:12.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 64.162534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13082024-11-22T05:53:12.924ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13092024-11-22T05:53:12.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 66.453851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
13102024-11-22T05:53:12.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 99.944458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
13112024-11-22T05:53:12.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 82.12144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
13122024-11-22T05:53:12.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 122.887431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13132024-11-22T05:53:12.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 64.326157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13142024-11-22T05:53:12.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 55.025256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13152024-11-22T05:53:13.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 95.855735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13162024-11-22T05:53:13.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 129.852838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
13172024-11-22T05:53:13.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 50.146319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13182024-11-22T05:53:13.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 259.195922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13192024-11-22T05:53:13.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 59.528736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13202024-11-22T05:53:13.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 258.183296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
13212024-11-22T05:53:13.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 154.323011ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13222024-11-22T05:53:13.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 166.460443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13232024-11-22T05:53:13.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 102.3358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13242024-11-22T05:53:13.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 120.254983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
13252024-11-22T05:53:13.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 234.227833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13262024-11-22T05:53:13.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 167.523918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13272024-11-22T05:53:13.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 280.260154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13282024-11-22T05:53:13.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 256.849294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
13292024-11-22T05:53:13.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 106.50172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13302024-11-22T05:53:13.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 46.909382ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13312024-11-22T05:53:13.234ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-11-22T05:53:13.235ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13332024-11-22T05:53:13.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 228.845966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13342024-11-22T05:53:13.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 367.726149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
13352024-11-22T05:53:13.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 260.541406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13362024-11-22T05:53:13.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 123.174173ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13372024-11-22T05:53:13.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 423.811745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13382024-11-22T05:53:13.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 357.294353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13392024-11-22T05:53:13.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 288.636598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13402024-11-22T05:53:13.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 247.588154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
13412024-11-22T05:53:13.354ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422024-11-22T05:53:13.354ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13432024-11-22T05:53:13.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 335.010277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13442024-11-22T05:53:13.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 165.785733ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13452024-11-22T05:53:13.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 979.166117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
13462024-11-22T05:53:13.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 299.931889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13472024-11-22T05:53:13.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 45.151371ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13482024-11-22T05:53:13.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 534.349522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13492024-11-22T05:53:13.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 58.556332ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13502024-11-22T05:53:13.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 823.471058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13512024-11-22T05:53:13.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 72.104478ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13522024-11-22T05:53:13.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 217.452571ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13532024-11-22T05:53:13.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 292.602561ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13542024-11-22T05:53:13.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.001571924s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
13552024-11-22T05:53:13.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 420.625581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13562024-11-22T05:53:13.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 800.295145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
13572024-11-22T05:53:13.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 87.11046ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13582024-11-22T05:53:13.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 721.50702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13592024-11-22T05:53:13.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 560.33902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13602024-11-22T05:53:13.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 537.977177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13612024-11-22T05:53:13.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.120166539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13622024-11-22T05:53:13.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 746.082804ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13632024-11-22T05:53:13.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 299.404909ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13642024-11-22T05:53:14.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 467.278137ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13652024-11-22T05:53:14.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 984.941991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13662024-11-22T05:53:14.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 877.938179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13672024-11-22T05:53:14.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 334.892965ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13682024-11-22T05:53:14.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 888.307227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13692024-11-22T05:53:14.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.484270405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13702024-11-22T05:53:14.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 857.383644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13712024-11-22T05:53:14.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.303948815s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
13722024-11-22T05:53:14.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 989.796184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13732024-11-22T05:53:14.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 942.444717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
13742024-11-22T05:53:14.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 624.676905ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13752024-11-22T05:53:14.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 768.689865ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13762024-11-22T05:53:14.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.40199689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
13772024-11-22T05:53:14.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.107727937s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13782024-11-22T05:53:14.674ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13792024-11-22T05:53:14.674ZINFOSledAgent (ServiceManager): Booting oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
13802024-11-22T05:53:14.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 53.202494ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
13812024-11-22T05:53:14.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 52.130185ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
13822024-11-22T05:53:14.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 977.6594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13832024-11-22T05:53:15.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.176671299s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
13842024-11-22T05:53:15.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 249.673452ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
13852024-11-22T05:53:15.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.015325113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
13862024-11-22T05:53:15.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.490926715s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
13872024-11-22T05:53:15.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 711.212235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
13882024-11-22T05:53:15.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.338789006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
13892024-11-22T05:53:15.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 509.81189ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
13902024-11-22T05:53:15.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 795.556335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
13912024-11-22T05:53:15.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 527.876449ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13922024-11-22T05:53:15.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 563.185717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
13932024-11-22T05:53:15.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.291429408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
13942024-11-22T05:53:15.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.266843641s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
13952024-11-22T05:53:15.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 620.320412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
13962024-11-22T05:53:15.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 993.126893ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
13972024-11-22T05:53:15.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 612.927372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
13982024-11-22T05:53:15.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.206674469s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
13992024-11-22T05:53:16.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.169015566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
14002024-11-22T05:53:16.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 642.781639ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
14012024-11-22T05:53:16.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.415585779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
14022024-11-22T05:53:16.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 927.048546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14032024-11-22T05:53:16.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 641.937723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
14042024-11-22T05:53:16.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.388468347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
14052024-11-22T05:53:16.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.235590501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
14062024-11-22T05:53:16.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 561.903513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
14072024-11-22T05:53:16.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 516.894095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
14082024-11-22T05:53:16.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.48195777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
14092024-11-22T05:53:16.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.068833517s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
14102024-11-22T05:53:16.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.230896155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
14112024-11-22T05:53:16.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.427005499s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
14122024-11-22T05:53:17.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 596.660205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
14132024-11-22T05:53:17.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.439693045s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
14142024-11-22T05:53:17.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 549.679542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14152024-11-22T05:53:17.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.249930403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
14162024-11-22T05:53:17.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 831.677909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
14172024-11-22T05:53:17.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.066628359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
14182024-11-22T05:53:17.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.009378925s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
14192024-11-22T05:53:17.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 501.317105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
14202024-11-22T05:53:17.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.233660272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
14212024-11-22T05:53:17.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 789.508115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14222024-11-22T05:53:17.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.044845593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
14232024-11-22T05:53:17.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 875.476985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
14242024-11-22T05:53:17.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 519.697467ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
14252024-11-22T05:53:18.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.212941999s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
14262024-11-22T05:53:18.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.302943102s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
14272024-11-22T05:53:18.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.283112939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
14282024-11-22T05:53:18.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.473749493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
14292024-11-22T05:53:18.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 808.52206ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
14302024-11-22T05:53:18.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.050950835s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
14312024-11-22T05:53:18.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.183577555s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
14322024-11-22T05:53:18.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.168725844s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
14332024-11-22T05:53:18.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.067965366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
14342024-11-22T05:53:18.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 739.887784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14352024-11-22T05:53:18.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.446071152s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
14362024-11-22T05:53:18.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 562.232798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
14372024-11-22T05:53:18.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.380461981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
14382024-11-22T05:53:18.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 863.940563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
14392024-11-22T05:53:18.923ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402024-11-22T05:53:18.923ZINFOSledAgent (ServiceManager): Booting oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14412024-11-22T05:53:18.945ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14422024-11-22T05:53:18.945ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14432024-11-22T05:53:19.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 908.30546ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
14442024-11-22T05:53:19.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.493161655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
14452024-11-22T05:53:19.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 589.046371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14462024-11-22T05:53:19.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 50.90247ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14472024-11-22T05:53:19.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 38.246143ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14482024-11-22T05:53:19.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 610.379838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
14492024-11-22T05:53:19.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 86.799449ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14502024-11-22T05:53:19.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 74.299648ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14512024-11-22T05:53:19.331ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='786313a2-b1dc-42c9-8b39-8463a88d854f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14522024-11-22T05:53:19.331ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5011025a-5007-4e18-bad6-3b867e3bc813/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3164cac9-4549-41a9-99a2-50a0d75febad'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14532024-11-22T05:53:19.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 685.439285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
14542024-11-22T05:53:19.416ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
14552024-11-22T05:53:19.429ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
14562024-11-22T05:53:19.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.462253629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
14572024-11-22T05:53:19.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 136.89553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14582024-11-22T05:53:19.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.388487619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
14592024-11-22T05:53:19.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 288.393433ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14602024-11-22T05:53:19.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 901.175825ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
14612024-11-22T05:53:19.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 651.733084ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
14622024-11-22T05:53:19.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 689.305491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
14632024-11-22T05:53:19.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 526.971141ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14642024-11-22T05:53:19.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.131409499s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
14652024-11-22T05:53:19.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 54.369616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
14662024-11-22T05:53:19.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 78.650794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
14672024-11-22T05:53:19.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.391464062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
14682024-11-22T05:53:19.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 237.142886ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14692024-11-22T05:53:19.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.450822364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14702024-11-22T05:53:19.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 41.429939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
14712024-11-22T05:53:19.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 287.20484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
14722024-11-22T05:53:19.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.457389418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
14732024-11-22T05:53:19.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 64.983015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
14742024-11-22T05:53:19.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.456644916s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
14752024-11-22T05:53:20.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.099662703s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
14762024-11-22T05:53:20.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 151.342213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
14772024-11-22T05:53:20.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 444.307864ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14782024-11-22T05:53:20.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 892.45556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
14792024-11-22T05:53:20.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.200941812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
14802024-11-22T05:53:20.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 893.801917ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14812024-11-22T05:53:20.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 519.717313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
14822024-11-22T05:53:20.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.11043946s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
14832024-11-22T05:53:20.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 520.122064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
14842024-11-22T05:53:20.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 651.14272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
14852024-11-22T05:53:20.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.128801315s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
14862024-11-22T05:53:20.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 989.723893ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
14872024-11-22T05:53:20.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.291277087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
14882024-11-22T05:53:20.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 623.332434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
14892024-11-22T05:53:20.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 647.963878ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
14902024-11-22T05:53:20.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.183984313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
14912024-11-22T05:53:20.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.023608108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
14922024-11-22T05:53:20.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.145303802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
14932024-11-22T05:53:20.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.259661146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
14942024-11-22T05:53:21.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.371325232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
14952024-11-22T05:53:21.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 688.891527ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
14962024-11-22T05:53:21.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.168073541s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
14972024-11-22T05:53:21.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 706.909507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
14982024-11-22T05:53:21.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 929.113342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
14992024-11-22T05:53:21.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.237711253s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
15002024-11-22T05:53:21.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 629.993849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
15012024-11-22T05:53:21.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.115749068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
15022024-11-22T05:53:21.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.248093012s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
15032024-11-22T05:53:21.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 853.430287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15042024-11-22T05:53:21.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.385851064s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
15052024-11-22T05:53:21.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.115540888s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
15062024-11-22T05:53:21.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 800.469067ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
15072024-11-22T05:53:21.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 674.615625ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
15082024-11-22T05:53:21.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 898.919927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
15092024-11-22T05:53:21.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 979.764051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
15102024-11-22T05:53:21.910ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15112024-11-22T05:53:21.910ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15122024-11-22T05:53:21.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.213188232s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
15132024-11-22T05:53:21.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 607.643056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
15142024-11-22T05:53:22.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 776.352277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
15152024-11-22T05:53:22.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.486208228s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
15162024-11-22T05:53:22.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 54.504622ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15172024-11-22T05:53:22.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.295759649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
15182024-11-22T05:53:22.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 112.588806ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15192024-11-22T05:53:22.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 771.938451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
15202024-11-22T05:53:22.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 1.031435818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15212024-11-22T05:53:22.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 783.325927ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
15222024-11-22T05:53:22.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 239.752077ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15232024-11-22T05:53:22.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 605.715046ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
15242024-11-22T05:53:22.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.327861389s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
15252024-11-22T05:53:22.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 1.478172554s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
15262024-11-22T05:53:22.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 841.787328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
15272024-11-22T05:53:22.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 951.941539ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
15282024-11-22T05:53:22.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 315.487303ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15292024-11-22T05:53:22.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 1.475514227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
15302024-11-22T05:53:22.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 511.968885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
15312024-11-22T05:53:22.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 647.339937ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
15322024-11-22T05:53:22.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 908.985213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
15332024-11-22T05:53:22.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.067848289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
15342024-11-22T05:53:22.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.490598505s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
15352024-11-22T05:53:22.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 532.827717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
15362024-11-22T05:53:22.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 471.192852ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15372024-11-22T05:53:22.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.291536749s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
15382024-11-22T05:53:23.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 942.722681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
15392024-11-22T05:53:23.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.302824629s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
15402024-11-22T05:53:23.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 829.185366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
15412024-11-22T05:53:23.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.26885203s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
15422024-11-22T05:53:23.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 648.822805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
15432024-11-22T05:53:23.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 668.176019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15442024-11-22T05:53:23.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.384703257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
15452024-11-22T05:53:23.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 668.283109ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15462024-11-22T05:53:23.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 676.690072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
15472024-11-22T05:53:23.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 841.021719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
15482024-11-22T05:53:23.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.114643588s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
15492024-11-22T05:53:23.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.34143158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
15502024-11-22T05:53:23.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.367900759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
15512024-11-22T05:53:23.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 712.187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
15522024-11-22T05:53:23.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 774.895947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
15532024-11-22T05:53:23.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 1.249832503s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
15542024-11-22T05:53:23.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 749.830357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
15552024-11-22T05:53:23.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 989.047471ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
15562024-11-22T05:53:23.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 890.332572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
15572024-11-22T05:53:24.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 512.803132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15582024-11-22T05:53:24.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 1.007085851s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15592024-11-22T05:53:24.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 1.057283017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
15602024-11-22T05:53:24.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 510.24637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
15612024-11-22T05:53:24.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 981.60227ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
15622024-11-22T05:53:24.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 915.836907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
15632024-11-22T05:53:24.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.382477927s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
15642024-11-22T05:53:24.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 630.403604ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
15652024-11-22T05:53:24.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.104924221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
15662024-11-22T05:53:24.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.14887364s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
15672024-11-22T05:53:24.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 525.95124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15682024-11-22T05:53:24.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.158764156s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
15692024-11-22T05:53:24.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.401745074s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
15702024-11-22T05:53:24.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 608.200437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
15712024-11-22T05:53:24.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.192243077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
15722024-11-22T05:53:24.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 534.963969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
15732024-11-22T05:53:24.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 639.60313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
15742024-11-22T05:53:24.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 611.28803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
15752024-11-22T05:53:24.943ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 17.826651851s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
15762024-11-22T05:53:24.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.149717271s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
15772024-11-22T05:53:25.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.015968726s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
15782024-11-22T05:53:25.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 843.102129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15792024-11-22T05:53:25.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 994.323719ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
15802024-11-22T05:53:25.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.430720847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
15812024-11-22T05:53:25.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 583.55818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
15822024-11-22T05:53:25.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 876.05016ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
15832024-11-22T05:53:25.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.388712021s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
15842024-11-22T05:53:25.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.327381884s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
15852024-11-22T05:53:25.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.438381588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
15862024-11-22T05:53:25.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 944.214548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
15872024-11-22T05:53:25.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 937.346468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
15882024-11-22T05:53:25.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.032008895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
15892024-11-22T05:53:25.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.21945888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
15902024-11-22T05:53:25.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.131657888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
15912024-11-22T05:53:25.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 871.31592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
15922024-11-22T05:53:25.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.394532369s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
15932024-11-22T05:53:25.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.145789305s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
15942024-11-22T05:53:25.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.322434212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
15952024-11-22T05:53:25.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 980.283136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
15962024-11-22T05:53:26.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.053451374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
15972024-11-22T05:53:26.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 959.609289ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
15982024-11-22T05:53:26.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.023580504s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
15992024-11-22T05:53:26.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 1.349975007s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
16002024-11-22T05:53:26.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.211245673s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
16012024-11-22T05:53:26.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.380347895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
16022024-11-22T05:53:26.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 946.865502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
16032024-11-22T05:53:26.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.028231107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
16042024-11-22T05:53:26.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 615.770729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16052024-11-22T05:53:26.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.122662861s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
16062024-11-22T05:53:26.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 1.391127859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
16072024-11-22T05:53:26.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.447139828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
16082024-11-22T05:53:26.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.051640209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
16092024-11-22T05:53:26.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.253099187s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
16102024-11-22T05:53:26.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.316221394s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
16112024-11-22T05:53:26.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 593.275381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
16122024-11-22T05:53:26.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 566.073272ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
16132024-11-22T05:53:27.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 556.240473ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
16142024-11-22T05:53:27.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 590.46811ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
16152024-11-22T05:53:27.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 799.154355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
16162024-11-22T05:53:27.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.145759533s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
16172024-11-22T05:53:27.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 599.032202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16182024-11-22T05:53:27.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 616.665441ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
16192024-11-22T05:53:27.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.019629178s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
16202024-11-22T05:53:27.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.067977121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
16212024-11-22T05:53:27.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 1.384704887s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
16222024-11-22T05:53:27.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 855.25137ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
16232024-11-22T05:53:27.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 855.519644ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
16242024-11-22T05:53:27.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 822.229824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
16252024-11-22T05:53:27.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 712.297617ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
16262024-11-22T05:53:27.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 627.416061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
16272024-11-22T05:53:27.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.431464439s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
16282024-11-22T05:53:27.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.229383293s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
16292024-11-22T05:53:27.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 612.332938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
16302024-11-22T05:53:27.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 687.277274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16312024-11-22T05:53:27.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 525.579087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
16322024-11-22T05:53:27.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.039319794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
16332024-11-22T05:53:28.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 1.370703607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
16342024-11-22T05:53:28.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 873.24788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
16352024-11-22T05:53:28.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 551.396461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
16362024-11-22T05:53:28.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.267838313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
16372024-11-22T05:53:28.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 835.133622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
16382024-11-22T05:53:28.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 862.890962ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
16392024-11-22T05:53:28.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 984.431316ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
16402024-11-22T05:53:28.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.027450362s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
16412024-11-22T05:53:28.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 521.12984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
16422024-11-22T05:53:28.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 958.025255ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
16432024-11-22T05:53:28.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 741.069145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
16442024-11-22T05:53:28.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.324891104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
16452024-11-22T05:53:28.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.316099766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
16462024-11-22T05:53:28.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.228180161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
16472024-11-22T05:53:28.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.266722149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16482024-11-22T05:53:28.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 738.648464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
16492024-11-22T05:53:28.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 1.305405628s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
16502024-11-22T05:53:28.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.126308531s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
16512024-11-22T05:53:28.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 1.070094484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
16522024-11-22T05:53:29.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 608.27352ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
16532024-11-22T05:53:29.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.483132542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
16542024-11-22T05:53:29.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.440574846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
16552024-11-22T05:53:29.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.392584798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
16562024-11-22T05:53:29.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 720.15195ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
16572024-11-22T05:53:29.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 658.746218ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
16582024-11-22T05:53:29.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 1.433577005s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
16592024-11-22T05:53:29.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.381662164s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
16602024-11-22T05:53:29.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 969.80389ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
16612024-11-22T05:53:29.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 1.48270045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
16622024-11-22T05:53:29.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.380280482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
16632024-11-22T05:53:29.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.231641513s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
16642024-11-22T05:53:29.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 915.711414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
16652024-11-22T05:53:29.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.148795533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
16662024-11-22T05:53:29.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.27270043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
16672024-11-22T05:53:29.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 936.340775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
16682024-11-22T05:53:29.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.10703225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16692024-11-22T05:53:29.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 562.033548ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
16702024-11-22T05:53:29.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 1.420961421s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
16712024-11-22T05:53:30.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 1.434556789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
16722024-11-22T05:53:30.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 835.538385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
16732024-11-22T05:53:30.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 929.651765ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
16742024-11-22T05:53:30.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 1.270889042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
16752024-11-22T05:53:30.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 914.539906ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
16762024-11-22T05:53:30.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 707.797526ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
16772024-11-22T05:53:30.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 946.294526ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
16782024-11-22T05:53:30.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 895.311282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
16792024-11-22T05:53:30.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.131497169s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
16802024-11-22T05:53:30.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 852.779424ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
16812024-11-22T05:53:30.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.48158675s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
16822024-11-22T05:53:30.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 1.090246882s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
16832024-11-22T05:53:30.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 1.116371807s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
16842024-11-22T05:53:30.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 920.124088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
16852024-11-22T05:53:30.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec") failed: Property not found. retry in 1.359977752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
16862024-11-22T05:53:30.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 523.968072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16872024-11-22T05:53:30.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891") failed: Property not found. retry in 1.475637142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
16882024-11-22T05:53:30.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 672.514046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
16892024-11-22T05:53:31.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7") failed: Property not found. retry in 1.344761694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
16902024-11-22T05:53:31.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 664.185952ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
16912024-11-22T05:53:31.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 1.409536384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
16922024-11-22T05:53:31.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75") failed: Property not found. retry in 870.725414ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
16932024-11-22T05:53:31.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.258659202s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
16942024-11-22T05:53:31.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 833.165633ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
16952024-11-22T05:53:31.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea") failed: Property not found. retry in 537.893675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
16962024-11-22T05:53:31.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 991.915819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
16972024-11-22T05:53:31.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 717.754211ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
16982024-11-22T05:53:31.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 1.343582003s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
16992024-11-22T05:53:31.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551") failed: Property not found. retry in 1.315244773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
17002024-11-22T05:53:31.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19") failed: Property not found. retry in 580.84681ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
17012024-11-22T05:53:31.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63") failed: Property not found. retry in 1.137964999s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
17022024-11-22T05:53:31.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf") failed: Property not found. retry in 1.297291572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
17032024-11-22T05:53:31.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 591.926444ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
17042024-11-22T05:53:31.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 606.348703ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
17052024-11-22T05:53:31.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36") failed: Property not found. retry in 1.440952747s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
17062024-11-22T05:53:32.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e") failed: Property not found. retry in 1.45365606s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
17072024-11-22T05:53:32.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362") failed: Property not found. retry in 1.02086644s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
17082024-11-22T05:53:32.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802") failed: Property not found. retry in 765.242486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
17092024-11-22T05:53:32.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede") failed: Property not found. retry in 778.695013ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
17102024-11-22T05:53:32.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d") failed: Property not found. retry in 1.331006516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
17112024-11-22T05:53:32.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6") failed: Property not found. retry in 1.172360552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
17122024-11-22T05:53:32.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab") failed: Property not found. retry in 1.00265571s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
17132024-11-22T05:53:32.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09") failed: Property not found. retry in 834.621963ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
17142024-11-22T05:53:32.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c") failed: Property not found. retry in 612.708714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
17152024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_oximeter_263bd4c5-59af-44f0-9ab7-249049492f75
17162024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_26ea84d1-4927-431e-a6b1-ff34cee0e2ec
17172024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_7290d2a3-c0f3-43f5-af40-c91be1504bea
17182024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_0a3ea476-f35b-40d9-868b-7b4f4c438bf7
17192024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_db656b86-f032-4326-8a6e-14de8692fccf
17202024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_944dfa82-0d31-483c-9606-a464ddba8f2e
17212024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_3e41278f-c6d6-455d-9155-b44af9aafa63
17222024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_6652103c-533e-477f-853d-d5a6ff146362
17232024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_1a17ffde-7e17-46a2-80a5-3effa07c2a36
17242024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_04ec7037-23ad-463c-89a4-3c11e29fdc19
17252024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_25fb7e03-cb6e-490e-94ae-52c4ba6cf802
17262024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_external_dns_e40af71f-a5c0-473a-94dd-6fd1db818ede
17272024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_7ac3407d-cb8c-4509-86e6-086558a7517d
17282024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_nexus_7c155939-0b0e-4a50-a14d-2fb48dae613c
17292024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_c6bc2660-1fa1-4a03-8c11-33cd3b3b21e6
17302024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_85574770-42a5-4426-840d-937ee2fe59ab
17312024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_pantry_5d531444-6ead-44c7-80f4-b62f0be40891
17322024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_clickhouse_5eb957e5-fc6c-4d3e-abdb-1ff615308d09
17332024-11-22T05:53:34.137ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3318 zone = oxz_crucible_4f88574d-a32e-4791-b5ee-4e32fd4d5551
17342024-11-22T05:53:34.138ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
17352024-11-22T05:53:34.168ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json"
17362024-11-22T05:53:34.168ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:200
17372024-11-22T05:53:34.205ZINFOSledAgent (ServiceManager): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json"
17382024-11-22T05:53:34.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35508216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41076 req_id = dcd635b6-4100-4cc6-8bec-6d8b456e52ea response_code = 204 uri = /omicron-zones
17392024-11-22T05:53:34.253ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1448
17402024-11-22T05:53:34.253ZINFOSledAgent (RSS): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
17412024-11-22T05:53:34.253ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/rss-plan-completed.marker"
17422024-11-22T05:53:34.253ZINFOSledAgent (RSS): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:200
17432024-11-22T05:53:34.254ZINFOSledAgent (RSS): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/rss-plan-completed.marker"
17442024-11-22T05:53:34.624ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:787
17452024-11-22T05:53:34.625ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:799
17462024-11-22T05:53:34.665ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1013
17472024-11-22T05:53:38.218ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17482024-11-22T05:53:38.287ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17492024-11-22T05:53:38.426ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17502024-11-22T05:53:38.583ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17512024-11-22T05:53:38.767ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17522024-11-22T05:53:38.892ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17532024-11-22T05:53:39.090ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17542024-11-22T05:53:39.497ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17552024-11-22T05:53:39.678ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17562024-11-22T05:53:40.220ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17572024-11-22T05:53:40.686ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50044
17582024-11-22T05:53:40.688ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 609 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50044 req_id = e459acbf-adb1-40a5-85bd-94bb2a6d91a8 response_code = 200 uri = /baseboard
17592024-11-22T05:53:40.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17602024-11-22T05:53:41.272ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17612024-11-22T05:53:42.126ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17622024-11-22T05:53:42.817ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 66.739254219s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
17632024-11-22T05:53:43.108ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/bc798e4e-a9f0-45a6-90cf-a2cdd3f22375/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1075
17642024-11-22T05:53:44.730ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f88eb035-1892-4634-a8da-b07f5f6077d5", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"bc798e4e-a9f0-45a6-90cf-a2cdd3f22375\"", request_id: "f88eb035-1892-4634-a8da-b07f5f6077d5" } file = sled-agent/src/rack_setup/service.rs:1075
17652024-11-22T05:53:46.246ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "75738711-3d18-4d6d-8dec-5485686fb415", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9\"", request_id: "75738711-3d18-4d6d-8dec-5485686fb415" } file = sled-agent/src/rack_setup/service.rs:1075
17662024-11-22T05:53:47.572ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "860ede1a-eabe-4159-93d1-c24be8f6b2c1", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9\"", request_id: "860ede1a-eabe-4159-93d1-c24be8f6b2c1" } file = sled-agent/src/rack_setup/service.rs:1075
17672024-11-22T05:53:49.563ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "38bcd5b0-3ee3-4812-bff2-5af96ce15071", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9\"", request_id: "38bcd5b0-3ee3-4812-bff2-5af96ce15071" } file = sled-agent/src/rack_setup/service.rs:1075
17682024-11-22T05:53:51.869ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "aba4c08c-9e18-45ae-a378-c871ecc7f5fa", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9\"", request_id: "aba4c08c-9e18-45ae-a378-c871ecc7f5fa" } file = sled-agent/src/rack_setup/service.rs:1075
17692024-11-22T05:53:55.282ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "29fd814a-4d2c-483c-96e8-0b9582cb4496", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9\"", request_id: "29fd814a-4d2c-483c-96e8-0b9582cb4496" } file = sled-agent/src/rack_setup/service.rs:1075
17702024-11-22T05:53:58.912ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e65b0855-039a-4ab3-b4fe-012458ca315e", "content-length": "173", "date": "Fri, 22 Nov 2024 05:53:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9\"", request_id: "e65b0855-039a-4ab3-b4fe-012458ca315e" } file = sled-agent/src/rack_setup/service.rs:1075
17712024-11-22T05:54:00.041ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
17722024-11-22T05:54:00.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43055
17732024-11-22T05:54:00.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17742024-11-22T05:54:00.128ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17752024-11-22T05:54:00.128ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
17762024-11-22T05:54:00.129ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
17772024-11-22T05:54:00.144ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17782024-11-22T05:54:00.144ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56
17792024-11-22T05:54:00.172ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17802024-11-22T05:54:00.172ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5011025a-5007-4e18-bad6-3b867e3bc813
17812024-11-22T05:54:00.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17822024-11-22T05:54:00.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f4e28855-9173-4d42-9164-2e22168b6a5d
17832024-11-22T05:54:00.221ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17842024-11-22T05:54:00.221ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706
17852024-11-22T05:54:00.246ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17862024-11-22T05:54:00.246ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e
17872024-11-22T05:54:00.268ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17882024-11-22T05:54:00.268ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_38f500bf-3a39-433c-8745-e20b3ab66215
17892024-11-22T05:54:00.291ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17902024-11-22T05:54:00.291ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9
17912024-11-22T05:54:00.312ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17922024-11-22T05:54:00.312ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d
17932024-11-22T05:54:00.333ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17942024-11-22T05:54:00.333ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_633ab940-354c-4903-be3d-50b19510ea4f
17952024-11-22T05:54:00.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43055 req_id = b5de771f-5cd9-4da6-909a-336e4f377040 response_code = 200 uri = /inventory
17962024-11-22T05:54:04.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38620
17972024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17982024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
17992024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18002024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18022024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18032024-11-22T05:54:04.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18042024-11-22T05:54:04.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38620 req_id = a2c5e11c-ded7-40ac-996c-8fee994defc4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18052024-11-22T05:54:04.196ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1085
18062024-11-22T05:54:04.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33280
18072024-11-22T05:54:04.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18082024-11-22T05:54:04.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18092024-11-22T05:54:04.417ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
18102024-11-22T05:54:04.418ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
18112024-11-22T05:54:04.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18122024-11-22T05:54:04.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56
18132024-11-22T05:54:04.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18142024-11-22T05:54:04.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5011025a-5007-4e18-bad6-3b867e3bc813
18152024-11-22T05:54:04.481ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162024-11-22T05:54:04.481ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f4e28855-9173-4d42-9164-2e22168b6a5d
18172024-11-22T05:54:04.505ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18182024-11-22T05:54:04.505ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706
18192024-11-22T05:54:04.527ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18202024-11-22T05:54:04.527ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e
18212024-11-22T05:54:04.551ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18222024-11-22T05:54:04.551ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_38f500bf-3a39-433c-8745-e20b3ab66215
18232024-11-22T05:54:04.572ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18242024-11-22T05:54:04.572ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9
18252024-11-22T05:54:04.592ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18262024-11-22T05:54:04.592ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d
18272024-11-22T05:54:04.612ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18282024-11-22T05:54:04.612ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_633ab940-354c-4903-be3d-50b19510ea4f
18292024-11-22T05:54:04.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206718 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33280 req_id = 2615c672-0b31-4996-adc5-872c9b2f5832 response_code = 200 uri = /inventory
18302024-11-22T05:54:05.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54513
18312024-11-22T05:54:05.413ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18322024-11-22T05:54:05.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18332024-11-22T05:54:05.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18342024-11-22T05:54:05.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18352024-11-22T05:54:05.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18362024-11-22T05:54:05.413ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18372024-11-22T05:54:05.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18382024-11-22T05:54:05.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54513 req_id = 25761ed1-6560-437e-ab1b-71c8a1c61c98 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18392024-11-22T05:54:05.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55820
18402024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18412024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18422024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18432024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18442024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18452024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18462024-11-22T05:54:05.664ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18472024-11-22T05:54:05.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55820 req_id = 2517963d-66b1-414f-b6cf-4e236cce1619 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18482024-11-22T05:54:05.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39619
18492024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18502024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
18512024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18522024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18532024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18542024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-11-22T05:54:05.811ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18562024-11-22T05:54:05.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39619 req_id = f1325c72-bbba-4dcb-9d2c-df1dadbf0a4d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18572024-11-22T05:54:10.726ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52672
18582024-11-22T05:54:10.727ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52672 req_id = fcdf8260-e835-4460-9f87-6b4fc5aaf715 response_code = 200 uri = /baseboard
18592024-11-22T05:54:12.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59717
18602024-11-22T05:54:12.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 837 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59717 req_id = 1fff5df9-c782-414b-9cb8-8d21a12b8078 response_code = 200 uri = /vpc-routes
18612024-11-22T05:54:12.978ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
18622024-11-22T05:54:12.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59717 req_id = 262bb7ee-865c-4e10-9e25-0494b10bffcc response_code = 204 uri = /eip-gateways
18632024-11-22T05:54:13.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2711 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59717 req_id = ec5cef1b-2228-4458-b811-1d603be5e9ee response_code = 204 uri = /vpc-routes
18642024-11-22T05:54:14.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64755
18652024-11-22T05:54:14.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64755 req_id = 6cc2ecf6-5ddf-4e6e-9e28-edf3ad738176 response_code = 200 uri = /vpc-routes
18662024-11-22T05:54:14.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
18672024-11-22T05:54:14.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64755 req_id = 4e396d6e-6071-40bc-ac03-7eed106c2b83 response_code = 204 uri = /eip-gateways
18682024-11-22T05:54:14.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64755 req_id = 1a0aff08-6390-402f-8684-dd9a0b80f5e5 response_code = 204 uri = /vpc-routes
18692024-11-22T05:54:15.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42413
18702024-11-22T05:54:15.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 587 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42413 req_id = 29add61a-835d-4363-a994-3adeee486ba0 response_code = 200 uri = /v2p
18712024-11-22T05:54:15.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36090
18722024-11-22T05:54:15.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36090 req_id = 8178d5d9-b60c-4729-8777-402a35208311 response_code = 200 uri = /vpc-routes
18732024-11-22T05:54:15.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45303
18742024-11-22T05:54:15.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18752024-11-22T05:54:15.339ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18762024-11-22T05:54:15.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45303 req_id = 33f5d4c0-31d5-432a-9a42-ae3d884610cf response_code = 204 uri = /switch-ports
18772024-11-22T05:54:15.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50421
18782024-11-22T05:54:15.415ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
18792024-11-22T05:54:15.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36090 req_id = 9bc2bbf8-7ca2-4025-86e3-f5cc961694c8 response_code = 204 uri = /eip-gateways
18802024-11-22T05:54:15.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49760
18812024-11-22T05:54:15.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51796
18822024-11-22T05:54:15.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50421 req_id = ce20dd7e-f925-4707-9b54-db2cff125aa4 response_code = 200 uri = /vpc-routes
18832024-11-22T05:54:15.415ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18842024-11-22T05:54:15.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5645 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45303 req_id = 48c069b6-907b-42ac-9af1-585e24efeafa response_code = 200 uri = /network-bootstore-config
18852024-11-22T05:54:15.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49760 req_id = dd4b89cb-f33e-4d79-bad2-7d6965254b6c response_code = 200 uri = /v2p
18862024-11-22T05:54:15.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36090 req_id = e78cb71a-096c-4f2b-a3f0-f65cda891433 response_code = 204 uri = /vpc-routes
18872024-11-22T05:54:15.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47993
18882024-11-22T05:54:15.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55896
18892024-11-22T05:54:15.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47993 req_id = 2140561b-570a-4f40-9e42-d473566e9482 response_code = 200 uri = /v2p
18902024-11-22T05:54:15.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
18912024-11-22T05:54:15.479ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
18922024-11-22T05:54:15.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50421 req_id = 1712b479-34e0-4649-a3e6-c567a37877d6 response_code = 204 uri = /eip-gateways
18932024-11-22T05:54:15.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 979 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50421 req_id = 6bb67f59-57eb-4d4f-b2ec-c9a588aa593e response_code = 204 uri = /vpc-routes
18942024-11-22T05:54:15.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124431 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51796 req_id = 8165f8d5-3764-43d5-b900-f1e7619f54ef response_code = 204 uri = /switch-ports
18952024-11-22T05:54:15.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
18962024-11-22T05:54:15.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 779 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51796 req_id = fd984320-0135-4f8e-adfa-cd121900fc44 response_code = 200 uri = /network-bootstore-config
18972024-11-22T05:54:15.573ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18982024-11-22T05:54:15.573ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
18992024-11-22T05:54:15.574ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
19002024-11-22T05:54:15.574ZINFOSledAgent (bootstore): Writing ledger to /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:200 peer_id = pc-buskin-i86pc
19012024-11-22T05:54:15.576ZINFOSledAgent (bootstore): Successfully wrote to ledger file = common/src/ledger.rs:133 path = "/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/cluster/bootstore-network-config.json" peer_id = pc-buskin-i86pc
19022024-11-22T05:54:15.576ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
19032024-11-22T05:54:15.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4437 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45303 req_id = 15c07f8b-f8dd-4617-8b7d-ad5dc6784217 response_code = 204 uri = /network-bootstore-config
19042024-11-22T05:54:15.583ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19052024-11-22T05:54:15.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55896 req_id = 4053c873-0cb7-4bd7-ad0d-fa08843bf023 response_code = 204 uri = /switch-ports
19062024-11-22T05:54:15.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55896 req_id = ec24be36-d1d2-4e65-a997-168a92f29402 response_code = 200 uri = /network-bootstore-config
19072024-11-22T05:54:40.760ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55465
19082024-11-22T05:54:40.761ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55465 req_id = 91e1ef66-a74c-4d4d-97f1-33528bb1674c response_code = 200 uri = /baseboard
19092024-11-22T05:54:45.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57414
19102024-11-22T05:54:45.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19112024-11-22T05:54:45.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 794 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57414 req_id = cf1599dc-5a90-4393-995a-f8519b3f3db8 response_code = 200 uri = /artifacts
19122024-11-22T05:54:45.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60902
19132024-11-22T05:54:45.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60902 req_id = e6152a53-3754-47b0-a26c-3da839ab02e9 response_code = 200 uri = /vpc-routes
19142024-11-22T05:54:45.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59060
19152024-11-22T05:54:45.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59060 req_id = b83b53bf-c83d-4028-8937-7f533ba51e21 response_code = 200 uri = /vpc-routes
19162024-11-22T05:54:45.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61162
19172024-11-22T05:54:45.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61162 req_id = 63f8bcee-66dd-4ed2-8e2e-b68e40064556 response_code = 200 uri = /vpc-routes
19182024-11-22T05:54:45.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54338
19192024-11-22T05:54:45.467ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19202024-11-22T05:54:45.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54338 req_id = 4a040964-fe0b-4fd4-a24c-069c82b38738 response_code = 200 uri = /artifacts
19212024-11-22T05:54:45.487ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
19222024-11-22T05:54:45.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61162 req_id = b2a1c1f4-8e65-46a1-853e-282118631a76 response_code = 204 uri = /eip-gateways
19232024-11-22T05:54:45.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58266
19242024-11-22T05:54:45.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58266 req_id = 601c3f52-1402-497e-91d1-76694fd8ac99 response_code = 200 uri = /v2p
19252024-11-22T05:54:45.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55819
19262024-11-22T05:54:45.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55819 req_id = 6c40a927-3587-4956-b99a-a58d89b117d6 response_code = 200 uri = /v2p
19272024-11-22T05:54:45.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
19282024-11-22T05:54:45.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59060 req_id = d7ca8146-6a60-48b5-a70a-f77b8599d690 response_code = 204 uri = /eip-gateways
19292024-11-22T05:54:45.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61691
19302024-11-22T05:54:45.543ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19312024-11-22T05:54:45.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61691 req_id = fa334b23-a3ac-4e82-98c5-8c755f47657e response_code = 200 uri = /artifacts
19322024-11-22T05:54:45.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59060 req_id = 338a65f6-ec53-4baf-b909-ff645c04b455 response_code = 204 uri = /vpc-routes
19332024-11-22T05:54:45.551ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
19342024-11-22T05:54:45.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60902 req_id = 0495979d-d647-418a-bebf-8c8d5c1023d7 response_code = 204 uri = /eip-gateways
19352024-11-22T05:54:45.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60902 req_id = 4d4fe0ee-fbe8-4836-a62d-cbc670636371 response_code = 204 uri = /vpc-routes
19362024-11-22T05:54:45.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61162 req_id = c82945b7-3905-4dd5-a521-ac70c63aaa83 response_code = 204 uri = /vpc-routes
19372024-11-22T05:54:45.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56961
19382024-11-22T05:54:45.668ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19392024-11-22T05:54:45.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19402024-11-22T05:54:45.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94942 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56961 req_id = 6580626b-601a-4b67-9bcd-d0d6ae4c1c59 response_code = 204 uri = /switch-ports
19412024-11-22T05:54:45.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39520
19422024-11-22T05:54:45.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56961 req_id = 1af0f3d8-2b1d-4ba8-bc55-fda6d5beaea9 response_code = 200 uri = /network-bootstore-config
19432024-11-22T05:54:45.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39520 req_id = 4471d820-e814-4d33-a462-ba84564dd715 response_code = 200 uri = /v2p
19442024-11-22T05:54:45.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49103
19452024-11-22T05:54:45.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42635
19462024-11-22T05:54:45.766ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19472024-11-22T05:54:45.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19482024-11-22T05:54:45.851ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19492024-11-22T05:54:45.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42635 req_id = de69af9a-6b5a-4627-a1bf-d55a2fbd9c35 response_code = 204 uri = /switch-ports
19502024-11-22T05:54:45.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42635 req_id = a8e14e29-b7e2-443c-8c46-f9354e25022a response_code = 200 uri = /network-bootstore-config
19512024-11-22T05:54:45.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19522024-11-22T05:54:45.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49103 req_id = cdc104f1-4448-45b4-8336-7546e53a3ccd response_code = 204 uri = /switch-ports
19532024-11-22T05:54:45.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49103 req_id = e6cae64f-4d72-407e-9063-fb94f1787411 response_code = 200 uri = /network-bootstore-config
19542024-11-22T05:54:58.989ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:40649 remote_addr = [fd00:1122:3344:101::d]:59482 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
19552024-11-22T05:54:59.015ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25482 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = add7fad8-3bf2-4eba-94ff-e64ab4630e67 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
19562024-11-22T05:55:10.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59978
19572024-11-22T05:55:10.795ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59978 req_id = 3cfe5d58-b398-492e-8b93-e1cbd3168ec5 response_code = 200 uri = /baseboard
19582024-11-22T05:55:14.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51980
19592024-11-22T05:55:14.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51980 req_id = 3637410b-0764-4728-bfa3-d49248132d5b response_code = 200 uri = /vpc-routes
19602024-11-22T05:55:15.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38390
19612024-11-22T05:55:15.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38390 req_id = 328ca13a-a5bc-4f98-8771-7f0c84316991 response_code = 200 uri = /v2p
19622024-11-22T05:55:15.062ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
19632024-11-22T05:55:15.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51980 req_id = 0df2d271-ee72-4f13-9966-d2e478bf2a43 response_code = 204 uri = /eip-gateways
19642024-11-22T05:55:15.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51980 req_id = cadf8198-4c88-4b44-9be1-aef64b049330 response_code = 204 uri = /vpc-routes
19652024-11-22T05:55:15.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43849
19662024-11-22T05:55:15.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43849 req_id = e4800455-3d1f-46c3-85ad-1e966dae888a response_code = 200 uri = /vpc-routes
19672024-11-22T05:55:15.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47004
19682024-11-22T05:55:15.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47004 req_id = 5f362cf1-acdd-462d-a4ea-1c65eb18098f response_code = 200 uri = /vpc-routes
19692024-11-22T05:55:15.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
19702024-11-22T05:55:15.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47004 req_id = 73f80f11-2998-4462-9c61-b0f625906312 response_code = 204 uri = /eip-gateways
19712024-11-22T05:55:15.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
19722024-11-22T05:55:15.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43849 req_id = b7a6ddc6-c9e5-4603-8122-43da280f3d5d response_code = 204 uri = /eip-gateways
19732024-11-22T05:55:15.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47004 req_id = 23bd0285-d2e3-47c0-a16c-b6211ae86d60 response_code = 204 uri = /vpc-routes
19742024-11-22T05:55:15.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50071
19752024-11-22T05:55:15.285ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19762024-11-22T05:55:15.326ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19772024-11-22T05:55:15.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101153 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50071 req_id = 54421d83-7a4f-446d-8405-c49c3422225c response_code = 204 uri = /switch-ports
19782024-11-22T05:55:15.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57836
19792024-11-22T05:55:15.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60130
19802024-11-22T05:55:15.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50071 req_id = 926efd56-d0cc-478d-af1c-ba08a3ed4756 response_code = 200 uri = /network-bootstore-config
19812024-11-22T05:55:15.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43849 req_id = e4e32237-ab03-4ba6-b9ed-f63e02a6f5a7 response_code = 204 uri = /vpc-routes
19822024-11-22T05:55:15.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60130 req_id = 9e0df1cd-aa8f-4b86-b6c9-31cf0f4dc4b9 response_code = 200 uri = /v2p
19832024-11-22T05:55:15.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57836 req_id = 4690c3f9-0424-42df-a951-999f2cc69c8e response_code = 200 uri = /v2p
19842024-11-22T05:55:15.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47034
19852024-11-22T05:55:15.431ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19862024-11-22T05:55:15.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19872024-11-22T05:55:15.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47034 req_id = de0bc25c-dfcc-43c3-9954-12732f9e7169 response_code = 204 uri = /switch-ports
19882024-11-22T05:55:15.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52080
19892024-11-22T05:55:15.522ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
19902024-11-22T05:55:15.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3568 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47034 req_id = 3803b742-5abe-47cb-9ba9-618dd536b75b response_code = 200 uri = /network-bootstore-config
19912024-11-22T05:55:15.557ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
19922024-11-22T05:55:15.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52080 req_id = f7d85b70-2a9b-483b-b20d-c2e7565d9766 response_code = 204 uri = /switch-ports
19932024-11-22T05:55:15.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52080 req_id = 4a9d36be-8f09-4873-9531-fa4ff0004e40 response_code = 200 uri = /network-bootstore-config
19942024-11-22T05:55:25.335ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19952024-11-22T05:55:28.995ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6664 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = f74368fe-7f85-462c-96a8-2064f51421e1 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
19962024-11-22T05:55:40.829ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45333
19972024-11-22T05:55:40.829ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45333 req_id = efea0018-87e2-48cf-b387-54f92baaa404 response_code = 200 uri = /baseboard
19982024-11-22T05:55:44.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51155
19992024-11-22T05:55:44.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51155 req_id = ae7cb969-d224-4b9f-a13a-3f69b3d61d21 response_code = 200 uri = /vpc-routes
20002024-11-22T05:55:45.081ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20012024-11-22T05:55:45.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51155 req_id = 7f72543d-51e0-4909-83d5-790a1afc7667 response_code = 204 uri = /eip-gateways
20022024-11-22T05:55:45.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42004
20032024-11-22T05:55:45.301ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20042024-11-22T05:55:45.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42004 req_id = 24decb0f-62fe-4946-8475-4b8f53254afd response_code = 200 uri = /artifacts
20052024-11-22T05:55:45.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 366 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51155 req_id = 2c0d7756-66ff-4665-bb72-b5a48df738d2 response_code = 204 uri = /vpc-routes
20062024-11-22T05:55:45.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45983
20072024-11-22T05:55:45.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45983 req_id = 139543cf-8cd4-4561-97b9-f794bc5db3f0 response_code = 200 uri = /v2p
20082024-11-22T05:55:45.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43405
20092024-11-22T05:55:45.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20102024-11-22T05:55:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43405 req_id = ca5fdf06-df9e-4a60-92fb-ef0376c7ad8a response_code = 200 uri = /artifacts
20112024-11-22T05:55:45.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48523
20122024-11-22T05:55:45.508ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20132024-11-22T05:55:45.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48523 req_id = 893470e5-6280-47c7-a7a4-ade0e4d33faf response_code = 200 uri = /artifacts
20142024-11-22T05:55:45.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49138
20152024-11-22T05:55:45.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49138 req_id = c154229b-badd-485a-bb00-6bc3260f3aa3 response_code = 200 uri = /vpc-routes
20162024-11-22T05:55:45.587ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20172024-11-22T05:55:45.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49138 req_id = 87431bd0-53ef-4b88-9941-3331abdb8f03 response_code = 204 uri = /eip-gateways
20182024-11-22T05:55:45.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57128
20192024-11-22T05:55:45.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57128 req_id = 3071299e-8be4-4a35-865e-fafb4c49c58e response_code = 200 uri = /vpc-routes
20202024-11-22T05:55:45.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58768
20212024-11-22T05:55:45.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58768 req_id = 05c7503c-e67f-4722-9ca7-d7626f6e4087 response_code = 200 uri = /v2p
20222024-11-22T05:55:45.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49138 req_id = 87a59751-5d74-4097-a17e-caf2c81b9830 response_code = 204 uri = /vpc-routes
20232024-11-22T05:55:45.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20242024-11-22T05:55:45.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57128 req_id = 7e09a03d-6918-4e74-9bb6-f305808a9f49 response_code = 204 uri = /eip-gateways
20252024-11-22T05:55:45.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57128 req_id = 01f4000e-a61a-4e3b-ad63-c29c8edadafd response_code = 204 uri = /vpc-routes
20262024-11-22T05:55:45.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34751
20272024-11-22T05:55:45.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20282024-11-22T05:55:45.710ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20292024-11-22T05:55:45.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98196 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34751 req_id = 71470a59-f307-49ff-aa3e-121e88e2507d response_code = 204 uri = /switch-ports
20302024-11-22T05:55:45.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39165
20312024-11-22T05:55:45.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59586
20322024-11-22T05:55:45.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33238
20332024-11-22T05:55:45.769ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20342024-11-22T05:55:45.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3802 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39165 req_id = a5d6616f-3697-4c6a-a82d-48ae5f46048c response_code = 200 uri = /v2p
20352024-11-22T05:55:45.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3846 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34751 req_id = c5c721b8-dfe9-4c22-be92-9f2b6e693d80 response_code = 200 uri = /network-bootstore-config
20362024-11-22T05:55:45.806ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20372024-11-22T05:55:45.874ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20382024-11-22T05:55:45.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33238 req_id = 2d24f9b8-7842-4445-86ad-9d03caa12a19 response_code = 204 uri = /switch-ports
20392024-11-22T05:55:45.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 805 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33238 req_id = 02ce1bbd-cb43-48d8-8144-fcc7b4886a3e response_code = 200 uri = /network-bootstore-config
20402024-11-22T05:55:45.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20412024-11-22T05:55:45.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59586 req_id = af932dd6-8d68-4365-9c6a-0516bd78770c response_code = 204 uri = /switch-ports
20422024-11-22T05:55:45.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59586 req_id = 195d6ee4-d1c4-4313-9a28-7a5672530bd7 response_code = 200 uri = /network-bootstore-config
20432024-11-22T05:55:58.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7492 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = e039cf16-c34b-45a7-a5a8-baeca86a1ce4 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
20442024-11-22T05:56:10.871ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44006
20452024-11-22T05:56:10.871ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44006 req_id = ad501d8e-6888-4ac4-a0f6-d84e43bbea93 response_code = 200 uri = /baseboard
20462024-11-22T05:56:14.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57588
20472024-11-22T05:56:14.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57588 req_id = 59d2d07a-2818-4369-9c99-acce93d980c9 response_code = 200 uri = /vpc-routes
20482024-11-22T05:56:14.982ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20492024-11-22T05:56:14.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57588 req_id = 0afe6d51-2b4b-461f-82a2-2c8bb57c986b response_code = 204 uri = /eip-gateways
20502024-11-22T05:56:15.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57588 req_id = df835a02-8e85-4e25-a500-31bea9fa17eb response_code = 204 uri = /vpc-routes
20512024-11-22T05:56:15.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52533
20522024-11-22T05:56:15.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20532024-11-22T05:56:15.090ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20542024-11-22T05:56:15.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52533 req_id = 051a6cef-d6d8-48d4-bbbe-a86d14ea16bf response_code = 204 uri = /switch-ports
20552024-11-22T05:56:15.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49492
20562024-11-22T05:56:15.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49492 req_id = bf2822a2-2400-448b-8c69-3b8c92835ca5 response_code = 200 uri = /v2p
20572024-11-22T05:56:15.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52533 req_id = 0ace3fb9-d158-47e7-a6dc-560f29aec4f2 response_code = 200 uri = /network-bootstore-config
20582024-11-22T05:56:15.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35032
20592024-11-22T05:56:15.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35032 req_id = ae9a66f6-2011-4f6e-a65d-203ec2d10010 response_code = 200 uri = /v2p
20602024-11-22T05:56:15.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59235
20612024-11-22T05:56:15.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59235 req_id = 862640b3-5674-4b01-8a88-876654ef9b9b response_code = 200 uri = /vpc-routes
20622024-11-22T05:56:15.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20632024-11-22T05:56:15.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59235 req_id = 72ea0e97-c9a0-49e4-bcdb-53357408e198 response_code = 204 uri = /eip-gateways
20642024-11-22T05:56:15.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59235 req_id = 5bcc9af3-e13b-4b44-beef-b4c9061d7c7d response_code = 204 uri = /vpc-routes
20652024-11-22T05:56:15.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58793
20662024-11-22T05:56:15.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58793 req_id = 5ea0272d-dd51-4f93-b95f-e72c9aa094a0 response_code = 200 uri = /vpc-routes
20672024-11-22T05:56:15.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20682024-11-22T05:56:15.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58793 req_id = bee1529f-5fca-493f-9605-198760f9c66e response_code = 204 uri = /eip-gateways
20692024-11-22T05:56:15.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46646
20702024-11-22T05:56:15.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46646 req_id = ff34e87c-b530-452b-b564-f9f72f2801d9 response_code = 200 uri = /v2p
20712024-11-22T05:56:15.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58793 req_id = 41cb5e01-134f-4b9e-9ab1-66960a99a86f response_code = 204 uri = /vpc-routes
20722024-11-22T05:56:15.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56981
20732024-11-22T05:56:15.421ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20742024-11-22T05:56:15.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20752024-11-22T05:56:15.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56981 req_id = 6b4752e5-e158-4420-bfb3-8b8e9a54c42d response_code = 204 uri = /switch-ports
20762024-11-22T05:56:15.512ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55047
20772024-11-22T05:56:15.512ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
20782024-11-22T05:56:15.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56981 req_id = ef2eafc0-84aa-477a-85ee-5aa3c5127d57 response_code = 200 uri = /network-bootstore-config
20792024-11-22T05:56:15.546ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
20802024-11-22T05:56:15.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55047 req_id = 2dc54607-bc9a-400a-b781-872560a65b81 response_code = 204 uri = /switch-ports
20812024-11-22T05:56:15.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55047 req_id = 924edc45-7b5c-4d92-a362-d73ebe63bd9e response_code = 200 uri = /network-bootstore-config
20822024-11-22T05:56:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6533 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 6f080083-ece3-4cfa-873c-e3275289c48b response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
20832024-11-22T05:56:40.904ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45532
20842024-11-22T05:56:40.904ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45532 req_id = c6d44620-9790-4898-8ba1-4f64ef550cfb response_code = 200 uri = /baseboard
20852024-11-22T05:56:45.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46155
20862024-11-22T05:56:45.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46155 req_id = ae058350-1213-41d8-89f9-7428b4fd6bd2 response_code = 200 uri = /v2p
20872024-11-22T05:56:45.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34378
20882024-11-22T05:56:45.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34378 req_id = 3b6311db-6035-4d13-b45f-11d4bf7beccc response_code = 200 uri = /vpc-routes
20892024-11-22T05:56:45.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45823
20902024-11-22T05:56:45.247ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
20912024-11-22T05:56:45.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45823 req_id = cedf6e5f-03da-4c94-946c-2e26fadd10b6 response_code = 200 uri = /artifacts
20922024-11-22T05:56:45.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59823
20932024-11-22T05:56:45.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59823 req_id = 41a9efac-2461-4c72-93f9-1fab66f62575 response_code = 200 uri = /vpc-routes
20942024-11-22T05:56:45.318ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
20952024-11-22T05:56:45.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34378 req_id = 6f34bcd9-91b1-460c-8676-5245e76405ec response_code = 204 uri = /eip-gateways
20962024-11-22T05:56:45.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34378 req_id = 8f87fadc-ceff-479d-8b93-c84b6a57d518 response_code = 204 uri = /vpc-routes
20972024-11-22T05:56:45.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65413
20982024-11-22T05:56:45.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65413 req_id = 848ede2b-307c-419e-a84c-1993e882c863 response_code = 200 uri = /vpc-routes
20992024-11-22T05:56:45.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21002024-11-22T05:56:45.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59823 req_id = b7665ef8-89e1-42ff-82c1-4d0e0e89a1cc response_code = 204 uri = /eip-gateways
21012024-11-22T05:56:45.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65253
21022024-11-22T05:56:45.393ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21032024-11-22T05:56:45.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21042024-11-22T05:56:45.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65253 req_id = fc09f867-1885-4f0c-9130-f8bf273d69c9 response_code = 204 uri = /switch-ports
21052024-11-22T05:56:45.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58959
21062024-11-22T05:56:45.498ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21072024-11-22T05:56:45.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65413 req_id = 19dc3121-cae2-46f3-aec2-8388cb1a17ea response_code = 204 uri = /eip-gateways
21082024-11-22T05:56:45.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59823 req_id = b1f7a49e-0f37-4ac4-98bf-7a3032d7f72b response_code = 204 uri = /vpc-routes
21092024-11-22T05:56:45.498ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
21102024-11-22T05:56:45.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65253 req_id = 6f1e4d9f-d4a2-4cf9-b1c5-4e27a754f3c5 response_code = 200 uri = /network-bootstore-config
21112024-11-22T05:56:45.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58959 req_id = af9d44ef-11aa-4509-85e8-961a84d29fe3 response_code = 200 uri = /artifacts
21122024-11-22T05:56:45.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64081
21132024-11-22T05:56:45.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64081 req_id = 7263d67f-c535-450d-9ac6-b0f8b1fc49e6 response_code = 200 uri = /v2p
21142024-11-22T05:56:45.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65413 req_id = 74b6cc48-4524-4703-841c-bd2cc5964d96 response_code = 204 uri = /vpc-routes
21152024-11-22T05:56:45.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60343
21162024-11-22T05:56:45.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
21172024-11-22T05:56:45.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60343 req_id = 871fb8d1-6754-45c7-8344-c6cd3365f483 response_code = 200 uri = /artifacts
21182024-11-22T05:56:45.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39385
21192024-11-22T05:56:45.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39385 req_id = bbcda260-da01-4544-8d0e-54bc1cc57fd6 response_code = 200 uri = /v2p
21202024-11-22T05:56:45.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41377
21212024-11-22T05:56:45.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21222024-11-22T05:56:45.758ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21232024-11-22T05:56:45.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41377 req_id = e1c0a58e-b2b6-46a6-86f1-e1809447ad9e response_code = 204 uri = /switch-ports
21242024-11-22T05:56:45.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41377 req_id = 8dbe04cb-bfef-4efa-93c5-739c2bb9b5d1 response_code = 200 uri = /network-bootstore-config
21252024-11-22T05:56:45.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47613
21262024-11-22T05:56:45.827ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21272024-11-22T05:56:45.861ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21282024-11-22T05:56:45.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84995 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47613 req_id = 4dd1a98b-2298-4c00-a911-37658bf1ae60 response_code = 204 uri = /switch-ports
21292024-11-22T05:56:45.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47613 req_id = 45cbf393-bef9-4b47-b254-a7be7db41f1b response_code = 200 uri = /network-bootstore-config
21302024-11-22T05:56:58.995ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6654 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 14fccd27-65c6-4eb2-836b-76156ada15a0 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
21312024-11-22T05:57:10.937ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59204
21322024-11-22T05:57:10.937ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59204 req_id = bd4a6ebb-27ad-4cc6-9a5c-4f6603c065db response_code = 200 uri = /baseboard
21332024-11-22T05:57:14.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47497
21342024-11-22T05:57:14.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47497 req_id = 1d6691df-d6d5-4d51-b4f8-01cd3c6d7536 response_code = 200 uri = /vpc-routes
21352024-11-22T05:57:15.051ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21362024-11-22T05:57:15.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47497 req_id = f4c4e6d4-efe3-45e5-8658-406899582ff2 response_code = 204 uri = /eip-gateways
21372024-11-22T05:57:15.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47497 req_id = d31e96bf-ad21-4930-8b93-5a63d2b83574 response_code = 204 uri = /vpc-routes
21382024-11-22T05:57:15.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42765
21392024-11-22T05:57:15.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42765 req_id = a36f8851-01e4-4695-9c87-1415eb33e013 response_code = 200 uri = /v2p
21402024-11-22T05:57:15.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55416
21412024-11-22T05:57:15.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55416 req_id = 2cf9c4dc-1d0b-4c24-91a1-a4f1508e1545 response_code = 200 uri = /vpc-routes
21422024-11-22T05:57:15.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38734
21432024-11-22T05:57:15.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21442024-11-22T05:57:15.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21452024-11-22T05:57:15.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114505 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38734 req_id = 16cf64e0-c964-43f2-b034-4e5b9c0fc18f response_code = 204 uri = /switch-ports
21462024-11-22T05:57:15.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51387
21472024-11-22T05:57:15.282ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21482024-11-22T05:57:15.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55416 req_id = e9d19a26-e4f8-4ea1-98bf-aedbbddded0b response_code = 204 uri = /eip-gateways
21492024-11-22T05:57:15.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38734 req_id = fba368bc-2435-46f2-a4d9-a0dc1312dab2 response_code = 200 uri = /network-bootstore-config
21502024-11-22T05:57:15.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51387 req_id = f1736e8a-ee03-4043-9046-b9a9d6d3fefe response_code = 200 uri = /v2p
21512024-11-22T05:57:15.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55416 req_id = 5f359ede-44ed-4697-8309-553cf863cff0 response_code = 204 uri = /vpc-routes
21522024-11-22T05:57:15.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52802
21532024-11-22T05:57:15.299ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21542024-11-22T05:57:15.338ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21552024-11-22T05:57:15.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94629 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52802 req_id = b297d4c6-f219-44fc-b02b-df4593a32dd3 response_code = 204 uri = /switch-ports
21562024-11-22T05:57:15.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65136
21572024-11-22T05:57:15.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56821
21582024-11-22T05:57:15.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52802 req_id = 0fb37c54-136f-4649-b903-d4679091f642 response_code = 200 uri = /network-bootstore-config
21592024-11-22T05:57:15.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56821 req_id = ba03e036-8321-4e8a-953d-bbc577552cbd response_code = 200 uri = /v2p
21602024-11-22T05:57:15.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65136 req_id = 1ffa847a-4a6a-48e6-aab1-0bfcb30b3404 response_code = 200 uri = /vpc-routes
21612024-11-22T05:57:15.435ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21622024-11-22T05:57:15.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65136 req_id = 5929df90-d9dc-4dc6-8260-21335280704b response_code = 204 uri = /eip-gateways
21632024-11-22T05:57:15.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65136 req_id = 1a4a53b7-760f-41cd-88b8-857b655e0219 response_code = 204 uri = /vpc-routes
21642024-11-22T05:57:15.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40572
21652024-11-22T05:57:15.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21662024-11-22T05:57:15.508ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21672024-11-22T05:57:15.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40572 req_id = 110f2d00-d9b6-445f-b3d0-ef7d15898009 response_code = 204 uri = /switch-ports
21682024-11-22T05:57:15.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40572 req_id = f1b867d7-4e3e-4730-be41-6be76d78135c response_code = 200 uri = /network-bootstore-config
21692024-11-22T05:57:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6894 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 43f61e23-17ac-4f63-9c46-843ccfa55fe2 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
21702024-11-22T05:57:40.971ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46556
21712024-11-22T05:57:40.972ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46556 req_id = bb80d997-b575-4c29-87a0-a846585252bb response_code = 200 uri = /baseboard
21722024-11-22T05:57:45.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57463
21732024-11-22T05:57:45.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57463 req_id = 30f66db4-41ed-4a06-812d-15f9601a8149 response_code = 200 uri = /v2p
21742024-11-22T05:57:45.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49397
21752024-11-22T05:57:45.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
21762024-11-22T05:57:45.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 439 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49397 req_id = 97233048-9af4-4960-a715-ec2a432955fa response_code = 200 uri = /artifacts
21772024-11-22T05:57:45.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44804
21782024-11-22T05:57:45.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44804 req_id = 5b409591-792e-4e7b-8b08-1008747c9174 response_code = 200 uri = /vpc-routes
21792024-11-22T05:57:45.326ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21802024-11-22T05:57:45.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44804 req_id = 820f0f08-2410-47c2-b4d3-cbb19d04b501 response_code = 204 uri = /eip-gateways
21812024-11-22T05:57:45.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44804 req_id = 4ec3864c-d723-46cd-85d3-fbd7dcb6a148 response_code = 204 uri = /vpc-routes
21822024-11-22T05:57:45.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61537
21832024-11-22T05:57:45.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
21842024-11-22T05:57:45.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61537 req_id = e3da5975-5836-4eb6-9ebf-faab444341c3 response_code = 200 uri = /artifacts
21852024-11-22T05:57:45.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43951
21862024-11-22T05:57:45.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43951 req_id = 3df53624-90dd-4b6a-be88-a01c3c0c055f response_code = 200 uri = /vpc-routes
21872024-11-22T05:57:45.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47889
21882024-11-22T05:57:45.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21892024-11-22T05:57:45.427ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
21902024-11-22T05:57:45.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47889 req_id = 777d7c18-49a7-4a1f-bec6-3807ee87a858 response_code = 204 uri = /switch-ports
21912024-11-22T05:57:45.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60962
21922024-11-22T05:57:45.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
21932024-11-22T05:57:45.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43951 req_id = 35c3df21-7929-4fd6-aa5c-4cabc50a2005 response_code = 204 uri = /eip-gateways
21942024-11-22T05:57:45.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
21952024-11-22T05:57:45.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47889 req_id = 9869a9ac-fb50-445b-be8b-696d0805bb87 response_code = 200 uri = /network-bootstore-config
21962024-11-22T05:57:45.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39926
21972024-11-22T05:57:45.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39926 req_id = 5158c883-37e6-4a55-b63b-946412a636af response_code = 200 uri = /v2p
21982024-11-22T05:57:45.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 696 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43951 req_id = d37907a8-4cf1-45c3-813a-4ccb627d5c8c response_code = 204 uri = /vpc-routes
21992024-11-22T05:57:45.528ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22002024-11-22T05:57:45.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39576
22012024-11-22T05:57:45.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22022024-11-22T05:57:45.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39576 req_id = dead0400-1da9-4e3a-904a-2e27d86abaee response_code = 200 uri = /artifacts
22032024-11-22T05:57:45.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42688
22042024-11-22T05:57:45.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42688 req_id = a19bf38b-5c39-4075-83db-4661de68921a response_code = 200 uri = /vpc-routes
22052024-11-22T05:57:45.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60962 req_id = 94945d73-4b12-485b-a27f-feaeb80d92df response_code = 204 uri = /switch-ports
22062024-11-22T05:57:45.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60962 req_id = f0008f1a-671f-4d93-ae0d-6fce8cac1b3d response_code = 200 uri = /network-bootstore-config
22072024-11-22T05:57:45.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22082024-11-22T05:57:45.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42688 req_id = 4d3d4346-2725-45cb-b8ec-e31d16ea63af response_code = 204 uri = /eip-gateways
22092024-11-22T05:57:45.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42688 req_id = 9f5dec77-d33a-4f37-beed-d5b6c94657ed response_code = 204 uri = /vpc-routes
22102024-11-22T05:57:45.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60299
22112024-11-22T05:57:45.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22122024-11-22T05:57:45.698ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22132024-11-22T05:57:45.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106558 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60299 req_id = 3403d696-5dad-4d5a-9e20-17b4dce8c442 response_code = 204 uri = /switch-ports
22142024-11-22T05:57:45.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64883
22152024-11-22T05:57:45.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60299 req_id = f3cff84a-e419-4776-8453-dc20651acbd8 response_code = 200 uri = /network-bootstore-config
22162024-11-22T05:57:45.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64883 req_id = dd3d0b06-b499-473a-8f96-b7429c6d6250 response_code = 200 uri = /v2p
22172024-11-22T05:57:58.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6982 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 9fd2e182-2f0a-4e46-b2b7-f99258afc2d6 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
22182024-11-22T05:58:11.003ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44924
22192024-11-22T05:58:11.004ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44924 req_id = b5db58c8-20ca-4b21-b6ff-aa6810d953f1 response_code = 200 uri = /baseboard
22202024-11-22T05:58:14.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35244
22212024-11-22T05:58:14.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35244 req_id = ca9c9f08-b4a2-4e36-843a-be6f7251c556 response_code = 200 uri = /vpc-routes
22222024-11-22T05:58:14.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22232024-11-22T05:58:14.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35244 req_id = 26f5c16f-f304-4bc6-a375-a0bf30a0a3db response_code = 204 uri = /eip-gateways
22242024-11-22T05:58:15.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56148
22252024-11-22T05:58:15.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56148 req_id = aedbc024-f413-4ecc-a4b6-827f8a1ae91b response_code = 200 uri = /v2p
22262024-11-22T05:58:15.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35244 req_id = edc66d64-797d-4dbc-83e2-9b41772a2121 response_code = 204 uri = /vpc-routes
22272024-11-22T05:58:15.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59548
22282024-11-22T05:58:15.065ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22292024-11-22T05:58:15.122ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22302024-11-22T05:58:15.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59548 req_id = 5300f184-8a4b-46fe-a14a-0b669ef08b11 response_code = 204 uri = /switch-ports
22312024-11-22T05:58:15.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59548 req_id = 1ad41290-c91e-4320-845e-5e56ad4e5265 response_code = 200 uri = /network-bootstore-config
22322024-11-22T05:58:15.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36613
22332024-11-22T05:58:15.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36613 req_id = be14cff0-78e7-4961-b16f-fee53c54ec4e response_code = 200 uri = /vpc-routes
22342024-11-22T05:58:15.251ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22352024-11-22T05:58:15.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36613 req_id = 3bbcb14a-d959-4fc0-99e3-d98e3926cda3 response_code = 204 uri = /eip-gateways
22362024-11-22T05:58:15.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36613 req_id = 5a75e84d-a7f0-4d16-a2d1-6c843f3132ed response_code = 204 uri = /vpc-routes
22372024-11-22T05:58:15.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64199
22382024-11-22T05:58:15.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64199 req_id = f996db61-cecc-4e33-bc8b-06adc720f6d8 response_code = 200 uri = /v2p
22392024-11-22T05:58:15.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36865
22402024-11-22T05:58:15.323ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22412024-11-22T05:58:15.362ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22422024-11-22T05:58:15.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93793 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36865 req_id = 66cd4d08-9418-4edb-9829-9edead4d5307 response_code = 204 uri = /switch-ports
22432024-11-22T05:58:15.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47764
22442024-11-22T05:58:15.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55914
22452024-11-22T05:58:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55914 req_id = 260c0333-0eac-4fb0-bc1e-35bdcf17e676 response_code = 200 uri = /v2p
22462024-11-22T05:58:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36865 req_id = 5693562d-4029-453d-b65f-e90de7e8fdcb response_code = 200 uri = /network-bootstore-config
22472024-11-22T05:58:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47764 req_id = cc0f2182-70ee-4343-b09b-98058c894247 response_code = 200 uri = /vpc-routes
22482024-11-22T05:58:15.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60178
22492024-11-22T05:58:15.438ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22502024-11-22T05:58:15.474ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22512024-11-22T05:58:15.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60178 req_id = ab20beaf-67c4-4fe7-872c-789e47b80986 response_code = 204 uri = /switch-ports
22522024-11-22T05:58:15.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60178 req_id = 8d571f7e-396d-413b-ab1c-cba468023d94 response_code = 200 uri = /network-bootstore-config
22532024-11-22T05:58:15.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22542024-11-22T05:58:15.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47764 req_id = c054b80c-1b1c-4a66-bacd-5601590b8a8a response_code = 204 uri = /eip-gateways
22552024-11-22T05:58:15.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47764 req_id = e18534bd-678f-4156-a030-a62ba8095b55 response_code = 204 uri = /vpc-routes
22562024-11-22T05:58:28.995ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6725 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = fd8089aa-67d3-4bec-8f1a-c21162e1b732 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
22572024-11-22T05:58:41.035ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61477
22582024-11-22T05:58:41.035ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61477 req_id = 33f90bc9-c449-43ec-bedc-361fc0e3e25a response_code = 200 uri = /baseboard
22592024-11-22T05:58:45.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51422
22602024-11-22T05:58:45.085ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22612024-11-22T05:58:45.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51422 req_id = 32bc7614-4c1f-4472-b022-1205f09b5b3f response_code = 200 uri = /artifacts
22622024-11-22T05:58:45.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63728
22632024-11-22T05:58:45.222ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63728 req_id = 940cac28-0ef7-4ace-b7bf-4f882e9956b2 response_code = 200 uri = /vpc-routes
22642024-11-22T05:58:45.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22652024-11-22T05:58:45.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63728 req_id = f575dd47-c24b-4a68-b406-e5eec7856d46 response_code = 204 uri = /eip-gateways
22662024-11-22T05:58:45.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44109
22672024-11-22T05:58:45.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44109 req_id = 5f1986b8-bba9-4f62-a09e-f0258bc9bb46 response_code = 200 uri = /v2p
22682024-11-22T05:58:45.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63728 req_id = 950745ec-0005-4793-ac7e-274cf170431e response_code = 204 uri = /vpc-routes
22692024-11-22T05:58:45.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54581
22702024-11-22T05:58:45.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
22712024-11-22T05:58:45.412ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
22722024-11-22T05:58:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100577 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54581 req_id = 6ad21f05-f352-489e-b39e-1c1ad317a597 response_code = 204 uri = /switch-ports
22732024-11-22T05:58:45.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53585
22742024-11-22T05:58:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53585 req_id = 6c0ba512-a966-4e4b-ad19-374fea45d4b1 response_code = 200 uri = /vpc-routes
22752024-11-22T05:58:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54581 req_id = a168f390-853b-42e0-be13-2887cddbc7da response_code = 200 uri = /network-bootstore-config
22762024-11-22T05:58:45.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63907
22772024-11-22T05:58:45.496ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22782024-11-22T05:58:45.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
22792024-11-22T05:58:45.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22802024-11-22T05:58:45.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22812024-11-22T05:58:45.496ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22822024-11-22T05:58:45.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22832024-11-22T05:58:45.497ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22842024-11-22T05:58:45.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63907 req_id = 6eac641c-6685-4f02-8900-6fd5ed4b205c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22852024-11-22T05:58:45.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50138
22862024-11-22T05:58:45.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50138 req_id = d7e77a6b-e188-4ff8-b18f-00226d5daf62 response_code = 200 uri = /vpc-routes
22872024-11-22T05:58:45.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48168
22882024-11-22T05:58:45.580ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22892024-11-22T05:58:45.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48168 req_id = f3165f7d-82e6-4032-a2e2-1fa8e26304a3 response_code = 200 uri = /artifacts
22902024-11-22T05:58:45.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50722
22912024-11-22T05:58:45.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22922024-11-22T05:58:45.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50722 req_id = f1b2bc58-2127-4b37-b317-68df3a6134a3 response_code = 200 uri = /artifacts
22932024-11-22T05:58:45.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22942024-11-22T05:58:45.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50138 req_id = 8e2bb89d-f217-40f1-99cf-45267a1f6292 response_code = 204 uri = /eip-gateways
22952024-11-22T05:58:45.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50138 req_id = d8065e3e-76f2-42ef-8db0-5de1b9f20c07 response_code = 204 uri = /vpc-routes
22962024-11-22T05:58:45.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
22972024-11-22T05:58:45.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53585 req_id = beca5a2e-07eb-47af-9ad2-3a6f7addc629 response_code = 204 uri = /eip-gateways
22982024-11-22T05:58:45.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53585 req_id = 8b796273-ccb0-4675-a8c5-24c5fd65fdf1 response_code = 204 uri = /vpc-routes
22992024-11-22T05:58:45.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36935
23002024-11-22T05:58:45.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36935 req_id = 55deb55d-ccaf-470d-b15d-7ffe927ba07a response_code = 200 uri = /v2p
23012024-11-22T05:58:45.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39988
23022024-11-22T05:58:45.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23032024-11-22T05:58:45.741ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23042024-11-22T05:58:45.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39988 req_id = d7ee8ace-6d9a-488e-89e3-374cc277033c response_code = 204 uri = /switch-ports
23052024-11-22T05:58:45.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41621
23062024-11-22T05:58:45.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44742
23072024-11-22T05:58:45.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39988 req_id = afc5d924-2b0b-431b-acf1-a431a0632107 response_code = 200 uri = /network-bootstore-config
23082024-11-22T05:58:45.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23092024-11-22T05:58:45.802ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23102024-11-22T05:58:45.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23112024-11-22T05:58:45.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23122024-11-22T05:58:45.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23132024-11-22T05:58:45.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23142024-11-22T05:58:45.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23152024-11-22T05:58:45.806ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23162024-11-22T05:58:45.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44742 req_id = 30bd706b-4760-44e7-aadb-7989c4d8c0d4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23172024-11-22T05:58:45.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36054
23182024-11-22T05:58:45.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36054 req_id = 6dc6adb4-580b-43a5-9259-02917a0d290c response_code = 200 uri = /v2p
23192024-11-22T05:58:45.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51132
23202024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23212024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
23222024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23232024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23242024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23252024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23262024-11-22T05:58:45.834ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23272024-11-22T05:58:45.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51132 req_id = 008a1300-b384-4a3b-bd91-e86b177b9501 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23282024-11-22T05:58:45.840ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23292024-11-22T05:58:45.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41621 req_id = 2309755b-c1aa-458b-9d6b-8b950e180e0f response_code = 204 uri = /switch-ports
23302024-11-22T05:58:45.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41621 req_id = c710fc39-eb85-44ce-86c2-2301bba96aa8 response_code = 200 uri = /network-bootstore-config
23312024-11-22T05:58:58.995ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6703 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = cdcbaad0-6344-424f-b9b1-49459b87ed4e response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
23322024-11-22T05:59:11.069ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47551
23332024-11-22T05:59:11.069ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47551 req_id = 20b493cf-31e2-470d-a1d0-ae0a2c1c2b63 response_code = 200 uri = /baseboard
23342024-11-22T05:59:14.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49038
23352024-11-22T05:59:14.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49038 req_id = 636e3470-ec78-42cf-ba0d-79028fa0c762 response_code = 200 uri = /vpc-routes
23362024-11-22T05:59:14.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
23372024-11-22T05:59:14.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49038 req_id = fdd7b89a-34aa-4ec2-98d4-d81dcdbbb014 response_code = 204 uri = /eip-gateways
23382024-11-22T05:59:15.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48505
23392024-11-22T05:59:15.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48505 req_id = 33560fb8-3fcf-455e-aea6-be82260ef0af response_code = 200 uri = /v2p
23402024-11-22T05:59:15.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 740 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49038 req_id = 450f81cd-6396-4cfc-929f-01a05e1e01b7 response_code = 204 uri = /vpc-routes
23412024-11-22T05:59:15.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50089
23422024-11-22T05:59:15.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50089 req_id = a5756dd7-2372-4f84-85f6-ec64b7df8291 response_code = 200 uri = /vpc-routes
23432024-11-22T05:59:15.234ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
23442024-11-22T05:59:15.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50089 req_id = 1052a1c5-384f-4cc5-a2c4-acb305caa728 response_code = 204 uri = /eip-gateways
23452024-11-22T05:59:15.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49696
23462024-11-22T05:59:15.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23472024-11-22T05:59:15.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23482024-11-22T05:59:15.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49696 req_id = fbc32af6-570a-46bd-bacb-056b5293c1cc response_code = 204 uri = /switch-ports
23492024-11-22T05:59:15.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46797
23502024-11-22T05:59:15.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49696 req_id = 4155b3d9-a6ae-4487-9e26-3011537a06a8 response_code = 200 uri = /network-bootstore-config
23512024-11-22T05:59:15.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50089 req_id = 38a41f23-9090-473b-869d-acd004f260ca response_code = 204 uri = /vpc-routes
23522024-11-22T05:59:15.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46797 req_id = 26952c90-0264-415a-8caa-353af7a85c0b response_code = 200 uri = /vpc-routes
23532024-11-22T05:59:15.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62146
23542024-11-22T05:59:15.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62146 req_id = cc6ef7db-3ff7-4cb0-b2de-c23f99b6d140 response_code = 200 uri = /v2p
23552024-11-22T05:59:15.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57513
23562024-11-22T05:59:15.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23572024-11-22T05:59:15.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23582024-11-22T05:59:15.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95520 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57513 req_id = e5b71e74-bee6-4f1f-9114-be7c9c6df985 response_code = 204 uri = /switch-ports
23592024-11-22T05:59:15.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43688
23602024-11-22T05:59:15.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
23612024-11-22T05:59:15.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46797 req_id = d97cefcd-3203-4840-8a4f-404729d29d0f response_code = 204 uri = /eip-gateways
23622024-11-22T05:59:15.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59347
23632024-11-22T05:59:15.470ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23642024-11-22T05:59:15.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 353 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57513 req_id = b66f4d71-00aa-4c6d-a01e-c03192c3190e response_code = 200 uri = /network-bootstore-config
23652024-11-22T05:59:15.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3638 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59347 req_id = e869dbb2-6992-47ba-bb6a-40180748653c response_code = 200 uri = /v2p
23662024-11-22T05:59:15.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46797 req_id = 317d5f79-2e27-416e-a601-182ae8eb6011 response_code = 204 uri = /vpc-routes
23672024-11-22T05:59:15.504ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23682024-11-22T05:59:15.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87358 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43688 req_id = 11cd01be-6a6e-493f-984b-4684cedb3712 response_code = 204 uri = /switch-ports
23692024-11-22T05:59:15.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43688 req_id = ce3dce5f-f9e0-4f9b-9f15-82ad9bc625b1 response_code = 200 uri = /network-bootstore-config
23702024-11-22T05:59:28.995ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6633 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 8fdfaaf6-2707-4dab-9664-b4a5bce8b449 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
23712024-11-22T05:59:41.103ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53034
23722024-11-22T05:59:41.103ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53034 req_id = 9084b0e1-882b-4bff-a216-766171ff8be2 response_code = 200 uri = /baseboard
23732024-11-22T05:59:45.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56558
23742024-11-22T05:59:45.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56558 req_id = e01dd2ee-6c5a-4a76-8bb0-5218c67587ed response_code = 200 uri = /vpc-routes
23752024-11-22T05:59:45.316ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
23762024-11-22T05:59:45.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56558 req_id = 97899a4b-ad65-4525-938c-7f362c8fe1ef response_code = 204 uri = /eip-gateways
23772024-11-22T05:59:45.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60112
23782024-11-22T05:59:45.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60112 req_id = 1ed29e53-2e81-4011-8dab-4fb46a45ee7d response_code = 200 uri = /vpc-routes
23792024-11-22T05:59:45.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61871
23802024-11-22T05:59:45.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23812024-11-22T05:59:45.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 460 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61871 req_id = 7f2b64b8-21fa-4b85-a1e1-e346cbaa76bf response_code = 200 uri = /artifacts
23822024-11-22T05:59:45.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33979
23832024-11-22T05:59:45.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33979 req_id = b8117938-6369-4e2c-b34b-50c5057a46c8 response_code = 200 uri = /vpc-routes
23842024-11-22T05:59:45.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
23852024-11-22T05:59:45.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60112 req_id = a83778b9-9b67-4fd5-8b2a-721c175e59e2 response_code = 204 uri = /eip-gateways
23862024-11-22T05:59:45.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
23872024-11-22T05:59:45.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33979 req_id = 454d34cc-434d-484b-9ddd-902972794446 response_code = 204 uri = /eip-gateways
23882024-11-22T05:59:45.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60112 req_id = fb8e9996-cfde-48e0-bc86-ba5454c61025 response_code = 204 uri = /vpc-routes
23892024-11-22T05:59:45.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33979 req_id = d41a0818-5ade-41fe-a50d-b7d3bcab2767 response_code = 204 uri = /vpc-routes
23902024-11-22T05:59:45.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63574
23912024-11-22T05:59:45.452ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
23922024-11-22T05:59:45.496ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
23932024-11-22T05:59:45.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63574 req_id = 9e6cd80c-9691-4132-a934-a3d01701fdda response_code = 204 uri = /switch-ports
23942024-11-22T05:59:45.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38877
23952024-11-22T05:59:45.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56276
23962024-11-22T05:59:45.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23972024-11-22T05:59:45.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63574 req_id = cd0c13af-3df4-42f1-a2a9-c1baa18d891b response_code = 200 uri = /network-bootstore-config
23982024-11-22T05:59:45.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38877 req_id = 019ddaaf-3e99-45e1-9f84-8b801929ba3d response_code = 200 uri = /artifacts
23992024-11-22T05:59:45.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56276 req_id = 813ab319-b5ce-438e-b7f5-278c6770334d response_code = 200 uri = /v2p
24002024-11-22T05:59:45.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56558 req_id = bdce74c7-d899-43f2-beac-20d2c206e5c2 response_code = 204 uri = /vpc-routes
24012024-11-22T05:59:45.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48476
24022024-11-22T05:59:45.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24032024-11-22T05:59:45.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48476 req_id = d95b793e-b117-4247-97a0-6e01aeca8971 response_code = 200 uri = /artifacts
24042024-11-22T05:59:45.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58205
24052024-11-22T05:59:45.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58205 req_id = b82ce193-3bd5-46d8-bff5-46c7480e8046 response_code = 200 uri = /v2p
24062024-11-22T05:59:45.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58218
24072024-11-22T05:59:45.600ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24082024-11-22T05:59:45.636ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24092024-11-22T05:59:45.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58218 req_id = 80b992a4-4d47-4f78-ac88-056816530fcb response_code = 204 uri = /switch-ports
24102024-11-22T05:59:45.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48551
24112024-11-22T05:59:45.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48551 req_id = fe5bb124-72ed-4eee-8069-c699c00593d7 response_code = 200 uri = /v2p
24122024-11-22T05:59:45.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58218 req_id = c6ed589b-8c7d-4730-bded-46487ccdb235 response_code = 200 uri = /network-bootstore-config
24132024-11-22T05:59:45.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64196
24142024-11-22T05:59:45.737ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24152024-11-22T05:59:45.773ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24162024-11-22T05:59:45.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94038 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64196 req_id = fd0e3514-53a6-492b-b81f-71de21db8d3f response_code = 204 uri = /switch-ports
24172024-11-22T05:59:45.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64196 req_id = 93f52ab2-af91-4ec5-80a1-0ad4afeb54ad response_code = 200 uri = /network-bootstore-config
24182024-11-22T05:59:58.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6885 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 30619e40-0302-43a0-a968-13c507de8bcb response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
24192024-11-22T06:00:11.122ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24202024-11-22T06:00:11.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24212024-11-22T06:00:11.137ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45186
24222024-11-22T06:00:11.137ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45186 req_id = 1a3cd16b-e6a1-43fd-8e23-b398dc38f798 response_code = 200 uri = /baseboard
24232024-11-22T06:00:11.151ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1954, tv_nsec: 354778200 } time_to_next_cleanup = 599.99999556s
24242024-11-22T06:00:14.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54419
24252024-11-22T06:00:14.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54419 req_id = ffbd853a-f1e5-4d1d-9d16-43cbf1ec6547 response_code = 200 uri = /vpc-routes
24262024-11-22T06:00:14.970ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
24272024-11-22T06:00:14.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54419 req_id = d7fe1db2-063d-4cfd-b76d-3333cb5fd7d7 response_code = 204 uri = /eip-gateways
24282024-11-22T06:00:15.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61236
24292024-11-22T06:00:15.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61236 req_id = 4dfa5f30-f20f-41ff-bb28-796186c84aab response_code = 200 uri = /v2p
24302024-11-22T06:00:15.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54419 req_id = d331585a-db2e-4d60-8b44-e6656e80afd3 response_code = 204 uri = /vpc-routes
24312024-11-22T06:00:15.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60065
24322024-11-22T06:00:15.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24332024-11-22T06:00:15.113ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24342024-11-22T06:00:15.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60065 req_id = c88dc376-b1c4-4736-9da4-68b3d97ab484 response_code = 204 uri = /switch-ports
24352024-11-22T06:00:15.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51179
24362024-11-22T06:00:15.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60065 req_id = e2c4d896-4fdd-4163-903b-abd575912fad response_code = 200 uri = /network-bootstore-config
24372024-11-22T06:00:15.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51179 req_id = 30c47953-63cf-405b-b682-2ad123046571 response_code = 200 uri = /v2p
24382024-11-22T06:00:15.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55113
24392024-11-22T06:00:15.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55113 req_id = 9bf39ca5-7a78-4281-a4d8-f114acc13ce6 response_code = 200 uri = /vpc-routes
24402024-11-22T06:00:15.225ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
24412024-11-22T06:00:15.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55113 req_id = 3cc1917f-f8f6-456b-b834-77ee5177d5b4 response_code = 204 uri = /eip-gateways
24422024-11-22T06:00:15.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55113 req_id = 65ce77de-c806-424e-9d76-c79e30461245 response_code = 204 uri = /vpc-routes
24432024-11-22T06:00:15.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56037
24442024-11-22T06:00:15.282ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24452024-11-22T06:00:15.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24462024-11-22T06:00:15.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56037 req_id = c8205fc5-e235-4730-ba0f-a60745270ff2 response_code = 204 uri = /switch-ports
24472024-11-22T06:00:15.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53238
24482024-11-22T06:00:15.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53238 req_id = f516da63-ac63-48b8-a1b4-3161145e4165 response_code = 200 uri = /vpc-routes
24492024-11-22T06:00:15.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56037 req_id = 95fbcf8f-0901-42b4-8bb0-ce86fae880ac response_code = 200 uri = /network-bootstore-config
24502024-11-22T06:00:15.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38691
24512024-11-22T06:00:15.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38691 req_id = dcb4659b-6af5-45f4-9790-1745fefce8f7 response_code = 200 uri = /v2p
24522024-11-22T06:00:15.418ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
24532024-11-22T06:00:15.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53238 req_id = d433ee62-d2ef-43f3-ab72-bb2485f5cfc8 response_code = 204 uri = /eip-gateways
24542024-11-22T06:00:15.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34971
24552024-11-22T06:00:15.423ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24562024-11-22T06:00:15.461ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24572024-11-22T06:00:15.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34971 req_id = 1ab1dab3-e564-4da1-80de-7c3b889a31d4 response_code = 204 uri = /switch-ports
24582024-11-22T06:00:15.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34971 req_id = 00529f09-8abf-401a-8864-ccbafa4eafdd response_code = 200 uri = /network-bootstore-config
24592024-11-22T06:00:15.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53238 req_id = 8376ee44-6ab6-4e55-a629-61d045d70d70 response_code = 204 uri = /vpc-routes
24602024-11-22T06:00:25.337ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24612024-11-22T06:00:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7103 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = f3a4a982-df15-46a0-95fa-21ed73fe459d response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
24622024-11-22T06:00:41.169ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61810
24632024-11-22T06:00:41.169ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61810 req_id = 1013bd39-33f5-4841-ab31-340221b12043 response_code = 200 uri = /baseboard
24642024-11-22T06:00:45.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46949
24652024-11-22T06:00:45.185ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24662024-11-22T06:00:45.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46949 req_id = 92b4d6a7-1207-4a36-ad97-bb4106275cdd response_code = 200 uri = /artifacts
24672024-11-22T06:00:45.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45668
24682024-11-22T06:00:45.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45668 req_id = 412f4cb5-8f35-44e1-8fcf-a748c50af61b response_code = 200 uri = /vpc-routes
24692024-11-22T06:00:45.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37651
24702024-11-22T06:00:45.264ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24712024-11-22T06:00:45.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37651 req_id = 0d06ccb9-9014-4441-bbd9-aef8b79b1c72 response_code = 200 uri = /artifacts
24722024-11-22T06:00:45.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39370
24732024-11-22T06:00:45.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24742024-11-22T06:00:45.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39370 req_id = 55c89127-4d6f-46b4-be0d-dfee0976555e response_code = 200 uri = /artifacts
24752024-11-22T06:00:45.333ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
24762024-11-22T06:00:45.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45668 req_id = 88dd3ba2-d928-4d18-a6e5-d3064f193f59 response_code = 204 uri = /eip-gateways
24772024-11-22T06:00:45.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45668 req_id = 3662c603-1595-4813-ad94-0fc33c815d0e response_code = 204 uri = /vpc-routes
24782024-11-22T06:00:45.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41560
24792024-11-22T06:00:45.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41560 req_id = 84b048f1-bf61-4749-b996-02ef99d5c781 response_code = 200 uri = /vpc-routes
24802024-11-22T06:00:45.379ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
24812024-11-22T06:00:45.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41560 req_id = 68128792-e086-4074-a8a7-c3c263ab2aa0 response_code = 204 uri = /eip-gateways
24822024-11-22T06:00:45.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41560 req_id = 0565e439-6120-4649-a4bc-444182b3598a response_code = 204 uri = /vpc-routes
24832024-11-22T06:00:45.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44290
24842024-11-22T06:00:45.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44290 req_id = 302be686-b2d3-42c2-959b-7c0dfa1ff89f response_code = 200 uri = /v2p
24852024-11-22T06:00:45.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48355
24862024-11-22T06:00:45.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48355 req_id = baedaff4-75b1-4ece-b5bc-72ad9a79056f response_code = 200 uri = /vpc-routes
24872024-11-22T06:00:45.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46448
24882024-11-22T06:00:45.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24892024-11-22T06:00:45.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
24902024-11-22T06:00:45.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99699 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46448 req_id = 17e8136a-6f74-4f9e-8856-98779accac73 response_code = 204 uri = /switch-ports
24912024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35060
24922024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43510
24932024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48256
24942024-11-22T06:00:45.582ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
24952024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48355 req_id = 3aa18c5d-0756-4e79-851f-14d13d870f0d response_code = 204 uri = /eip-gateways
24962024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46448 req_id = 4a7679b2-c9ef-4933-8f10-3ff5ba2a0296 response_code = 200 uri = /network-bootstore-config
24972024-11-22T06:00:45.582ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
24982024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48256 req_id = 820b59d8-5534-43aa-97cc-3448043d9203 response_code = 200 uri = /v2p
24992024-11-22T06:00:45.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43510 req_id = 521c1b75-2fee-4d77-b3db-5af55501c6b5 response_code = 200 uri = /v2p
25002024-11-22T06:00:45.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48355 req_id = c957c000-4cfd-4301-88b6-403ab88b17df response_code = 204 uri = /vpc-routes
25012024-11-22T06:00:45.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59609
25022024-11-22T06:00:45.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25032024-11-22T06:00:45.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25042024-11-22T06:00:45.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35060 req_id = d1020a5c-69e7-4861-a365-475ca5368392 response_code = 204 uri = /switch-ports
25052024-11-22T06:00:45.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 674 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35060 req_id = 4e056166-eebc-4e2c-82f9-cc6690edabca response_code = 200 uri = /network-bootstore-config
25062024-11-22T06:00:45.712ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25072024-11-22T06:00:45.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59609 req_id = fb212676-3862-48c6-9ff3-84bc6fa71e4c response_code = 204 uri = /switch-ports
25082024-11-22T06:00:45.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59609 req_id = c02f7058-947c-439d-a8f4-f1f59b59e625 response_code = 200 uri = /network-bootstore-config
25092024-11-22T06:00:58.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6611 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 9595b939-0aa0-4eba-a53f-2821fafcd438 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
25102024-11-22T06:01:11.203ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45513
25112024-11-22T06:01:11.203ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45513 req_id = 34c9c6d0-1ea8-4b89-bb06-d01f2c2a3ba0 response_code = 200 uri = /baseboard
25122024-11-22T06:01:14.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37214
25132024-11-22T06:01:14.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37214 req_id = 7451b7f6-94de-4602-a555-574b98e00088 response_code = 200 uri = /vpc-routes
25142024-11-22T06:01:15.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
25152024-11-22T06:01:15.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37214 req_id = 2448d71b-4815-47ad-9294-7d8cccb8ad84 response_code = 204 uri = /eip-gateways
25162024-11-22T06:01:15.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37214 req_id = b1403498-c4e3-4835-982c-5661bc62aa03 response_code = 204 uri = /vpc-routes
25172024-11-22T06:01:15.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40900
25182024-11-22T06:01:15.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40900 req_id = 329ba830-d563-447c-9b8e-a03a445f670a response_code = 200 uri = /v2p
25192024-11-22T06:01:15.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60822
25202024-11-22T06:01:15.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25212024-11-22T06:01:15.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25222024-11-22T06:01:15.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60822 req_id = 98c82edf-7aea-4f46-be59-ab3462329036 response_code = 204 uri = /switch-ports
25232024-11-22T06:01:15.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36350
25242024-11-22T06:01:15.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5627 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60822 req_id = c39a979d-aa8d-4346-83d6-b8598d3c819f response_code = 200 uri = /network-bootstore-config
25252024-11-22T06:01:15.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36350 req_id = 30a4c1ac-3991-4790-b688-da0f99e5109e response_code = 200 uri = /vpc-routes
25262024-11-22T06:01:15.341ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
25272024-11-22T06:01:15.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36350 req_id = a0677d2d-33a6-4a50-999d-75d86b2b9d48 response_code = 204 uri = /eip-gateways
25282024-11-22T06:01:15.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54704
25292024-11-22T06:01:15.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54704 req_id = f153e280-8f79-483f-9b02-c4280d76db04 response_code = 200 uri = /v2p
25302024-11-22T06:01:15.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36350 req_id = ba9769dc-74e3-4ddc-b763-c38d20670309 response_code = 204 uri = /vpc-routes
25312024-11-22T06:01:15.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34668
25322024-11-22T06:01:15.398ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25332024-11-22T06:01:15.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25342024-11-22T06:01:15.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92600 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34668 req_id = 5e0d6200-bdcf-4729-94ed-c04e5271286b response_code = 204 uri = /switch-ports
25352024-11-22T06:01:15.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62481
25362024-11-22T06:01:15.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34668 req_id = 5bc05358-6caf-4d9b-a8cf-0f3433053a08 response_code = 200 uri = /network-bootstore-config
25372024-11-22T06:01:15.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62481 req_id = 0f27b9f9-a549-4772-ab57-cbcfe4d54e91 response_code = 200 uri = /vpc-routes
25382024-11-22T06:01:15.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64769
25392024-11-22T06:01:15.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64769 req_id = b8cf8004-34a0-47af-93dc-1c5fd519947c response_code = 200 uri = /v2p
25402024-11-22T06:01:15.541ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
25412024-11-22T06:01:15.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62481 req_id = 7d4a8f3d-7761-4e6f-9b21-07fc66ef3007 response_code = 204 uri = /eip-gateways
25422024-11-22T06:01:15.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62481 req_id = 6ac42b5f-1206-46f0-9006-b6a6f28bb107 response_code = 204 uri = /vpc-routes
25432024-11-22T06:01:15.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51047
25442024-11-22T06:01:15.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25452024-11-22T06:01:15.591ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25462024-11-22T06:01:15.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51047 req_id = 9d0a8890-3117-4d28-949c-384a01bc78cc response_code = 204 uri = /switch-ports
25472024-11-22T06:01:15.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51047 req_id = d01b1077-ab16-4899-8266-3de704d3ac41 response_code = 200 uri = /network-bootstore-config
25482024-11-22T06:01:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7324 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = e04dcf1a-dc9b-4946-930b-f6285eddd2fa response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
25492024-11-22T06:01:41.236ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39331
25502024-11-22T06:01:41.236ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39331 req_id = 2d9ef47d-a7bd-4fe4-904c-1c0a88e379cc response_code = 200 uri = /baseboard
25512024-11-22T06:01:44.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53906
25522024-11-22T06:01:44.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53906 req_id = 5f4ac01e-29f8-40db-b1db-c7275bae3480 response_code = 200 uri = /vpc-routes
25532024-11-22T06:01:45.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
25542024-11-22T06:01:45.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53906 req_id = d31f1b2d-8a3d-47c6-abce-f6b4a9fde783 response_code = 204 uri = /eip-gateways
25552024-11-22T06:01:45.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53906 req_id = 0f2d8eb2-21ba-41f5-9a2e-d46a481016c3 response_code = 204 uri = /vpc-routes
25562024-11-22T06:01:45.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59379
25572024-11-22T06:01:45.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59379 req_id = 583cd4f4-9b39-490d-b876-8c6238bd385f response_code = 200 uri = /v2p
25582024-11-22T06:01:45.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55693
25592024-11-22T06:01:45.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55693 req_id = 864db25d-5cc4-4880-99a6-12c6a7907300 response_code = 200 uri = /vpc-routes
25602024-11-22T06:01:45.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59185
25612024-11-22T06:01:45.414ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25622024-11-22T06:01:45.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59185 req_id = 5a32a56f-b54b-48d9-9220-8c5aab549009 response_code = 200 uri = /artifacts
25632024-11-22T06:01:45.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56332
25642024-11-22T06:01:45.431ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25652024-11-22T06:01:45.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56332 req_id = 9cde29a3-9bae-45ed-8dab-c382f92599eb response_code = 200 uri = /artifacts
25662024-11-22T06:01:45.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37775
25672024-11-22T06:01:45.441ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25682024-11-22T06:01:45.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37775 req_id = 0c63c23c-a4a3-4072-8dde-655277e8892e response_code = 200 uri = /artifacts
25692024-11-22T06:01:45.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61906
25702024-11-22T06:01:45.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61906 req_id = 70bde3ce-3bb9-4d9e-9d6a-881645ac6b59 response_code = 200 uri = /vpc-routes
25712024-11-22T06:01:45.497ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
25722024-11-22T06:01:45.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55693 req_id = a85392cd-b218-4d7f-9879-4733c63de465 response_code = 204 uri = /eip-gateways
25732024-11-22T06:01:45.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55693 req_id = 0f10915a-3efe-42dd-82e7-ae5c7a23270b response_code = 204 uri = /vpc-routes
25742024-11-22T06:01:45.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
25752024-11-22T06:01:45.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61906 req_id = d988c6c7-c34e-4f4c-a0dd-930179137890 response_code = 204 uri = /eip-gateways
25762024-11-22T06:01:45.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61906 req_id = 52bcd95a-dd25-40e6-a0f7-4f2e307176ff response_code = 204 uri = /vpc-routes
25772024-11-22T06:01:45.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44354
25782024-11-22T06:01:45.557ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25792024-11-22T06:01:45.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25802024-11-22T06:01:45.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44354 req_id = 00845a5b-17d8-42c0-a345-58a235c7ec18 response_code = 204 uri = /switch-ports
25812024-11-22T06:01:45.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64932
25822024-11-22T06:01:45.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61825
25832024-11-22T06:01:45.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60808
25842024-11-22T06:01:45.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44354 req_id = 20a3510f-c4b1-4b75-a50d-560a8ee9a8e9 response_code = 200 uri = /network-bootstore-config
25852024-11-22T06:01:45.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25862024-11-22T06:01:45.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4844 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61825 req_id = 5c99b5c8-62af-4c89-8934-989568d6e79c response_code = 200 uri = /v2p
25872024-11-22T06:01:45.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54270
25882024-11-22T06:01:45.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54270 req_id = 51f9be4b-dd2e-452c-96d2-d985683cbbfa response_code = 200 uri = /v2p
25892024-11-22T06:01:45.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25902024-11-22T06:01:45.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
25912024-11-22T06:01:45.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60808 req_id = c51c066a-3780-48d6-8a03-d916565d37d1 response_code = 204 uri = /switch-ports
25922024-11-22T06:01:45.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 770 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60808 req_id = 666988cf-3b2a-4568-95bb-18277e18bfcb response_code = 200 uri = /network-bootstore-config
25932024-11-22T06:01:45.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
25942024-11-22T06:01:45.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64932 req_id = 0a6940d0-9ae2-4c90-8f5d-36e671c42f09 response_code = 204 uri = /switch-ports
25952024-11-22T06:01:45.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64932 req_id = 4e7c9e76-263b-4ea7-bc21-c22bca7afc0b response_code = 200 uri = /network-bootstore-config
25962024-11-22T06:01:58.997ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7452 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 475f9fb2-24aa-4fa0-bb78-47f7ce63d92d response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
25972024-11-22T06:02:11.269ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41102
25982024-11-22T06:02:11.269ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41102 req_id = 12ade5a3-56b1-4d83-b141-47b8f9d861d3 response_code = 200 uri = /baseboard
25992024-11-22T06:02:14.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37913
26002024-11-22T06:02:14.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37913 req_id = ec76018f-e131-4ac2-be43-0a001020a1df response_code = 200 uri = /vpc-routes
26012024-11-22T06:02:14.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26022024-11-22T06:02:14.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37913 req_id = bedf3557-0ef7-4a2a-9de2-4af579b3e888 response_code = 204 uri = /eip-gateways
26032024-11-22T06:02:14.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37913 req_id = 9a902a98-650a-4ced-84ea-3393af161e10 response_code = 204 uri = /vpc-routes
26042024-11-22T06:02:15.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42264
26052024-11-22T06:02:15.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42264 req_id = 6a3934bd-83a5-4c0e-90d8-d172ffca2c2f response_code = 200 uri = /vpc-routes
26062024-11-22T06:02:15.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33961
26072024-11-22T06:02:15.131ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26082024-11-22T06:02:15.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26092024-11-22T06:02:15.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33961 req_id = 6f8558e8-c2aa-4436-ada4-29dd5308856a response_code = 204 uri = /switch-ports
26102024-11-22T06:02:15.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46008
26112024-11-22T06:02:15.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26122024-11-22T06:02:15.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42264 req_id = f02a0631-b2e7-4969-ae06-98973ded9b3e response_code = 204 uri = /eip-gateways
26132024-11-22T06:02:15.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33961 req_id = c336da46-af83-4f5c-aebb-481e367c0064 response_code = 200 uri = /network-bootstore-config
26142024-11-22T06:02:15.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46008 req_id = 08cad860-6da0-46ec-85cc-1e6496be7616 response_code = 200 uri = /v2p
26152024-11-22T06:02:15.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42264 req_id = fdcf8659-f1ad-436f-ac69-18e51e7fc361 response_code = 204 uri = /vpc-routes
26162024-11-22T06:02:15.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53174
26172024-11-22T06:02:15.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53174 req_id = bd3ad792-1e42-4035-be08-8e226e966dfb response_code = 200 uri = /vpc-routes
26182024-11-22T06:02:15.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47095
26192024-11-22T06:02:15.352ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26202024-11-22T06:02:15.393ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26212024-11-22T06:02:15.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47095 req_id = 2244cfae-e568-4406-8fc3-3a7a16ed9ea9 response_code = 204 uri = /switch-ports
26222024-11-22T06:02:15.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41773
26232024-11-22T06:02:15.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39036
26242024-11-22T06:02:15.453ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26252024-11-22T06:02:15.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53174 req_id = 60d14600-0fe1-4f60-9372-70d3ad9e4c71 response_code = 204 uri = /eip-gateways
26262024-11-22T06:02:15.453ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26272024-11-22T06:02:15.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47095 req_id = 13b6906d-507f-4a07-b28d-64e0ce5221e7 response_code = 200 uri = /network-bootstore-config
26282024-11-22T06:02:15.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3895 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39036 req_id = cd6aba8a-ce3e-4dec-8a2b-3b1a1ab3f9b4 response_code = 200 uri = /v2p
26292024-11-22T06:02:15.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62957
26302024-11-22T06:02:15.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62957 req_id = 74d7bc32-0dad-49ef-bdb3-c6e6ca36785f response_code = 200 uri = /v2p
26312024-11-22T06:02:15.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53174 req_id = 4c835eaf-5d7f-4d2b-ac1c-100b25b84854 response_code = 204 uri = /vpc-routes
26322024-11-22T06:02:15.490ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26332024-11-22T06:02:15.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90536 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41773 req_id = 13e53855-2db3-468e-a27c-cebc5926cee6 response_code = 204 uri = /switch-ports
26342024-11-22T06:02:15.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41773 req_id = 4a00467e-f89f-4bcc-90d7-d88f76f43960 response_code = 200 uri = /network-bootstore-config
26352024-11-22T06:02:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6860 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 1b7d4c3a-010e-444a-94a3-80ed9afd3783 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
26362024-11-22T06:02:41.302ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49070
26372024-11-22T06:02:41.303ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49070 req_id = 40892310-274c-46d5-9d94-5ff4de27cc26 response_code = 200 uri = /baseboard
26382024-11-22T06:02:45.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61357
26392024-11-22T06:02:45.028ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26402024-11-22T06:02:45.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 501 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61357 req_id = a0adb1b2-cf1d-462a-8566-c090863ea175 response_code = 200 uri = /artifacts
26412024-11-22T06:02:45.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41299
26422024-11-22T06:02:45.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41299 req_id = 3c7b0c0a-4af1-44d2-bc89-214b4af7f351 response_code = 200 uri = /vpc-routes
26432024-11-22T06:02:45.208ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26442024-11-22T06:02:45.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41299 req_id = 54dbfc98-5abd-485b-b573-b0d65149b879 response_code = 204 uri = /eip-gateways
26452024-11-22T06:02:45.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41299 req_id = 7d2870ad-4c6c-4b92-970b-937c8c591307 response_code = 204 uri = /vpc-routes
26462024-11-22T06:02:45.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35704
26472024-11-22T06:02:45.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35704 req_id = beac34d0-607c-46b3-a295-5bf97ad1951b response_code = 200 uri = /v2p
26482024-11-22T06:02:45.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54197
26492024-11-22T06:02:45.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54197 req_id = bb666080-0017-49eb-81c8-3dcea3e0d897 response_code = 200 uri = /vpc-routes
26502024-11-22T06:02:45.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62988
26512024-11-22T06:02:45.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26522024-11-22T06:02:45.444ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26532024-11-22T06:02:45.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62988 req_id = ea84456b-4830-4797-a9bd-91eea1e627ab response_code = 204 uri = /switch-ports
26542024-11-22T06:02:45.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63085
26552024-11-22T06:02:45.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64022
26562024-11-22T06:02:45.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53515
26572024-11-22T06:02:45.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26582024-11-22T06:02:45.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26592024-11-22T06:02:45.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62988 req_id = 397f9ac0-efe8-41c8-8058-7c2382c51246 response_code = 200 uri = /network-bootstore-config
26602024-11-22T06:02:45.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63085 req_id = 02de39aa-e6b0-415c-8805-b5b06aebe37f response_code = 200 uri = /vpc-routes
26612024-11-22T06:02:45.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 528 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64022 req_id = ad5ba34d-b71c-4227-b837-5e4c942ebbb8 response_code = 200 uri = /artifacts
26622024-11-22T06:02:45.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53515 req_id = d6b84f52-c4e1-42d7-a0df-cd2dd022708b response_code = 200 uri = /artifacts
26632024-11-22T06:02:45.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26642024-11-22T06:02:45.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63085 req_id = f4619274-fe50-482e-80c3-64455b67fbd5 response_code = 204 uri = /eip-gateways
26652024-11-22T06:02:45.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33071
26662024-11-22T06:02:45.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33071 req_id = 54eb8768-17db-4163-9c2f-0b385d18cf3a response_code = 200 uri = /v2p
26672024-11-22T06:02:45.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63085 req_id = ced5008f-b777-4c3f-8a40-f01d603c805d response_code = 204 uri = /vpc-routes
26682024-11-22T06:02:45.530ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26692024-11-22T06:02:45.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54197 req_id = 025c3c9d-3828-4f79-9168-7b096b2ab875 response_code = 204 uri = /eip-gateways
26702024-11-22T06:02:45.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54197 req_id = 0d464f61-c0fe-4db8-b215-4c2a3ff5a7db response_code = 204 uri = /vpc-routes
26712024-11-22T06:02:45.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49170
26722024-11-22T06:02:45.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49170 req_id = 998b9f53-bea8-4a75-acd9-b23130f3eae3 response_code = 200 uri = /v2p
26732024-11-22T06:02:45.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64976
26742024-11-22T06:02:45.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26752024-11-22T06:02:45.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26762024-11-22T06:02:45.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64976 req_id = affb5604-ecbd-42b0-af5b-e2c38af2df92 response_code = 204 uri = /switch-ports
26772024-11-22T06:02:45.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44909
26782024-11-22T06:02:45.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64976 req_id = d787b1cb-bb83-4873-9ed9-b285daed045f response_code = 200 uri = /network-bootstore-config
26792024-11-22T06:02:45.657ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26802024-11-22T06:02:45.694ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26812024-11-22T06:02:45.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89709 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44909 req_id = 95d030fa-324d-4cae-8c59-e1e5262840c1 response_code = 204 uri = /switch-ports
26822024-11-22T06:02:45.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44909 req_id = a8451951-4e82-4c7b-bdeb-00b030a76f58 response_code = 200 uri = /network-bootstore-config
26832024-11-22T06:02:58.997ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8046 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = e9c8f240-c8c7-4a9c-b696-8a51b12e3d62 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
26842024-11-22T06:03:11.334ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44569
26852024-11-22T06:03:11.334ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44569 req_id = 0657e3fd-f211-4f43-9fb9-d539dc72def1 response_code = 200 uri = /baseboard
26862024-11-22T06:03:14.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34957
26872024-11-22T06:03:14.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34957 req_id = 10d0bfa0-1531-49a8-8d48-cb5b8fcaec5f response_code = 200 uri = /v2p
26882024-11-22T06:03:14.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62960
26892024-11-22T06:03:14.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62960 req_id = 8d8b0693-a44e-4785-bfd0-b55149251324 response_code = 200 uri = /vpc-routes
26902024-11-22T06:03:14.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
26912024-11-22T06:03:14.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62960 req_id = 451fdbe3-af55-456b-a488-058c66a86920 response_code = 204 uri = /eip-gateways
26922024-11-22T06:03:14.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62960 req_id = 1e29314b-1839-4517-9c95-74e18a8c1949 response_code = 204 uri = /vpc-routes
26932024-11-22T06:03:14.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61109
26942024-11-22T06:03:14.973ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
26952024-11-22T06:03:15.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
26962024-11-22T06:03:15.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130943 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61109 req_id = 833e7fb8-6bb9-458a-92a5-e2fbf744c42f response_code = 204 uri = /switch-ports
26972024-11-22T06:03:15.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61109 req_id = a2479735-2e71-48a2-be27-bfac9110e9d9 response_code = 200 uri = /network-bootstore-config
26982024-11-22T06:03:15.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58110
26992024-11-22T06:03:15.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58110 req_id = 7fc9433a-b330-4664-a05f-c79738e41de6 response_code = 200 uri = /vpc-routes
27002024-11-22T06:03:15.349ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
27012024-11-22T06:03:15.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58110 req_id = d4b54853-fb90-4274-86a4-0616e80979b5 response_code = 204 uri = /eip-gateways
27022024-11-22T06:03:15.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58110 req_id = d64070ce-0ae4-4df4-bae4-d88bfaa09f58 response_code = 204 uri = /vpc-routes
27032024-11-22T06:03:15.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63442
27042024-11-22T06:03:15.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63442 req_id = e6df3601-fbd1-463f-b9c3-605e5543fc73 response_code = 200 uri = /v2p
27052024-11-22T06:03:15.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54271
27062024-11-22T06:03:15.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54271 req_id = c32ba0c7-52d0-4468-afcb-281f3c23b3f9 response_code = 200 uri = /v2p
27072024-11-22T06:03:15.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41092
27082024-11-22T06:03:15.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41092 req_id = 895d78e8-8027-45f7-9bec-7eb00c9807ce response_code = 200 uri = /vpc-routes
27092024-11-22T06:03:15.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55826
27102024-11-22T06:03:15.430ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27112024-11-22T06:03:15.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27122024-11-22T06:03:15.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55826 req_id = 90c2d8ce-0052-441f-be38-fbca2311d43f response_code = 204 uri = /switch-ports
27132024-11-22T06:03:15.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49424
27142024-11-22T06:03:15.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55826 req_id = 92df6195-ba99-437b-a836-41e841a775ff response_code = 200 uri = /network-bootstore-config
27152024-11-22T06:03:15.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27162024-11-22T06:03:15.521ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
27172024-11-22T06:03:15.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41092 req_id = bcd8fbec-bda1-498b-8760-60e64fc72f83 response_code = 204 uri = /eip-gateways
27182024-11-22T06:03:15.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41092 req_id = 90ae174f-1c89-4f92-830e-13f883459d13 response_code = 204 uri = /vpc-routes
27192024-11-22T06:03:15.556ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27202024-11-22T06:03:15.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49424 req_id = 7f68365c-efd7-4a7d-9271-c466880aca24 response_code = 204 uri = /switch-ports
27212024-11-22T06:03:15.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49424 req_id = 9a8bf966-6f1a-4c63-bf03-911306017b7a response_code = 200 uri = /network-bootstore-config
27222024-11-22T06:03:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7366 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = c431ab1a-96fe-49d0-8e6c-5c76cbf7a1cd response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
27232024-11-22T06:03:41.369ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32852
27242024-11-22T06:03:41.369ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32852 req_id = da3092f8-7ee7-4136-96fa-a788177d1bc2 response_code = 200 uri = /baseboard
27252024-11-22T06:03:44.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64763
27262024-11-22T06:03:44.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64763 req_id = b3b3605c-cef7-4724-ae94-24398568b021 response_code = 200 uri = /vpc-routes
27272024-11-22T06:03:45.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
27282024-11-22T06:03:45.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64763 req_id = 12de20ad-1cde-4943-8b2c-60d88eeee84b response_code = 204 uri = /eip-gateways
27292024-11-22T06:03:45.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64763 req_id = 869604a1-6d9e-4834-b408-90c9a934c324 response_code = 204 uri = /vpc-routes
27302024-11-22T06:03:45.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50617
27312024-11-22T06:03:45.293ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27322024-11-22T06:03:45.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50617 req_id = 3d3d7a56-cd45-4c43-8562-ce54987a7537 response_code = 200 uri = /artifacts
27332024-11-22T06:03:45.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43554
27342024-11-22T06:03:45.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27352024-11-22T06:03:45.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43554 req_id = 79e4035d-7d93-4ae4-8d5b-f870955916f0 response_code = 200 uri = /artifacts
27362024-11-22T06:03:45.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58301
27372024-11-22T06:03:45.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58301 req_id = fa455e23-fddb-45c3-9b53-62611faab585 response_code = 200 uri = /v2p
27382024-11-22T06:03:45.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48068
27392024-11-22T06:03:45.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27402024-11-22T06:03:45.404ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27412024-11-22T06:03:45.404ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
27422024-11-22T06:03:45.405ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
27432024-11-22T06:03:45.421ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27442024-11-22T06:03:45.421ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56
27452024-11-22T06:03:45.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46107
27462024-11-22T06:03:45.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65402
27472024-11-22T06:03:45.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27482024-11-22T06:03:45.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65402 req_id = 54ef6a2b-a254-4fe5-b224-de71a9684fa5 response_code = 200 uri = /v2p
27492024-11-22T06:03:45.450ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27502024-11-22T06:03:45.450ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5011025a-5007-4e18-bad6-3b867e3bc813
27512024-11-22T06:03:45.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38664
27522024-11-22T06:03:45.464ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27532024-11-22T06:03:45.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38664 req_id = b401997c-26f0-407b-9426-e5a4f423a085 response_code = 200 uri = /artifacts
27542024-11-22T06:03:45.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27552024-11-22T06:03:45.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61451
27562024-11-22T06:03:45.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61451 req_id = d4623610-73f2-4457-b235-a25d0c1bdfd6 response_code = 200 uri = /vpc-routes
27572024-11-22T06:03:45.480ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27582024-11-22T06:03:45.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f4e28855-9173-4d42-9164-2e22168b6a5d
27592024-11-22T06:03:45.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45481
27602024-11-22T06:03:45.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45481 req_id = f5b7beac-5f61-494f-8585-1c65978373db response_code = 200 uri = /vpc-routes
27612024-11-22T06:03:45.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
27622024-11-22T06:03:45.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45481 req_id = 1e335a6b-398c-4a96-a5f8-cc046f6e633f response_code = 204 uri = /eip-gateways
27632024-11-22T06:03:45.523ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27642024-11-22T06:03:45.523ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706
27652024-11-22T06:03:45.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
27662024-11-22T06:03:45.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61451 req_id = 675adc17-7112-4cea-aa66-720ab3541735 response_code = 204 uri = /eip-gateways
27672024-11-22T06:03:45.553ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27682024-11-22T06:03:45.553ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e
27692024-11-22T06:03:45.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61451 req_id = 51966537-446e-46c3-b9fe-af7b6e75e8e7 response_code = 204 uri = /vpc-routes
27702024-11-22T06:03:45.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46107 req_id = 498a7301-d031-46bb-8a09-e19cc2edd92b response_code = 204 uri = /switch-ports
27712024-11-22T06:03:45.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46107 req_id = 20ecc838-4c51-4569-a478-e216278fc07c response_code = 200 uri = /network-bootstore-config
27722024-11-22T06:03:45.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64990
27732024-11-22T06:03:45.575ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
27742024-11-22T06:03:45.586ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27752024-11-22T06:03:45.586ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_38f500bf-3a39-433c-8745-e20b3ab66215
27762024-11-22T06:03:45.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38848
27772024-11-22T06:03:45.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36631
27782024-11-22T06:03:45.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27792024-11-22T06:03:45.612ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27802024-11-22T06:03:45.612ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
27812024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27822024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
27832024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27842024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27852024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27862024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27872024-11-22T06:03:45.612ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27882024-11-22T06:03:45.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 896 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38848 req_id = aac2fb0c-a79c-4ac0-b5c3-3ee6697b2577 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27892024-11-22T06:03:45.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
27902024-11-22T06:03:45.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 442 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45481 req_id = a52878ec-28a4-40c7-aa00-7d23df835286 response_code = 204 uri = /vpc-routes
27912024-11-22T06:03:45.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27922024-11-22T06:03:45.618ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9
27932024-11-22T06:03:45.622ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
27942024-11-22T06:03:45.635ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27952024-11-22T06:03:45.635ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56
27962024-11-22T06:03:45.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33986
27972024-11-22T06:03:45.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27982024-11-22T06:03:45.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5011025a-5007-4e18-bad6-3b867e3bc813
27992024-11-22T06:03:45.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42258
28002024-11-22T06:03:45.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42258 req_id = 9f5ac27d-40ef-40a0-bde4-836993a71ffa response_code = 200 uri = /v2p
28012024-11-22T06:03:45.680ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28022024-11-22T06:03:45.680ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d
28032024-11-22T06:03:45.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42697
28042024-11-22T06:03:45.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28052024-11-22T06:03:45.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28062024-11-22T06:03:45.698ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/config/omicron-zones.json file = common/src/ledger.rs:178
28072024-11-22T06:03:45.701ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28082024-11-22T06:03:45.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f4e28855-9173-4d42-9164-2e22168b6a5d
28092024-11-22T06:03:45.707ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28102024-11-22T06:03:45.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64990 req_id = cacda825-2e05-4a78-9691-9eefb97d85c3 response_code = 204 uri = /switch-ports
28112024-11-22T06:03:45.712ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/config/omicron-zones.json file = common/src/ledger.rs:178
28122024-11-22T06:03:45.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 759 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64990 req_id = be199151-9c3c-4eee-a512-b4bfc4abfc17 response_code = 200 uri = /network-bootstore-config
28132024-11-22T06:03:45.720ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28142024-11-22T06:03:45.720ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_633ab940-354c-4903-be3d-50b19510ea4f
28152024-11-22T06:03:45.734ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28162024-11-22T06:03:45.734ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56
28172024-11-22T06:03:45.753ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28182024-11-22T06:03:45.758ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28192024-11-22T06:03:45.758ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706
28202024-11-22T06:03:45.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358090 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48068 req_id = 9d485aff-58a4-4020-8f36-427b30cb48d0 response_code = 200 uri = /inventory
28212024-11-22T06:03:45.773ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5011025a-5007-4e18-bad6-3b867e3bc813 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28222024-11-22T06:03:45.773ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_5011025a-5007-4e18-bad6-3b867e3bc813
28232024-11-22T06:03:45.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62471
28242024-11-22T06:03:45.798ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4e28855-9173-4d42-9164-2e22168b6a5d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28252024-11-22T06:03:45.799ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_f4e28855-9173-4d42-9164-2e22168b6a5d
28262024-11-22T06:03:45.803ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28272024-11-22T06:03:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28282024-11-22T06:03:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28292024-11-22T06:03:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28302024-11-22T06:03:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28312024-11-22T06:03:45.803ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28322024-11-22T06:03:45.804ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28332024-11-22T06:03:45.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4381 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62471 req_id = 55c4afe4-f41b-4ef3-9a85-ccd9d3ad9181 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28342024-11-22T06:03:45.813ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28352024-11-22T06:03:45.813ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e
28362024-11-22T06:03:45.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151515 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33986 req_id = 6109cffa-d568-4998-92fe-75640b138508 response_code = 204 uri = /switch-ports
28372024-11-22T06:03:45.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33986 req_id = c5a88d1c-a6ce-4439-83e6-3e2f55fb4e90 response_code = 200 uri = /network-bootstore-config
28382024-11-22T06:03:45.830ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 42e0b7c7-ef11-481f-97b3-cb0e9fc7a706 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28392024-11-22T06:03:45.830ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_42e0b7c7-ef11-481f-97b3-cb0e9fc7a706
28402024-11-22T06:03:45.845ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28412024-11-22T06:03:45.845ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_38f500bf-3a39-433c-8745-e20b3ab66215
28422024-11-22T06:03:45.870ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28432024-11-22T06:03:45.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9
28442024-11-22T06:03:45.883ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e6cca38f-5841-4e6a-a47e-367773f37c5e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28452024-11-22T06:03:45.883ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e6cca38f-5841-4e6a-a47e-367773f37c5e
28462024-11-22T06:03:45.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43923
28472024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 929c1020-3d1b-44c1-869a-548e8ca7acfd, kind: Service { id: e40af71f-a5c0-473a-94dd-6fd1db818ede }, name: Name("external-dns-e40af71f-a5c0-473a-94dd-6fd1db818ede"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 171])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cac529c3-bef7-463c-a663-9c71ae43965a, kind: Service { id: 6652103c-533e-477f-853d-d5a6ff146362 }, name: Name("external-dns-6652103c-533e-477f-853d-d5a6ff146362"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 237])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3a1b1cc2-ffc3-4506-888d-f9cd68211b64, kind: Service { id: 1a17ffde-7e17-46a2-80a5-3effa07c2a36 }, name: Name("nexus-1a17ffde-7e17-46a2-80a5-3effa07c2a36"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 209])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b3b5905-bec1-4585-9176-cb5167794eb9, kind: Service { id: 7c155939-0b0e-4a50-a14d-2fb48dae613c }, name: Name("nexus-7c155939-0b0e-4a50-a14d-2fb48dae613c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 93])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 99cc8bfb-bb50-4cf0-917e-05fa907cb5db, kind: Service { id: 944dfa82-0d31-483c-9606-a464ddba8f2e }, name: Name("nexus-944dfa82-0d31-483c-9606-a464ddba8f2e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 76])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28482024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
28492024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28502024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28512024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28522024-11-22T06:03:45.899ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28532024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28542024-11-22T06:03:45.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d
28552024-11-22T06:03:45.899ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28562024-11-22T06:03:45.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43923 req_id = 2d4cecd3-7077-4847-9c3b-8608566e4681 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28572024-11-22T06:03:45.916ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38f500bf-3a39-433c-8745-e20b3ab66215 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28582024-11-22T06:03:45.916ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_38f500bf-3a39-433c-8745-e20b3ab66215
28592024-11-22T06:03:45.928ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28602024-11-22T06:03:45.928ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_633ab940-354c-4903-be3d-50b19510ea4f
28612024-11-22T06:03:45.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329989 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36631 req_id = f2540bfd-c14b-4f5e-9a63-1ce0582a7d8d response_code = 200 uri = /inventory
28622024-11-22T06:03:45.947ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dc63b39d-a6c3-4fc2-a251-2158d40a31c9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632024-11-22T06:03:45.947ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_dc63b39d-a6c3-4fc2-a251-2158d40a31c9
28642024-11-22T06:03:45.966ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e7e59236-66e7-48ed-9d40-0e0bd86be23d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28652024-11-22T06:03:45.966ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_e7e59236-66e7-48ed-9d40-0e0bd86be23d
28662024-11-22T06:03:45.989ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 633ab940-354c-4903-be3d-50b19510ea4f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28672024-11-22T06:03:45.989ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1022 request = datasets_list zpool = oxp_633ab940-354c-4903-be3d-50b19510ea4f
28682024-11-22T06:03:46.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 308447 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42697 req_id = 51e7ff5f-bb7e-4bed-8561-9c120360a58f response_code = 200 uri = /inventory
28692024-11-22T06:03:58.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6406 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 7091af83-57cd-4d34-9111-606d57d71201 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
28702024-11-22T06:04:11.403ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53098
28712024-11-22T06:04:11.403ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53098 req_id = 463b29e6-0ee8-48ad-9e18-295d9d266441 response_code = 200 uri = /baseboard
28722024-11-22T06:04:14.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37389
28732024-11-22T06:04:14.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37389 req_id = c9d22f97-9ce9-4c50-b155-b3411ed425a5 response_code = 200 uri = /vpc-routes
28742024-11-22T06:04:14.960ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
28752024-11-22T06:04:14.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37389 req_id = d83f5f27-6f77-4384-a8cd-cfb08e0a78c1 response_code = 204 uri = /eip-gateways
28762024-11-22T06:04:14.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37389 req_id = a76c3cdf-a17d-467d-95ea-8fe415f0a990 response_code = 204 uri = /vpc-routes
28772024-11-22T06:04:14.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53785
28782024-11-22T06:04:14.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53785 req_id = 9d3fd199-e95b-4df3-8aac-0456be5cf0f3 response_code = 200 uri = /v2p
28792024-11-22T06:04:15.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49130
28802024-11-22T06:04:15.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28812024-11-22T06:04:15.054ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28822024-11-22T06:04:15.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138366 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49130 req_id = b1bd03ff-9515-46e7-9dd5-652634cc20de response_code = 204 uri = /switch-ports
28832024-11-22T06:04:15.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49130 req_id = fa241564-ddeb-43c0-a00a-19042bee338d response_code = 200 uri = /network-bootstore-config
28842024-11-22T06:04:15.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45440
28852024-11-22T06:04:15.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45440 req_id = 88107272-21d3-4bdd-91eb-330790bb8bfc response_code = 200 uri = /vpc-routes
28862024-11-22T06:04:15.220ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
28872024-11-22T06:04:15.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45440 req_id = 7b85ab75-903d-4600-a01e-9fa3ef17ed97 response_code = 204 uri = /eip-gateways
28882024-11-22T06:04:15.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45440 req_id = c2ea8374-3d8a-4536-8104-20a4b1bbd54d response_code = 204 uri = /vpc-routes
28892024-11-22T06:04:15.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57369
28902024-11-22T06:04:15.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57369 req_id = 797423d4-888b-49ce-8c53-ec3bdf81790c response_code = 200 uri = /v2p
28912024-11-22T06:04:15.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58650
28922024-11-22T06:04:15.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58650 req_id = 3a421e26-16ab-4dbb-9d1c-901998e34cad response_code = 200 uri = /v2p
28932024-11-22T06:04:15.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34936
28942024-11-22T06:04:15.281ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
28952024-11-22T06:04:15.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
28962024-11-22T06:04:15.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34936 req_id = 6b0d8560-8a27-4312-8f87-c0a41e72f915 response_code = 204 uri = /switch-ports
28972024-11-22T06:04:15.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34936 req_id = a1e3b312-81b1-4bbb-b7c5-869d28ecc6d2 response_code = 200 uri = /network-bootstore-config
28982024-11-22T06:04:15.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47075
28992024-11-22T06:04:15.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47075 req_id = c5ef5b3d-ab9f-48ba-8806-df1657dec68f response_code = 200 uri = /vpc-routes
29002024-11-22T06:04:15.402ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29012024-11-22T06:04:15.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47075 req_id = e9b334a2-5a30-4cd9-a016-c898c6bd1314 response_code = 204 uri = /eip-gateways
29022024-11-22T06:04:15.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47075 req_id = e937fc82-b452-4c6a-88fd-f2fd07341226 response_code = 204 uri = /vpc-routes
29032024-11-22T06:04:15.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46425
29042024-11-22T06:04:15.464ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29052024-11-22T06:04:15.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29062024-11-22T06:04:15.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87295 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46425 req_id = ef700fdd-eb65-4647-99be-a9f59a15f572 response_code = 204 uri = /switch-ports
29072024-11-22T06:04:15.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46425 req_id = 366bcfe8-957f-4da1-8389-e0e9cdbf455f response_code = 200 uri = /network-bootstore-config
29082024-11-22T06:04:28.995ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6730 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 0f9e20a9-4b8d-442b-8c32-36190ca3adba response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
29092024-11-22T06:04:41.436ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41703
29102024-11-22T06:04:41.436ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41703 req_id = 7211238e-4ea1-4387-9a4c-a384599e0028 response_code = 200 uri = /baseboard
29112024-11-22T06:04:45.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53836
29122024-11-22T06:04:45.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29132024-11-22T06:04:45.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53836 req_id = 78ac20a7-3d31-4097-814c-9f48e4a6fe50 response_code = 200 uri = /artifacts
29142024-11-22T06:04:45.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42287
29152024-11-22T06:04:45.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42287 req_id = ecd89d7b-e754-4a7c-95b6-0848e43f22da response_code = 200 uri = /vpc-routes
29162024-11-22T06:04:45.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29172024-11-22T06:04:45.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42287 req_id = c1d9e57e-0236-4ec2-a292-0cebefda514b response_code = 204 uri = /eip-gateways
29182024-11-22T06:04:45.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 508 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42287 req_id = c5004397-1dbe-4de2-b8c3-ada3a0736678 response_code = 204 uri = /vpc-routes
29192024-11-22T06:04:45.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41455
29202024-11-22T06:04:45.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41455 req_id = 240160db-dc10-4e49-8cb6-c881841d74ae response_code = 200 uri = /v2p
29212024-11-22T06:04:45.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45016
29222024-11-22T06:04:45.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29232024-11-22T06:04:45.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29242024-11-22T06:04:45.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99290 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45016 req_id = 8bdcaaf9-c095-4748-b368-b3f7c2661d89 response_code = 204 uri = /switch-ports
29252024-11-22T06:04:45.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46024
29262024-11-22T06:04:45.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36042
29272024-11-22T06:04:45.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45016 req_id = 019e0aaa-3636-45fb-bf2a-57fbc4952865 response_code = 200 uri = /network-bootstore-config
29282024-11-22T06:04:45.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38070
29292024-11-22T06:04:45.476ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29302024-11-22T06:04:45.476ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29312024-11-22T06:04:45.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38070 req_id = 4575a4b4-a305-4f24-b87c-25be99c8310a response_code = 200 uri = /vpc-routes
29322024-11-22T06:04:45.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46024 req_id = 1f1c6bc0-be42-437b-bded-d4104220504a response_code = 200 uri = /artifacts
29332024-11-22T06:04:45.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36042 req_id = e713563c-ba6e-43bc-b33d-8b800e78d6f5 response_code = 200 uri = /artifacts
29342024-11-22T06:04:45.524ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29352024-11-22T06:04:45.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38070 req_id = adb607b8-0a62-4060-a449-baf964f2994b response_code = 204 uri = /eip-gateways
29362024-11-22T06:04:45.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64843
29372024-11-22T06:04:45.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64843 req_id = 4b653268-29da-4e2a-a5e5-9b5ca57131de response_code = 200 uri = /vpc-routes
29382024-11-22T06:04:45.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42240
29392024-11-22T06:04:45.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42240 req_id = 46ba1e28-accc-447d-9b45-a21400946613 response_code = 200 uri = /v2p
29402024-11-22T06:04:45.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38070 req_id = 7e37ddb6-6da4-4970-99ef-fb6e87735548 response_code = 204 uri = /vpc-routes
29412024-11-22T06:04:45.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29422024-11-22T06:04:45.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64843 req_id = 81ebb68c-2487-4aad-95e3-892ff16c78c7 response_code = 204 uri = /eip-gateways
29432024-11-22T06:04:45.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54539
29442024-11-22T06:04:45.641ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29452024-11-22T06:04:45.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29462024-11-22T06:04:45.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54539 req_id = 71f7044c-eaf0-4955-bdef-fdedd73b7aba response_code = 204 uri = /switch-ports
29472024-11-22T06:04:45.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58576
29482024-11-22T06:04:45.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39756
29492024-11-22T06:04:45.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54539 req_id = a5091bdf-de48-4e5d-9397-cfab71361101 response_code = 200 uri = /network-bootstore-config
29502024-11-22T06:04:45.734ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29512024-11-22T06:04:45.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64843 req_id = f4d74e14-76dc-49dd-9cd3-c9fd5ea8043c response_code = 204 uri = /vpc-routes
29522024-11-22T06:04:45.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58576 req_id = ce6f1ab9-94de-478a-84bf-821b0ba90988 response_code = 200 uri = /v2p
29532024-11-22T06:04:45.771ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29542024-11-22T06:04:45.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39756 req_id = ace465b0-6f15-4364-9331-3c16badc9305 response_code = 204 uri = /switch-ports
29552024-11-22T06:04:45.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39756 req_id = 1847c5e5-144b-4e20-a6a9-343400048a36 response_code = 200 uri = /network-bootstore-config
29562024-11-22T06:04:58.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7073 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 931fb2ea-1e25-4a1d-8b8c-4f56102ea752 response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
29572024-11-22T06:05:11.470ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56112
29582024-11-22T06:05:11.470ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56112 req_id = 15027e9d-69b6-41cf-8daa-e93649ce5565 response_code = 200 uri = /baseboard
29592024-11-22T06:05:14.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43636
29602024-11-22T06:05:14.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43636 req_id = 49901ef9-6c47-4202-a2f9-850af2755807 response_code = 200 uri = /vpc-routes
29612024-11-22T06:05:14.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29622024-11-22T06:05:14.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43636 req_id = 5e8af643-5dbf-4b53-864c-bc25d121f8b9 response_code = 204 uri = /eip-gateways
29632024-11-22T06:05:14.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43636 req_id = 481acbdc-cd10-4ec4-b451-2087b25d082c response_code = 204 uri = /vpc-routes
29642024-11-22T06:05:15.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47918
29652024-11-22T06:05:15.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47918 req_id = baa1bb32-b45c-4a14-8f58-fc8203311e87 response_code = 200 uri = /v2p
29662024-11-22T06:05:15.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44834
29672024-11-22T06:05:15.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29682024-11-22T06:05:15.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29692024-11-22T06:05:15.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44834 req_id = a1c2f0fe-0767-40ec-8a80-39ea96129c31 response_code = 204 uri = /switch-ports
29702024-11-22T06:05:15.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44834 req_id = 3d0aa898-2a07-41f9-acce-a5e33084a976 response_code = 200 uri = /network-bootstore-config
29712024-11-22T06:05:15.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42405
29722024-11-22T06:05:15.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42405 req_id = c1237b9e-2b30-406e-9a27-3707ea1026ef response_code = 200 uri = /vpc-routes
29732024-11-22T06:05:15.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29742024-11-22T06:05:15.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42405 req_id = 8a937392-316a-4190-8f76-42b02eb41912 response_code = 204 uri = /eip-gateways
29752024-11-22T06:05:15.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55592
29762024-11-22T06:05:15.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55592 req_id = dea4e49e-4b13-44cb-8ddf-6d98cf90a360 response_code = 200 uri = /v2p
29772024-11-22T06:05:15.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41824
29782024-11-22T06:05:15.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41824 req_id = a2293448-3577-4d8c-b79c-bbc39c577306 response_code = 200 uri = /vpc-routes
29792024-11-22T06:05:15.408ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
29802024-11-22T06:05:15.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41824 req_id = a78d8d95-7266-4c1b-9a36-c4cc01695eb0 response_code = 204 uri = /eip-gateways
29812024-11-22T06:05:15.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41824 req_id = 89fb0068-85b1-40f7-9be5-f6df20b44ddd response_code = 204 uri = /vpc-routes
29822024-11-22T06:05:15.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47167
29832024-11-22T06:05:15.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29842024-11-22T06:05:15.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29852024-11-22T06:05:15.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47167 req_id = 75df9fa1-e55c-4945-bac0-cc6192d72411 response_code = 204 uri = /switch-ports
29862024-11-22T06:05:15.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53490
29872024-11-22T06:05:15.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47167 req_id = bb0cb030-a146-4ed6-b983-8f627b383c21 response_code = 200 uri = /network-bootstore-config
29882024-11-22T06:05:15.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53490 req_id = 1b00a013-70b4-47b3-ad19-9b269a2466e0 response_code = 200 uri = /v2p
29892024-11-22T06:05:15.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42405 req_id = 592f3e2a-cffe-423f-8e88-3b362a7bcc17 response_code = 204 uri = /vpc-routes
29902024-11-22T06:05:15.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34337
29912024-11-22T06:05:15.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4177
29922024-11-22T06:05:15.975ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4201
29932024-11-22T06:05:16.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34337 req_id = 637a9a47-6fbe-4884-b093-651cd6f9f6d6 response_code = 204 uri = /switch-ports
29942024-11-22T06:05:16.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34337 req_id = 6f8399bf-b061-481d-b332-f0a2c4ccf404 response_code = 200 uri = /network-bootstore-config
29952024-11-22T06:05:20.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42198
29962024-11-22T06:05:20.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42198 req_id = da770b5b-3096-40a3-a7df-25edebd2d4c5 response_code = 200 uri = /v2p
29972024-11-22T06:05:20.840ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6535109) }
29982024-11-22T06:05:20.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42198 req_id = 02191862-fcc4-49fe-990e-774d39bcaa96 response_code = 204 uri = /v2p
29992024-11-22T06:05:20.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64992
30002024-11-22T06:05:20.980ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6535109))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-26d2cd6bceb", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 456c3dc4-5af2-4fdc-b2fa-bf4e72d791f5, read_only_parent: Some(Volume { block_size: 512, id: c3188aea-e41b-460b-be91-d205e6ff4f59, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5f5dd666-ef2b-4b17-9921-526d4a7762b8, key: Some("N4KlBOGZO2mCxZVMSBNVtqRlNOHNdGVmnoE/HJoQzv0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 456c3dc4-5af2-4fdc-b2fa-bf4e72d791f5, key: Some("jmv3ZYZ1PnHyM43ov4+KQfEEhkdKmSSqKRsc0ZYIahM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::19]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-26d2cd6bceb" }] }), cloud_init_bytes: Some(..) } instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 metadata = InstanceMetadata { silo_id: 624f79e6-c3d6-4260-9dec-14087ee9f806, project_id: 5963baba-10e7-44fb-b7bb-1b54dbea027d } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-22T06:05:20.972884689Z }
30012024-11-22T06:05:20.980ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 migration_id = None propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30022024-11-22T06:05:20.980ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 migration_id = None propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6535109))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7c0cd6be-dc69-44a8-b06b-d3d039d977dd, kind: Instance { id: a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6535109), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-26d2cd6bceb", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 456c3dc4-5af2-4fdc-b2fa-bf4e72d791f5, read_only_parent: Some(Volume { block_size: 512, id: c3188aea-e41b-460b-be91-d205e6ff4f59, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5f5dd666-ef2b-4b17-9921-526d4a7762b8, key: Some("N4KlBOGZO2mCxZVMSBNVtqRlNOHNdGVmnoE/HJoQzv0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 456c3dc4-5af2-4fdc-b2fa-bf4e72d791f5, key: Some("jmv3ZYZ1PnHyM43ov4+KQfEEhkdKmSSqKRsc0ZYIahM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::19]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-26d2cd6bceb" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-22T06:05:20.972884689Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30032024-11-22T06:05:20.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64992 req_id = 0104781f-35f0-4c57-899b-6f7cf293da79 response_code = 200 uri = /vmms/d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30042024-11-22T06:05:21.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57827
30052024-11-22T06:05:21.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57827 req_id = 1b7079b2-14fd-4f6d-ac0d-5802598747f6 response_code = 200 uri = /vmms/d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8/state
30062024-11-22T06:05:21.056ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6535109 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30072024-11-22T06:05:21.056ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30082024-11-22T06:05:21.095ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 file = illumos-utils/src/zone.rs:325 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30092024-11-22T06:05:21.122ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 file = illumos-utils/src/zone.rs:363 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30102024-11-22T06:05:21.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40718
30112024-11-22T06:05:21.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40718 req_id = 9f764a5d-c84a-4b13-8656-f3b736ad4d59 response_code = 200 uri = /vpc-routes
30122024-11-22T06:05:21.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {7c0cd6be-dc69-44a8-b06b-d3d039d977dd: {10.151.1.176: {1a1207d7-c4c4-499a-9959-3256e5ae09d2}, 10.151.1.175: {1a1207d7-c4c4-499a-9959-3256e5ae09d2}}} }
30132024-11-22T06:05:22.456ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30142024-11-22T06:05:22.457ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone file = illumos-utils/src/running_zone.rs:488 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30152024-11-22T06:05:22.696ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 49.533221ms file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30162024-11-22T06:05:22.754ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 119.797955ms file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30172024-11-22T06:05:22.892ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 180.78734ms file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30182024-11-22T06:05:23.086ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 454.750346ms file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30192024-11-22T06:05:23.556ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 828.908425ms file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30202024-11-22T06:05:24.398ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 1.195400774s file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30212024-11-22T06:05:25.338ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30222024-11-22T06:05:25.605ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 1.226071114s file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30232024-11-22T06:05:26.841ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 1.234823743s file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 zone = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30242024-11-22T06:05:28.105ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 file = sled-agent/src/instance.rs:1787 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30252024-11-22T06:05:28.115ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8") failed: Property not found. retry in 31.255995ms file = illumos-utils/src/svc.rs:36 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30262024-11-22T06:05:28.157ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30272024-11-22T06:05:28.196ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30282024-11-22T06:05:28.334ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30292024-11-22T06:05:28.336ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1213 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
30302024-11-22T06:05:28.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7154709 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40718 req_id = 25162ec8-04f2-4b2f-a5a6-7a006a13e120 response_code = 204 uri = /eip-gateways
30312024-11-22T06:05:28.337ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-11-22T06:05:28.337686812Z } file = sled-agent/src/instance.rs:780 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30322024-11-22T06:05:28.337ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T06:05:28.337686812Z } propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30332024-11-22T06:05:28.337ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T06:05:28.337686812Z }, migration_in: None, migration_out: None }
30342024-11-22T06:05:28.351ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-11-22T06:05:28.351359423Z } file = sled-agent/src/instance.rs:780 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30352024-11-22T06:05:28.351ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T06:05:28.351359423Z } propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30362024-11-22T06:05:28.351ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T06:05:28.351359423Z }, migration_in: None, migration_out: None }
30372024-11-22T06:05:28.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40718 req_id = 8d81c664-bb3f-4943-b4b5-0a677e49c001 response_code = 204 uri = /vpc-routes
30382024-11-22T06:05:28.996ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6512 local_addr = [fd00:1122:3344:101::1]:40649 method = GET remote_addr = [fd00:1122:3344:101::d]:59482 req_id = 9f012cdd-9f66-4d1b-b60b-e0d22649ce3a response_code = 200 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 uri = /94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
30392024-11-22T06:05:38.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57334
30402024-11-22T06:05:38.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57334 req_id = 7a3b3497-231a-4732-a523-aaf009d67308 response_code = 200 uri = /vmms/d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8/state
30412024-11-22T06:05:38.717ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-11-22T06:05:38.717204430Z } file = sled-agent/src/instance.rs:780 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30422024-11-22T06:05:38.717ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T06:05:38.717204430Z } propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30432024-11-22T06:05:38.717ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T06:05:38.717204430Z }, migration_in: None, migration_out: None }
30442024-11-22T06:05:38.726ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-11-22T06:05:38.726126312Z } file = sled-agent/src/instance.rs:780 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30452024-11-22T06:05:38.726ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-11-22T06:05:38.726126312Z } propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30462024-11-22T06:05:38.726ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30472024-11-22T06:05:38.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30482024-11-22T06:05:38.726ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 1899637987360106112 n_samples = 6 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
30492024-11-22T06:05:38.726ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30502024-11-22T06:05:38.726ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/11576e0f-ec9d-409a-acd8-2416d9925a5d/debug/bundle/zone", "/pool/int/7611e6e5-6a68-4a9f-8263-186d30fed23e/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/7e0a34bc-290f-47c1-9fcc-4eb4c8ce2a56/crypt/debug", "/pool/ext/5011025a-5007-4e18-bad6-3b867e3bc813/crypt/debug", "/pool/ext/f4e28855-9173-4d42-9164-2e22168b6a5d/crypt/debug", "/pool/ext/42e0b7c7-ef11-481f-97b3-cb0e9fc7a706/crypt/debug", "/pool/ext/e6cca38f-5841-4e6a-a47e-367773f37c5e/crypt/debug", "/pool/ext/38f500bf-3a39-433c-8745-e20b3ab66215/crypt/debug", "/pool/ext/dc63b39d-a6c3-4fc2-a251-2158d40a31c9/crypt/debug", "/pool/ext/e7e59236-66e7-48ed-9d40-0e0bd86be23d/crypt/debug", "/pool/ext/633ab940-354c-4903-be3d-50b19510ea4f/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30512024-11-22T06:05:38.726ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 16166469648379009908 n_samples = 6 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
30522024-11-22T06:05:39.370ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8", bundle_id: dec1a3d4-95fc-444a-bf87-6c649118b1ef }, time_created: 2024-11-22T06:05:38.727187551Z, version: 0, cause: TerminatedInstance }
30532024-11-22T06:05:39.370ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 file = sled-agent/src/instance.rs:1032 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30542024-11-22T06:05:41.146ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30552024-11-22T06:05:41.164ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(6535109), kind: System }
30562024-11-22T06:05:41.164ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(6535109), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30572024-11-22T06:05:41.164ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T06:05:41.164732340Z }, migration_in: None, migration_out: None }
30582024-11-22T06:05:41.192ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T06:05:41.164732340Z }, migration_in: None, migration_out: None }
30592024-11-22T06:05:41.196ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = a8f1bd02-fbc1-47f2-85f6-48f1f22997a4 propolis_id = d1bdf2c2-29ae-4093-80f5-d5ffe7f27ff8
30602024-11-22T06:05:41.504ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41857
30612024-11-22T06:05:41.504ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41857 req_id = ad93d747-0859-4a83-88ff-ed3b85283425 response_code = 200 uri = /baseboard
30622024-11-22T06:05:41.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47724
30632024-11-22T06:05:41.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47724 req_id = aa2a87ee-e8d0-454f-9a5d-deb97629bf4d response_code = 200 uri = /vpc-routes
30642024-11-22T06:05:41.549ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {7c0cd6be-dc69-44a8-b06b-d3d039d977dd: {10.151.1.175: {1a1207d7-c4c4-499a-9959-3256e5ae09d2}, 10.151.1.176: {1a1207d7-c4c4-499a-9959-3256e5ae09d2}}} }
30652024-11-22T06:05:41.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47724 req_id = df38edda-1fea-471f-842c-363c97a275a9 response_code = 204 uri = /eip-gateways
30662024-11-22T06:05:41.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41967
30672024-11-22T06:05:41.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41967 req_id = df91ba4f-aa24-49b7-8617-f746510ef4e2 response_code = 200 uri = /v2p
30682024-11-22T06:05:41.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47724 req_id = 19daac22-1db6-4077-b9d7-7edc25ccdd1a response_code = 204 uri = /vpc-routes
30692024-11-22T06:05:41.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56846
30702024-11-22T06:05:41.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56846 req_id = 1b1b3cee-0933-42cc-8d2c-f2ed0d796501 response_code = 200 uri = /v2p
30712024-11-22T06:05:42.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48504
30722024-11-22T06:05:42.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48504 req_id = 42ac6489-c42a-4c8f-acf4-8dd6975b1d1f response_code = 200 uri = /vpc-routes
30732024-11-22T06:05:42.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
30742024-11-22T06:05:42.061ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1213 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9
30752024-11-22T06:05:42.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48504 req_id = 6c873d42-7c9f-42ef-9338-57c214e2c087 response_code = 204 uri = /eip-gateways
30762024-11-22T06:05:42.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48504 req_id = 2f85f93f-4534-4f2e-8473-f0d8423f504f response_code = 204 uri = /vpc-routes
30772024-11-22T06:05:42.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39371
30782024-11-22T06:05:42.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39371 req_id = 2a020321-5bcc-49b1-9b0d-c6da919b6cfb response_code = 200 uri = /vpc-routes
30792024-11-22T06:05:42.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1187 sled_id = 94dfca6f-ac64-4e0e-9bdb-de864c8ef8c9 values = ExternalIpGatewayMap { mappings: {} }
30802024-11-22T06:05:42.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39371 req_id = faf7c028-ab41-4ac9-b092-619e9afacc6d response_code = 204 uri = /eip-gateways
30812024-11-22T06:05:42.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39371 req_id = 51632fd0-11d8-4a36-b615-fdfdccbddacb response_code = 204 uri = /vpc-routes