Max level shown:
1 [ Dec 21 07:40:45 Enabled. ]
2 [ Dec 21 07:40:45 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 21 07:40:45 Method "start" exited with status 0. ]
4 [ Dec 21 07:40:45 Rereading configuration. ]
5 [ Dec 21 07:40:45 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-21T07:40:45.982ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-21T07:40:45.983ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-21T07:40:46.036ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-21T07:40:46.036ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-21T07:40:46.150ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-21T07:40:46.160ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-21T07:40:46.168ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-21T07:40:46.769ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-21T07:40:46.911ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-21T07:40:46.911ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-21T07:40:46.911ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-21T07:40:46.911ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-21T07:40:46.911ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-21T07:40:46.911ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-21T07:40:46.914ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-21T07:40:46.914ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-21T07:40:46.914ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-21T07:40:46.914ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-21T07:40:46.914ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-21T07:40:46.914ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-21T07:40:46.914ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-21T07:40:46.914ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-21T07:40:46.914ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-21T07:40:46.926ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-21T07:40:46.926ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool)
322024-12-21T07:40:47.043ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal }
332024-12-21T07:40:47.497ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-21T07:40:47.497ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-21T07:40:47.497ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-21T07:40:47.497ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-21T07:40:47.497ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-21T07:40:47.498ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-21T07:40:47.498ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-21T07:40:47.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-21T07:40:47.507ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool)
422024-12-21T07:40:47.613ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal }
432024-12-21T07:40:48.056ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-21T07:40:48.056ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-21T07:40:48.056ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-21T07:40:48.056ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-21T07:40:48.056ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-21T07:40:48.056ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-21T07:40:48.056ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-21T07:40:48.056ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-21T07:40:48.056ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-21T07:40:48.056ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-21T07:40:48.056ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542024-12-21T07:40:48.056ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-21T07:40:48.056ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-21T07:40:48.056ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-21T07:40:48.057ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632024-12-21T07:40:48.057ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-21T07:40:48.057ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-21T07:40:48.057ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-21T07:40:48.057ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-21T07:40:48.057ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-21T07:40:48.057ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-21T07:40:48.057ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832024-12-21T07:40:48.057ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
852024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
862024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
872024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
882024-12-21T07:40:48.057ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902024-12-21T07:40:48.057ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-12-21T07:40:48.057ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
922024-12-21T07:40:48.057ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
932024-12-21T07:40:48.057ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
952024-12-21T07:40:48.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
962024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-21T07:40:48.057ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
982024-12-21T07:40:48.057ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1002024-12-21T07:40:48.057ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1012024-12-21T07:40:48.057ZINFOSledAgent (bootstore): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1022024-12-21T07:40:48.057ZINFOSledAgent (bootstore): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1032024-12-21T07:40:48.057ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1042024-12-21T07:40:48.057ZINFOSledAgent (bootstore): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-21T07:40:48.057ZINFOSledAgent (bootstore): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-21T07:40:48.057ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1072024-12-21T07:40:48.057ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-12-21T07:40:48.057ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-12-21T07:40:48.068ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1102024-12-21T07:40:48.068ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1381, tv_nsec: 826071994 } time_to_next_cleanup = 599.999933269s
1112024-12-21T07:40:48.068ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
1122024-12-21T07:40:48.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1132024-12-21T07:40:48.068ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-12-21T07:40:48.068ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-12-21T07:40:48.071ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1162024-12-21T07:40:48.073ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1172024-12-21T07:40:48.073ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1182024-12-21T07:40:48.073ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192024-12-21T07:40:48.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1202024-12-21T07:40:48.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1212024-12-21T07:40:48.073ZINFOSledAgent (RSS): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/rss-started.marker file = common/src/ledger.rs:188
1222024-12-21T07:40:48.073ZINFOSledAgent (RSS): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/rss-started.marker file = common/src/ledger.rs:188
1232024-12-21T07:40:48.073ZINFOSledAgent (RSS): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-12-21T07:40:48.073ZINFOSledAgent (RSS): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-12-21T07:40:48.073ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1262024-12-21T07:40:48.073ZINFOSledAgent (RSS): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1272024-12-21T07:40:48.074ZINFOSledAgent (RSS): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1282024-12-21T07:40:48.074ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1292024-12-21T07:40:48.074ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1302024-12-21T07:40:48.074ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1312024-12-21T07:40:48.074ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1322024-12-21T07:40:48.074ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1332024-12-21T07:40:48.074ZINFOSledAgent (bootstore): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1342024-12-21T07:40:48.074ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1352024-12-21T07:40:48.074ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1362024-12-21T07:40:48.074ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 (sled), rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1372024-12-21T07:40:48.075ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4259
1382024-12-21T07:40:48.075ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4659
1392024-12-21T07:40:48.080ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1402024-12-21T07:40:48.086ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1412024-12-21T07:40:48.086ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1422024-12-21T07:40:48.090ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432024-12-21T07:40:48.090ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442024-12-21T07:40:48.090ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:51871
1452024-12-21T07:40:48.090ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 (sled), rack_id: e92af880-4a9b-4c79-a3ae-829b6394cf0b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1462024-12-21T07:40:48.090ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1472024-12-21T07:40:48.091ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482024-12-21T07:40:48.091ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1492024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1502024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1512024-12-21T07:40:48.091ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1522024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1532024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1542024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1552024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1562024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1572024-12-21T07:40:48.091ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1582024-12-21T07:40:48.091ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1592024-12-21T07:40:48.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1602024-12-21T07:40:48.128ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1612024-12-21T07:40:48.146ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1622024-12-21T07:40:48.152ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1632024-12-21T07:40:48.152ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642024-12-21T07:40:48.152ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1652024-12-21T07:40:48.152ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662024-12-21T07:40:48.155ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 137.794197ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3bb1e80a-a247-4c16-946b-7b41d83e1ca4", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3bb1e80a-a247-4c16-946b-7b41d83e1ca4" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-12-21T07:40:48.164ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_38e50563-d6f1-4512-81d8-478fc24b0465/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-12-21T07:40:48.190ZINFOSledAgent: successfully created encrypted zvol: name="oxi_38e50563-d6f1-4512-81d8-478fc24b0465/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-12-21T07:40:48.190ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_38e50563-d6f1-4512-81d8-478fc24b0465/swap" file = sled-agent/src/swap_device.rs:96
1702024-12-21T07:40:48.195ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1712024-12-21T07:40:48.195ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1722024-12-21T07:40:48.195ZINFOSledAgent (BackingFs): Ensuring dataset oxi_38e50563-d6f1-4512-81d8-478fc24b0465/backing/fmd file = sled-agent/src/backing_fs.rs:139
1732024-12-21T07:40:48.278ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1742024-12-21T07:40:48.294ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752024-12-21T07:40:48.294ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 127.623473ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fd87ce2a-a801-4068-a197-ae5ae5518c29", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fd87ce2a-a801-4068-a197-ae5ae5518c29" } file = clients/ddm-admin-client/src/lib.rs:177
1762024-12-21T07:40:48.422ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-21T07:40:48.423ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 156.064243ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "782f2ccb-9a73-48a3-9e38-058ab697b67a", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "782f2ccb-9a73-48a3-9e38-058ab697b67a" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-21T07:40:48.497ZINFOSledAgent (BackingFs): Mounting oxi_38e50563-d6f1-4512-81d8-478fc24b0465/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1792024-12-21T07:40:48.510ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1802024-12-21T07:40:48.510ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1812024-12-21T07:40:48.510ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1822024-12-21T07:40:48.510ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1832024-12-21T07:40:48.581ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-12-21T07:40:48.582ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 225.739056ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c42086a6-c76f-4749-bf75-2e1c92be7eb1", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c42086a6-c76f-4749-bf75-2e1c92be7eb1" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-12-21T07:40:48.808ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-12-21T07:40:48.809ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 221.605389ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5b5c28f1-dee4-425a-a111-7c9a8a2aceb1", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5b5c28f1-dee4-425a-a111-7c9a8a2aceb1" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-12-21T07:40:49.032ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-12-21T07:40:49.032ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 152.276685ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a4e73a4c-51fd-4491-988b-9a94ed083613", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a4e73a4c-51fd-4491-988b-9a94ed083613" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-12-21T07:40:49.185ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-12-21T07:40:49.186ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 254.550634ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "89ed366a-58f7-4bc1-8d1a-b3afa3d061b6", "content-length": "124", "date": "Sat, 21 Dec 2024 07:40:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "89ed366a-58f7-4bc1-8d1a-b3afa3d061b6" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-12-21T07:40:49.264ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1922024-12-21T07:40:49.270ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:52235 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1932024-12-21T07:40:49.270ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1942024-12-21T07:40:49.270ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:52235 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1952024-12-21T07:40:49.271ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 369.634304ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1962024-12-21T07:40:49.272ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1972024-12-21T07:40:49.272ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
1982024-12-21T07:40:49.272ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
1992024-12-21T07:40:49.272ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2002024-12-21T07:40:49.441ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2012024-12-21T07:40:49.642ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 464.231622ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2022024-12-21T07:40:50.108ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 950.279528ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2032024-12-21T07:40:51.061ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.59122815s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2042024-12-21T07:40:51.798ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2683
2052024-12-21T07:40:51.798ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2928
2062024-12-21T07:40:51.798ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2553
2072024-12-21T07:40:51.798ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2600
2082024-12-21T07:40:51.798ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3009
2092024-12-21T07:40:51.798ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3054
2102024-12-21T07:40:51.800ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2853
2112024-12-21T07:40:51.802ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2594
2122024-12-21T07:40:51.802ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='5032d219-f3bf-40f5-8e36-efba904d39be'/> <propval type="astring" name="rack_id" value='e92af880-4a9b-4c79-a3ae-829b6394cf0b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe04:1416'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='e92af880-4a9b-4c79-a3ae-829b6394cf0b'/> <propval type="astring" name="sled_id" value='fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8'/> <propval type="astring" name="rack_uuid" value='e92af880-4a9b-4c79-a3ae-829b6394cf0b'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8'/> <propval type="astring" name="rack_uuid" value='e92af880-4a9b-4c79-a3ae-829b6394cf0b'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132024-12-21T07:40:51.802ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142024-12-21T07:40:52.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 26.808988ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-12-21T07:40:52.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 135.886534ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-21T07:40:52.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 225.846294ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-21T07:40:52.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 312.014073ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-21T07:40:52.736ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.138430293s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2192024-12-21T07:40:53.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.158310632s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-21T07:40:54.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 625.567733ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-21T07:40:55.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.291309827s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-21T07:40:56.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 522.910576ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-21T07:40:56.877ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.023689562s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2242024-12-21T07:40:57.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.038169099s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-21T07:40:58.541ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/nexus.rs:527 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2262024-12-21T07:40:58.570ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272024-12-21T07:40:58.570ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2282024-12-21T07:40:58.571ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2292024-12-21T07:40:58.571ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302024-12-21T07:40:58.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312024-12-21T07:40:58.571ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322024-12-21T07:40:58.572ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-21T07:40:58.572ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342024-12-21T07:40:58.572ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352024-12-21T07:40:58.572ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3962
2362024-12-21T07:40:58.572ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:51871
2372024-12-21T07:40:58.748ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2382024-12-21T07:40:58.748ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-12-21T07:40:58.753ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4283 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402024-12-21T07:40:58.753ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4299
2412024-12-21T07:40:58.753ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422024-12-21T07:40:59.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40278
2432024-12-21T07:40:59.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442024-12-21T07:40:59.021ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452024-12-21T07:40:59.021ZINFOSledAgent (ServiceManager): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-21T07:40:59.021ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-21T07:40:59.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40278 req_id = 9698b871-b6fc-4005-a93d-d9e51dba269b response_code = 200 uri = /inventory
2482024-12-21T07:40:59.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48075
2492024-12-21T07:40:59.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48075 req_id = 8703ffbf-3891-4e69-a46e-9e27a36ac992 response_code = 200 uri = /sled-role
2502024-12-21T07:40:59.090ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 6ba44795-992e-40c1-baba-97c31bf09f25 (physical_disk), pool_id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 89c6554d-c32d-4c15-b168-12d7b1128521 (physical_disk), pool_id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 98afd34c-cf7c-4491-b8ea-844f7971b6eb (physical_disk), pool_id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4f51a74c-500b-42b2-b22c-ea6109c01eca (physical_disk), pool_id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b2d18f57-72d7-48a2-a551-088fb2a92606 (physical_disk), pool_id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 2ea3338e-bc3a-4520-a1db-53e2ba4b586a (physical_disk), pool_id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4c8e8e6a-4527-4e67-8a94-249a52d827b8 (physical_disk), pool_id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b2d85d22-9a6f-4119-8d58-be2b5c309c51 (physical_disk), pool_id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 87b363a8-9a09-4a6d-ae68-2f1a568eaa30 (physical_disk), pool_id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2512024-12-21T07:40:59.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50023
2522024-12-21T07:40:59.090ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2532024-12-21T07:40:59.090ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 6ba44795-992e-40c1-baba-97c31bf09f25 (physical_disk), pool_id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 89c6554d-c32d-4c15-b168-12d7b1128521 (physical_disk), pool_id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 98afd34c-cf7c-4491-b8ea-844f7971b6eb (physical_disk), pool_id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4f51a74c-500b-42b2-b22c-ea6109c01eca (physical_disk), pool_id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: b2d18f57-72d7-48a2-a551-088fb2a92606 (physical_disk), pool_id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 2ea3338e-bc3a-4520-a1db-53e2ba4b586a (physical_disk), pool_id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 4c8e8e6a-4527-4e67-8a94-249a52d827b8 (physical_disk), pool_id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b2d85d22-9a6f-4119-8d58-be2b5c309c51 (physical_disk), pool_id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 87b363a8-9a09-4a6d-ae68-2f1a568eaa30 (physical_disk), pool_id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2542024-12-21T07:40:59.090ZINFOSledAgent (StorageManager): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-21T07:40:59.090ZINFOSledAgent (StorageManager): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-21T07:40:59.090ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2572024-12-21T07:40:59.090ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2582024-12-21T07:40:59.090ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2592024-12-21T07:40:59.090ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2602024-12-21T07:40:59.090ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2612024-12-21T07:40:59.206ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2622024-12-21T07:40:59.213ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632024-12-21T07:40:59.213ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool)
2642024-12-21T07:40:59.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16320947476623976589 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2652024-12-21T07:40:59.275ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 550342150322993620 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2662024-12-21T07:40:59.325ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }
2672024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-21T07:40:59.333ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742024-12-21T07:40:59.374ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752024-12-21T07:40:59.382ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone file = sled-storage/src/dataset.rs:302
2762024-12-21T07:40:59.553ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62 file = sled-storage/src/dataset.rs:388
2772024-12-21T07:40:59.561ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782024-12-21T07:40:59.561ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792024-12-21T07:40:59.561ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802024-12-21T07:40:59.561ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812024-12-21T07:40:59.561ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822024-12-21T07:40:59.571ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832024-12-21T07:40:59.571ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool)
2842024-12-21T07:40:59.688ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }
2852024-12-21T07:40:59.695ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862024-12-21T07:40:59.695ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872024-12-21T07:40:59.695ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882024-12-21T07:40:59.695ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892024-12-21T07:40:59.695ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-12-21T07:40:59.696ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-21T07:40:59.696ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922024-12-21T07:40:59.735ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932024-12-21T07:40:59.739ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
2942024-12-21T07:40:59.743ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone file = sled-storage/src/dataset.rs:302
2952024-12-21T07:40:59.913ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_54c8850c-5a87-4b82-9026-6ccf6d846961 file = sled-storage/src/dataset.rs:388
2962024-12-21T07:40:59.920ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-21T07:40:59.920ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-21T07:40:59.920ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-21T07:40:59.920ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-21T07:40:59.920ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-21T07:40:59.930ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-21T07:40:59.930ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 45666343-e064-4cc6-881c-0d53aea79e05 (zpool)
3032024-12-21T07:41:00.038ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }
3042024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-21T07:41:00.046ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112024-12-21T07:41:00.087ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-21T07:41:00.095ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone file = sled-storage/src/dataset.rs:302
3132024-12-21T07:41:00.266ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_45666343-e064-4cc6-881c-0d53aea79e05 file = sled-storage/src/dataset.rs:388
3142024-12-21T07:41:00.274ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152024-12-21T07:41:00.274ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162024-12-21T07:41:00.274ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172024-12-21T07:41:00.274ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182024-12-21T07:41:00.274ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192024-12-21T07:41:00.284ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202024-12-21T07:41:00.284ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool)
3212024-12-21T07:41:00.390ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }
3222024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-21T07:41:00.397ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292024-12-21T07:41:00.442ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302024-12-21T07:41:00.450ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone file = sled-storage/src/dataset.rs:302
3312024-12-21T07:41:00.617ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5 file = sled-storage/src/dataset.rs:388
3322024-12-21T07:41:00.624ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332024-12-21T07:41:00.624ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342024-12-21T07:41:00.624ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352024-12-21T07:41:00.624ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362024-12-21T07:41:00.624ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372024-12-21T07:41:00.635ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382024-12-21T07:41:00.635ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool)
3392024-12-21T07:41:00.742ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }
3402024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-21T07:41:00.751ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472024-12-21T07:41:00.755ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3482024-12-21T07:41:00.796ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492024-12-21T07:41:00.804ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone file = sled-storage/src/dataset.rs:302
3502024-12-21T07:41:00.905ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.762508532s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
3512024-12-21T07:41:00.974ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a file = sled-storage/src/dataset.rs:388
3522024-12-21T07:41:00.982ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-21T07:41:00.982ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-21T07:41:00.982ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-21T07:41:00.982ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-21T07:41:00.982ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-21T07:41:00.992ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-21T07:41:00.992ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f16a4591-8357-4fd5-b354-0deda45e4488 (zpool)
3592024-12-21T07:41:01.105ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }
3602024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-21T07:41:01.113ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672024-12-21T07:41:01.156ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-21T07:41:01.163ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone file = sled-storage/src/dataset.rs:302
3692024-12-21T07:41:01.330ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f16a4591-8357-4fd5-b354-0deda45e4488 file = sled-storage/src/dataset.rs:388
3702024-12-21T07:41:01.338ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-21T07:41:01.338ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-21T07:41:01.338ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-21T07:41:01.338ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-21T07:41:01.338ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-21T07:41:01.349ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-21T07:41:01.349ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool)
3772024-12-21T07:41:01.477ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }
3782024-12-21T07:41:01.487ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792024-12-21T07:41:01.487ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802024-12-21T07:41:01.487ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812024-12-21T07:41:01.487ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822024-12-21T07:41:01.487ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-21T07:41:01.490ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-21T07:41:01.490ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852024-12-21T07:41:01.535ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-12-21T07:41:01.543ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone file = sled-storage/src/dataset.rs:302
3872024-12-21T07:41:01.713ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87 file = sled-storage/src/dataset.rs:388
3882024-12-21T07:41:01.721ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892024-12-21T07:41:01.721ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902024-12-21T07:41:01.721ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912024-12-21T07:41:01.721ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922024-12-21T07:41:01.721ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932024-12-21T07:41:01.732ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942024-12-21T07:41:01.732ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool)
3952024-12-21T07:41:01.854ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }
3962024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-21T07:41:01.863ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032024-12-21T07:41:01.867ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4042024-12-21T07:41:01.904ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-21T07:41:01.912ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone file = sled-storage/src/dataset.rs:302
4062024-12-21T07:41:02.107ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83 file = sled-storage/src/dataset.rs:388
4072024-12-21T07:41:02.116ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-21T07:41:02.116ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-21T07:41:02.116ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-21T07:41:02.116ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-21T07:41:02.116ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-21T07:41:02.127ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-21T07:41:02.127ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool)
4142024-12-21T07:41:02.238ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }
4152024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-21T07:41:02.246ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222024-12-21T07:41:02.285ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-21T07:41:02.294ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone file = sled-storage/src/dataset.rs:302
4242024-12-21T07:41:02.465ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026 file = sled-storage/src/dataset.rs:388
4252024-12-21T07:41:02.473ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-21T07:41:02.473ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-21T07:41:02.473ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-21T07:41:02.473ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38e50563-d6f1-4512-81d8-478fc24b0465 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e31b4f07-f674-4ea7-9881-8af97296ef9c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-21T07:41:02.473ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-21T07:41:02.473ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-21T07:41:02.474ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-21T07:41:02.474ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4332024-12-21T07:41:02.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342024-12-21T07:41:02.474ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4352024-12-21T07:41:02.474ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4362024-12-21T07:41:02.474ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4372024-12-21T07:41:02.474ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4382024-12-21T07:41:02.474ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4392024-12-21T07:41:02.474ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-21T07:41:02.474ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4412024-12-21T07:41:02.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3384081 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50023 req_id = 8f8aaa90-8cea-4c1e-ab96-7fb9cc0798a7 response_code = 200 uri = /omicron-physical-disks
4422024-12-21T07:41:02.506ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {07f343f4-cec2-4c53-87fd-a034a4345680 (dataset): DatasetConfig { id: 07f343f4-cec2-4c53-87fd-a034a4345680 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e8a5eb8-001d-4275-9070-77f1f94a85a0 (dataset): DatasetConfig { id: 0e8a5eb8-001d-4275-9070-77f1f94a85a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 101863fa-2316-4d53-9e39-06707aa27823 (dataset): DatasetConfig { id: 101863fa-2316-4d53-9e39-06707aa27823 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 106f8a7d-55db-4a34-be06-e144380cb537 (dataset): DatasetConfig { id: 106f8a7d-55db-4a34-be06-e144380cb537 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 10d6b370-657d-46af-9dcd-02dfc3d6f670 (dataset): DatasetConfig { id: 10d6b370-657d-46af-9dcd-02dfc3d6f670 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1841fba7-d584-456c-9111-84dead2e74be (dataset): DatasetConfig { id: 1841fba7-d584-456c-9111-84dead2e74be (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18bccb88-34cd-4d9c-bcba-67865c9d5ee5 (dataset): DatasetConfig { id: 18bccb88-34cd-4d9c-bcba-67865c9d5ee5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a0f0bc0-bba4-4b77-90e1-95e5cda5df95 (dataset): DatasetConfig { id: 1a0f0bc0-bba4-4b77-90e1-95e5cda5df95 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b019a4d-f687-425b-a517-74bc3b55b8f6 (dataset): DatasetConfig { id: 1b019a4d-f687-425b-a517-74bc3b55b8f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2244e034-d48f-4be0-8266-c4e8502f6092 (dataset): DatasetConfig { id: 2244e034-d48f-4be0-8266-c4e8502f6092 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25a6dd5b-cea7-4fb5-b004-44df0dbf31ad (dataset): DatasetConfig { id: 25a6dd5b-cea7-4fb5-b004-44df0dbf31ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b65458-0b06-4a8b-a5b3-8619bc45ef90 (dataset): DatasetConfig { id: 29b65458-0b06-4a8b-a5b3-8619bc45ef90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30dd9c52-04f8-4a13-87d6-cadd01f39450 (dataset): DatasetConfig { id: 30dd9c52-04f8-4a13-87d6-cadd01f39450 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3196b49f-4974-47d9-8583-9333ad573722 (dataset): DatasetConfig { id: 3196b49f-4974-47d9-8583-9333ad573722 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 372b92ce-5d4f-4353-b0ba-b10d02aa0914 (dataset): DatasetConfig { id: 372b92ce-5d4f-4353-b0ba-b10d02aa0914 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 372fa8a4-0f3f-4d5c-b7bb-147f47c51e83 (dataset): DatasetConfig { id: 372fa8a4-0f3f-4d5c-b7bb-147f47c51e83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4390d70b-a255-4bcb-8628-7799633417e8 (dataset): DatasetConfig { id: 4390d70b-a255-4bcb-8628-7799633417e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43ff066a-bd41-4fa1-991e-8e668d748300 (dataset): DatasetConfig { id: 43ff066a-bd41-4fa1-991e-8e668d748300 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47e0d132-9557-4bae-9da5-cfd90b54fbb8 (dataset): DatasetConfig { id: 47e0d132-9557-4bae-9da5-cfd90b54fbb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fcd6513-acb2-4fef-a08d-2b9fb626912e (dataset): DatasetConfig { id: 4fcd6513-acb2-4fef-a08d-2b9fb626912e (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d723c9-98ca-4e6b-aa7a-faa5a913fdfa (dataset): DatasetConfig { id: 51d723c9-98ca-4e6b-aa7a-faa5a913fdfa (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57f1e4d8-e395-4dc1-bda3-62a4696c0501 (dataset): DatasetConfig { id: 57f1e4d8-e395-4dc1-bda3-62a4696c0501 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 584a2d89-1b17-4bc9-9661-0465062c0dd8 (dataset): DatasetConfig { id: 584a2d89-1b17-4bc9-9661-0465062c0dd8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ab27345-7eb5-466b-9ed3-82e8fe32d064 (dataset): DatasetConfig { id: 5ab27345-7eb5-466b-9ed3-82e8fe32d064 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ab7b163-d4bb-45c7-8555-4a4d8e8a1de0 (dataset): DatasetConfig { id: 5ab7b163-d4bb-45c7-8555-4a4d8e8a1de0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bc43fcb-3c85-4748-acc0-f8f0fe75be37 (dataset): DatasetConfig { id: 5bc43fcb-3c85-4748-acc0-f8f0fe75be37 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5da1457a-c92d-4b99-859e-31e02fb01264 (dataset): DatasetConfig { id: 5da1457a-c92d-4b99-859e-31e02fb01264 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6450b0f8-92c8-45bf-9bce-24fc620d18e8 (dataset): DatasetConfig { id: 6450b0f8-92c8-45bf-9bce-24fc620d18e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66700725-0e78-40bc-8afb-43c9422ee420 (dataset): DatasetConfig { id: 66700725-0e78-40bc-8afb-43c9422ee420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66bcaa99-d009-4e6e-b324-09158039c472 (dataset): DatasetConfig { id: 66bcaa99-d009-4e6e-b324-09158039c472 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bf34127-211d-4394-a9f1-916a8711aa73 (dataset): DatasetConfig { id: 6bf34127-211d-4394-a9f1-916a8711aa73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 724c02e5-11eb-4375-8078-1677b83ab04c (dataset): DatasetConfig { id: 724c02e5-11eb-4375-8078-1677b83ab04c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7dc3dfcb-f3c4-4941-a108-33c0b04cb055 (dataset): DatasetConfig { id: 7dc3dfcb-f3c4-4941-a108-33c0b04cb055 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e722694-7cd1-4afe-ac7c-d8d95034ea85 (dataset): DatasetConfig { id: 7e722694-7cd1-4afe-ac7c-d8d95034ea85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83afdf8e-326d-4a83-9685-76e714f07a0f (dataset): DatasetConfig { id: 83afdf8e-326d-4a83-9685-76e714f07a0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8485ba9c-46a3-432c-ba25-5a393c2a879c (dataset): DatasetConfig { id: 8485ba9c-46a3-432c-ba25-5a393c2a879c (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9516aca0-5dbe-469d-bc2b-e0714d407490 (dataset): DatasetConfig { id: 9516aca0-5dbe-469d-bc2b-e0714d407490 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9b7e9c7a-8a54-4f2c-b56e-21b90e5d22b3 (dataset): DatasetConfig { id: 9b7e9c7a-8a54-4f2c-b56e-21b90e5d22b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c9a2d0c-58b2-4362-9067-76f202f10bc4 (dataset): DatasetConfig { id: 9c9a2d0c-58b2-4362-9067-76f202f10bc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ff70af6-34ab-4a20-be1a-e8ce3eb9c9ab (dataset): DatasetConfig { id: 9ff70af6-34ab-4a20-be1a-e8ce3eb9c9ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fff10fe-5650-4145-aec9-3839e238cc52 (dataset): DatasetConfig { id: 9fff10fe-5650-4145-aec9-3839e238cc52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac653bf2-bd1e-4b74-b05e-38554f29ef70 (dataset): DatasetConfig { id: ac653bf2-bd1e-4b74-b05e-38554f29ef70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae33988a-5ab8-4f7e-ab39-977360acb3be (dataset): DatasetConfig { id: ae33988a-5ab8-4f7e-ab39-977360acb3be (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9d7ebf3-6d59-4d89-be23-f446008452ba (dataset): DatasetConfig { id: b9d7ebf3-6d59-4d89-be23-f446008452ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baf34b5d-00d0-4f0b-85dd-0e4fda3b26f8 (dataset): DatasetConfig { id: baf34b5d-00d0-4f0b-85dd-0e4fda3b26f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc0f768e-7296-4886-8da9-340c962abc7e (dataset): DatasetConfig { id: bc0f768e-7296-4886-8da9-340c962abc7e (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0639252-da0d-4505-8acf-22a77daebb78 (dataset): DatasetConfig { id: c0639252-da0d-4505-8acf-22a77daebb78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1d73b74-d7eb-4db2-93e8-064c852aef53 (dataset): DatasetConfig { id: c1d73b74-d7eb-4db2-93e8-064c852aef53 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c27a99a0-3013-4008-bac6-64449c899103 (dataset): DatasetConfig { id: c27a99a0-3013-4008-bac6-64449c899103 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c377df75-7794-4991-b70e-149bc8f293fc (dataset): DatasetConfig { id: c377df75-7794-4991-b70e-149bc8f293fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9d0ebf0-dc88-413f-ab6f-7975c3e3f9db (dataset): DatasetConfig { id: c9d0ebf0-dc88-413f-ab6f-7975c3e3f9db (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc613cfb-3234-40d5-962c-31bd4a29d180 (dataset): DatasetConfig { id: cc613cfb-3234-40d5-962c-31bd4a29d180 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1d5b6f6-15f5-4d66-945c-5423be87d183 (dataset): DatasetConfig { id: d1d5b6f6-15f5-4d66-945c-5423be87d183 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4c2dd1c-2b8c-419f-8768-29c9cae1f4fe (dataset): DatasetConfig { id: d4c2dd1c-2b8c-419f-8768-29c9cae1f4fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d7a81597-9eae-4d2b-a1f3-751946d53767 (dataset): DatasetConfig { id: d7a81597-9eae-4d2b-a1f3-751946d53767 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e22582de-faea-48cc-9d1b-a61e5df89d7a (dataset): DatasetConfig { id: e22582de-faea-48cc-9d1b-a61e5df89d7a (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5171bdc-4585-4588-9d7b-42948025eb1e (dataset): DatasetConfig { id: e5171bdc-4585-4588-9d7b-42948025eb1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6343897-626c-4de7-953a-23dc5939b22b (dataset): DatasetConfig { id: e6343897-626c-4de7-953a-23dc5939b22b (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e74935a8-ac68-4784-aefa-ab8f056c0cc0 (dataset): DatasetConfig { id: e74935a8-ac68-4784-aefa-ab8f056c0cc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8b972f3-f83a-4121-a993-4b4402dc5cc3 (dataset): DatasetConfig { id: e8b972f3-f83a-4121-a993-4b4402dc5cc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed8a713c-8906-49cb-8bbe-091ea875fa3f (dataset): DatasetConfig { id: ed8a713c-8906-49cb-8bbe-091ea875fa3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0a6d4a6-df60-4800-bd42-df342b767a04 (dataset): DatasetConfig { id: f0a6d4a6-df60-4800-bd42-df342b767a04 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1ff0431-30c0-42b3-8013-e1b19c083c29 (dataset): DatasetConfig { id: f1ff0431-30c0-42b3-8013-e1b19c083c29 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb3d0696-99fa-4d0c-8779-c1996c570608 (dataset): DatasetConfig { id: fb3d0696-99fa-4d0c-8779-c1996c570608 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd46f258-e56c-4e65-839a-649e269d3900 (dataset): DatasetConfig { id: fd46f258-e56c-4e65-839a-649e269d3900 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feeb6706-506b-4717-858a-87b33fe21c86 (dataset): DatasetConfig { id: feeb6706-506b-4717-858a-87b33fe21c86 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-21T07:41:02.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37105
4442024-12-21T07:41:02.506ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4452024-12-21T07:41:02.507ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {07f343f4-cec2-4c53-87fd-a034a4345680 (dataset): DatasetConfig { id: 07f343f4-cec2-4c53-87fd-a034a4345680 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0e8a5eb8-001d-4275-9070-77f1f94a85a0 (dataset): DatasetConfig { id: 0e8a5eb8-001d-4275-9070-77f1f94a85a0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 101863fa-2316-4d53-9e39-06707aa27823 (dataset): DatasetConfig { id: 101863fa-2316-4d53-9e39-06707aa27823 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 106f8a7d-55db-4a34-be06-e144380cb537 (dataset): DatasetConfig { id: 106f8a7d-55db-4a34-be06-e144380cb537 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 10d6b370-657d-46af-9dcd-02dfc3d6f670 (dataset): DatasetConfig { id: 10d6b370-657d-46af-9dcd-02dfc3d6f670 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1841fba7-d584-456c-9111-84dead2e74be (dataset): DatasetConfig { id: 1841fba7-d584-456c-9111-84dead2e74be (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18bccb88-34cd-4d9c-bcba-67865c9d5ee5 (dataset): DatasetConfig { id: 18bccb88-34cd-4d9c-bcba-67865c9d5ee5 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a0f0bc0-bba4-4b77-90e1-95e5cda5df95 (dataset): DatasetConfig { id: 1a0f0bc0-bba4-4b77-90e1-95e5cda5df95 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b019a4d-f687-425b-a517-74bc3b55b8f6 (dataset): DatasetConfig { id: 1b019a4d-f687-425b-a517-74bc3b55b8f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2244e034-d48f-4be0-8266-c4e8502f6092 (dataset): DatasetConfig { id: 2244e034-d48f-4be0-8266-c4e8502f6092 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25a6dd5b-cea7-4fb5-b004-44df0dbf31ad (dataset): DatasetConfig { id: 25a6dd5b-cea7-4fb5-b004-44df0dbf31ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29b65458-0b06-4a8b-a5b3-8619bc45ef90 (dataset): DatasetConfig { id: 29b65458-0b06-4a8b-a5b3-8619bc45ef90 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30dd9c52-04f8-4a13-87d6-cadd01f39450 (dataset): DatasetConfig { id: 30dd9c52-04f8-4a13-87d6-cadd01f39450 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3196b49f-4974-47d9-8583-9333ad573722 (dataset): DatasetConfig { id: 3196b49f-4974-47d9-8583-9333ad573722 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 372b92ce-5d4f-4353-b0ba-b10d02aa0914 (dataset): DatasetConfig { id: 372b92ce-5d4f-4353-b0ba-b10d02aa0914 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 372fa8a4-0f3f-4d5c-b7bb-147f47c51e83 (dataset): DatasetConfig { id: 372fa8a4-0f3f-4d5c-b7bb-147f47c51e83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4390d70b-a255-4bcb-8628-7799633417e8 (dataset): DatasetConfig { id: 4390d70b-a255-4bcb-8628-7799633417e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43ff066a-bd41-4fa1-991e-8e668d748300 (dataset): DatasetConfig { id: 43ff066a-bd41-4fa1-991e-8e668d748300 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 47e0d132-9557-4bae-9da5-cfd90b54fbb8 (dataset): DatasetConfig { id: 47e0d132-9557-4bae-9da5-cfd90b54fbb8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fcd6513-acb2-4fef-a08d-2b9fb626912e (dataset): DatasetConfig { id: 4fcd6513-acb2-4fef-a08d-2b9fb626912e (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51d723c9-98ca-4e6b-aa7a-faa5a913fdfa (dataset): DatasetConfig { id: 51d723c9-98ca-4e6b-aa7a-faa5a913fdfa (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 57f1e4d8-e395-4dc1-bda3-62a4696c0501 (dataset): DatasetConfig { id: 57f1e4d8-e395-4dc1-bda3-62a4696c0501 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 584a2d89-1b17-4bc9-9661-0465062c0dd8 (dataset): DatasetConfig { id: 584a2d89-1b17-4bc9-9661-0465062c0dd8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ab27345-7eb5-466b-9ed3-82e8fe32d064 (dataset): DatasetConfig { id: 5ab27345-7eb5-466b-9ed3-82e8fe32d064 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5ab7b163-d4bb-45c7-8555-4a4d8e8a1de0 (dataset): DatasetConfig { id: 5ab7b163-d4bb-45c7-8555-4a4d8e8a1de0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bc43fcb-3c85-4748-acc0-f8f0fe75be37 (dataset): DatasetConfig { id: 5bc43fcb-3c85-4748-acc0-f8f0fe75be37 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5da1457a-c92d-4b99-859e-31e02fb01264 (dataset): DatasetConfig { id: 5da1457a-c92d-4b99-859e-31e02fb01264 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6450b0f8-92c8-45bf-9bce-24fc620d18e8 (dataset): DatasetConfig { id: 6450b0f8-92c8-45bf-9bce-24fc620d18e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66700725-0e78-40bc-8afb-43c9422ee420 (dataset): DatasetConfig { id: 66700725-0e78-40bc-8afb-43c9422ee420 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66bcaa99-d009-4e6e-b324-09158039c472 (dataset): DatasetConfig { id: 66bcaa99-d009-4e6e-b324-09158039c472 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bf34127-211d-4394-a9f1-916a8711aa73 (dataset): DatasetConfig { id: 6bf34127-211d-4394-a9f1-916a8711aa73 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 724c02e5-11eb-4375-8078-1677b83ab04c (dataset): DatasetConfig { id: 724c02e5-11eb-4375-8078-1677b83ab04c (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7dc3dfcb-f3c4-4941-a108-33c0b04cb055 (dataset): DatasetConfig { id: 7dc3dfcb-f3c4-4941-a108-33c0b04cb055 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e722694-7cd1-4afe-ac7c-d8d95034ea85 (dataset): DatasetConfig { id: 7e722694-7cd1-4afe-ac7c-d8d95034ea85 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83afdf8e-326d-4a83-9685-76e714f07a0f (dataset): DatasetConfig { id: 83afdf8e-326d-4a83-9685-76e714f07a0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8485ba9c-46a3-432c-ba25-5a393c2a879c (dataset): DatasetConfig { id: 8485ba9c-46a3-432c-ba25-5a393c2a879c (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9516aca0-5dbe-469d-bc2b-e0714d407490 (dataset): DatasetConfig { id: 9516aca0-5dbe-469d-bc2b-e0714d407490 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9b7e9c7a-8a54-4f2c-b56e-21b90e5d22b3 (dataset): DatasetConfig { id: 9b7e9c7a-8a54-4f2c-b56e-21b90e5d22b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c9a2d0c-58b2-4362-9067-76f202f10bc4 (dataset): DatasetConfig { id: 9c9a2d0c-58b2-4362-9067-76f202f10bc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ff70af6-34ab-4a20-be1a-e8ce3eb9c9ab (dataset): DatasetConfig { id: 9ff70af6-34ab-4a20-be1a-e8ce3eb9c9ab (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fff10fe-5650-4145-aec9-3839e238cc52 (dataset): DatasetConfig { id: 9fff10fe-5650-4145-aec9-3839e238cc52 (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac653bf2-bd1e-4b74-b05e-38554f29ef70 (dataset): DatasetConfig { id: ac653bf2-bd1e-4b74-b05e-38554f29ef70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ae33988a-5ab8-4f7e-ab39-977360acb3be (dataset): DatasetConfig { id: ae33988a-5ab8-4f7e-ab39-977360acb3be (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9d7ebf3-6d59-4d89-be23-f446008452ba (dataset): DatasetConfig { id: b9d7ebf3-6d59-4d89-be23-f446008452ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, baf34b5d-00d0-4f0b-85dd-0e4fda3b26f8 (dataset): DatasetConfig { id: baf34b5d-00d0-4f0b-85dd-0e4fda3b26f8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc0f768e-7296-4886-8da9-340c962abc7e (dataset): DatasetConfig { id: bc0f768e-7296-4886-8da9-340c962abc7e (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0639252-da0d-4505-8acf-22a77daebb78 (dataset): DatasetConfig { id: c0639252-da0d-4505-8acf-22a77daebb78 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c1d73b74-d7eb-4db2-93e8-064c852aef53 (dataset): DatasetConfig { id: c1d73b74-d7eb-4db2-93e8-064c852aef53 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c27a99a0-3013-4008-bac6-64449c899103 (dataset): DatasetConfig { id: c27a99a0-3013-4008-bac6-64449c899103 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c377df75-7794-4991-b70e-149bc8f293fc (dataset): DatasetConfig { id: c377df75-7794-4991-b70e-149bc8f293fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9d0ebf0-dc88-413f-ab6f-7975c3e3f9db (dataset): DatasetConfig { id: c9d0ebf0-dc88-413f-ab6f-7975c3e3f9db (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc613cfb-3234-40d5-962c-31bd4a29d180 (dataset): DatasetConfig { id: cc613cfb-3234-40d5-962c-31bd4a29d180 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1d5b6f6-15f5-4d66-945c-5423be87d183 (dataset): DatasetConfig { id: d1d5b6f6-15f5-4d66-945c-5423be87d183 (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4c2dd1c-2b8c-419f-8768-29c9cae1f4fe (dataset): DatasetConfig { id: d4c2dd1c-2b8c-419f-8768-29c9cae1f4fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d7a81597-9eae-4d2b-a1f3-751946d53767 (dataset): DatasetConfig { id: d7a81597-9eae-4d2b-a1f3-751946d53767 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e22582de-faea-48cc-9d1b-a61e5df89d7a (dataset): DatasetConfig { id: e22582de-faea-48cc-9d1b-a61e5df89d7a (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e5171bdc-4585-4588-9d7b-42948025eb1e (dataset): DatasetConfig { id: e5171bdc-4585-4588-9d7b-42948025eb1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6343897-626c-4de7-953a-23dc5939b22b (dataset): DatasetConfig { id: e6343897-626c-4de7-953a-23dc5939b22b (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e74935a8-ac68-4784-aefa-ab8f056c0cc0 (dataset): DatasetConfig { id: e74935a8-ac68-4784-aefa-ab8f056c0cc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e8b972f3-f83a-4121-a993-4b4402dc5cc3 (dataset): DatasetConfig { id: e8b972f3-f83a-4121-a993-4b4402dc5cc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed8a713c-8906-49cb-8bbe-091ea875fa3f (dataset): DatasetConfig { id: ed8a713c-8906-49cb-8bbe-091ea875fa3f (dataset), name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0a6d4a6-df60-4800-bd42-df342b767a04 (dataset): DatasetConfig { id: f0a6d4a6-df60-4800-bd42-df342b767a04 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f1ff0431-30c0-42b3-8013-e1b19c083c29 (dataset): DatasetConfig { id: f1ff0431-30c0-42b3-8013-e1b19c083c29 (dataset), name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb3d0696-99fa-4d0c-8779-c1996c570608 (dataset): DatasetConfig { id: fb3d0696-99fa-4d0c-8779-c1996c570608 (dataset), name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fd46f258-e56c-4e65-839a-649e269d3900 (dataset): DatasetConfig { id: fd46f258-e56c-4e65-839a-649e269d3900 (dataset), name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, feeb6706-506b-4717-858a-87b33fe21c86 (dataset): DatasetConfig { id: feeb6706-506b-4717-858a-87b33fe21c86 (dataset), name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462024-12-21T07:41:02.507ZINFOSledAgent (StorageManager): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-21T07:41:02.507ZINFOSledAgent (StorageManager): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-21T07:41:02.507ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492024-12-21T07:41:02.522ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502024-12-21T07:41:02.522ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4512024-12-21T07:41:02.522ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f16a4591-8357-4fd5-b354-0deda45e4488/crypt/debug"), full_name: "oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crypt/debug" } file = sled-storage/src/manager.rs:1431
4522024-12-21T07:41:02.559ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532024-12-21T07:41:02.559ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542024-12-21T07:41:02.559ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone/oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone/oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7" } file = sled-storage/src/manager.rs:1431
4552024-12-21T07:41:02.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562024-12-21T07:41:02.632ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572024-12-21T07:41:02.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crucible" } file = sled-storage/src/manager.rs:1431
4582024-12-21T07:41:02.693ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592024-12-21T07:41:02.693ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4602024-12-21T07:41:02.693ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/debug"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/debug" } file = sled-storage/src/manager.rs:1431
4612024-12-21T07:41:02.730ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622024-12-21T07:41:02.730ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632024-12-21T07:41:02.730ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone/oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone/oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88" } file = sled-storage/src/manager.rs:1431
4642024-12-21T07:41:02.803ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652024-12-21T07:41:02.803ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662024-12-21T07:41:02.803ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4672024-12-21T07:41:02.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682024-12-21T07:41:02.866ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4692024-12-21T07:41:02.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/debug"), full_name: "oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/debug" } file = sled-storage/src/manager.rs:1431
4702024-12-21T07:41:02.870ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
4712024-12-21T07:41:02.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722024-12-21T07:41:02.904ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732024-12-21T07:41:02.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone/oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12"), full_name: "oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone/oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12" } file = sled-storage/src/manager.rs:1431
4742024-12-21T07:41:02.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752024-12-21T07:41:02.976ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762024-12-21T07:41:02.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone/oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec"), full_name: "oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone/oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec" } file = sled-storage/src/manager.rs:1431
4772024-12-21T07:41:03.051ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782024-12-21T07:41:03.051ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792024-12-21T07:41:03.051ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4802024-12-21T07:41:03.120ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812024-12-21T07:41:03.120ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822024-12-21T07:41:03.120ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crucible" } file = sled-storage/src/manager.rs:1431
4832024-12-21T07:41:03.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842024-12-21T07:41:03.185ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852024-12-21T07:41:03.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crucible" } file = sled-storage/src/manager.rs:1431
4862024-12-21T07:41:03.250ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872024-12-21T07:41:03.250ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882024-12-21T07:41:03.250ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4892024-12-21T07:41:03.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902024-12-21T07:41:03.317ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4912024-12-21T07:41:03.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone"), full_name: "oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone" } file = sled-storage/src/manager.rs:1431
4922024-12-21T07:41:03.354ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932024-12-21T07:41:03.354ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942024-12-21T07:41:03.354ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7" } file = sled-storage/src/manager.rs:1431
4952024-12-21T07:41:03.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962024-12-21T07:41:03.431ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972024-12-21T07:41:03.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone/oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone/oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee" } file = sled-storage/src/manager.rs:1431
4982024-12-21T07:41:03.504ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992024-12-21T07:41:03.504ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5002024-12-21T07:41:03.504ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone"), full_name: "oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5012024-12-21T07:41:03.542ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022024-12-21T07:41:03.542ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032024-12-21T07:41:03.542ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone/oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87"), full_name: "oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone/oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87" } file = sled-storage/src/manager.rs:1431
5042024-12-21T07:41:03.616ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052024-12-21T07:41:03.616ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062024-12-21T07:41:03.616ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone/oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98"), full_name: "oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone/oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98" } file = sled-storage/src/manager.rs:1431
5072024-12-21T07:41:03.694ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082024-12-21T07:41:03.694ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092024-12-21T07:41:03.694ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone/oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone/oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17" } file = sled-storage/src/manager.rs:1431
5102024-12-21T07:41:03.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112024-12-21T07:41:03.770ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122024-12-21T07:41:03.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone/oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4"), full_name: "oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/zone/oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4" } file = sled-storage/src/manager.rs:1431
5132024-12-21T07:41:03.844ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142024-12-21T07:41:03.844ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5152024-12-21T07:41:03.844ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/debug"), full_name: "oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/debug" } file = sled-storage/src/manager.rs:1431
5162024-12-21T07:41:03.872ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
5172024-12-21T07:41:03.881ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182024-12-21T07:41:03.881ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192024-12-21T07:41:03.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5202024-12-21T07:41:03.949ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212024-12-21T07:41:03.949ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5222024-12-21T07:41:03.949ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone"), full_name: "oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone" } file = sled-storage/src/manager.rs:1431
5232024-12-21T07:41:03.990ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242024-12-21T07:41:03.990ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252024-12-21T07:41:03.990ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5262024-12-21T07:41:04.056ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272024-12-21T07:41:04.056ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282024-12-21T07:41:04.056ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone/oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda"), full_name: "oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone/oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda" } file = sled-storage/src/manager.rs:1431
5292024-12-21T07:41:04.128ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302024-12-21T07:41:04.128ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312024-12-21T07:41:04.128ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0" } file = sled-storage/src/manager.rs:1431
5322024-12-21T07:41:04.206ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332024-12-21T07:41:04.206ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342024-12-21T07:41:04.206ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5352024-12-21T07:41:04.270ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362024-12-21T07:41:04.270ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372024-12-21T07:41:04.270ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone/oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone/oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3" } file = sled-storage/src/manager.rs:1431
5382024-12-21T07:41:04.345ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392024-12-21T07:41:04.345ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402024-12-21T07:41:04.345ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2" } file = sled-storage/src/manager.rs:1431
5412024-12-21T07:41:04.419ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422024-12-21T07:41:04.419ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5432024-12-21T07:41:04.419ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/debug"), full_name: "oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/debug" } file = sled-storage/src/manager.rs:1431
5442024-12-21T07:41:04.460ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452024-12-21T07:41:04.460ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462024-12-21T07:41:04.460ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone/oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759"), full_name: "oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone/oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759" } file = sled-storage/src/manager.rs:1431
5472024-12-21T07:41:04.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482024-12-21T07:41:04.531ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492024-12-21T07:41:04.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/zone" } file = sled-storage/src/manager.rs:1431
5502024-12-21T07:41:04.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512024-12-21T07:41:04.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522024-12-21T07:41:04.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b" } file = sled-storage/src/manager.rs:1431
5532024-12-21T07:41:04.643ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542024-12-21T07:41:04.643ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552024-12-21T07:41:04.643ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084" } file = sled-storage/src/manager.rs:1431
5562024-12-21T07:41:04.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572024-12-21T07:41:04.720ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582024-12-21T07:41:04.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5592024-12-21T07:41:04.788ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602024-12-21T07:41:04.788ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5612024-12-21T07:41:04.788ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45666343-e064-4cc6-881c-0d53aea79e05/crypt/debug"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/debug" } file = sled-storage/src/manager.rs:1431
5622024-12-21T07:41:04.830ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632024-12-21T07:41:04.830ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642024-12-21T07:41:04.830ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550" } file = sled-storage/src/manager.rs:1431
5652024-12-21T07:41:04.874ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
5662024-12-21T07:41:04.906ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672024-12-21T07:41:04.906ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682024-12-21T07:41:04.906ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone/oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6"), full_name: "oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/zone/oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6" } file = sled-storage/src/manager.rs:1431
5692024-12-21T07:41:04.985ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702024-12-21T07:41:04.986ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712024-12-21T07:41:04.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49" } file = sled-storage/src/manager.rs:1431
5722024-12-21T07:41:05.061ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732024-12-21T07:41:05.061ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742024-12-21T07:41:05.061ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone/oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015" } file = sled-storage/src/manager.rs:1431
5752024-12-21T07:41:05.136ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762024-12-21T07:41:05.136ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5772024-12-21T07:41:05.136ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone" } file = sled-storage/src/manager.rs:1431
5782024-12-21T07:41:05.176ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-21T07:41:05.176ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802024-12-21T07:41:05.176ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a" } file = sled-storage/src/manager.rs:1431
5812024-12-21T07:41:05.254ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822024-12-21T07:41:05.254ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832024-12-21T07:41:05.254ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5842024-12-21T07:41:05.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852024-12-21T07:41:05.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862024-12-21T07:41:05.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone/oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc"), full_name: "oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone/oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc" } file = sled-storage/src/manager.rs:1431
5872024-12-21T07:41:05.400ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882024-12-21T07:41:05.400ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892024-12-21T07:41:05.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone/oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5"), full_name: "oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone/oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5" } file = sled-storage/src/manager.rs:1431
5902024-12-21T07:41:05.478ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912024-12-21T07:41:05.478ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922024-12-21T07:41:05.478ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5932024-12-21T07:41:05.552ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942024-12-21T07:41:05.552ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5952024-12-21T07:41:05.552ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/debug"), full_name: "oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/debug" } file = sled-storage/src/manager.rs:1431
5962024-12-21T07:41:05.598ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972024-12-21T07:41:05.598ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5982024-12-21T07:41:05.598ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/debug"), full_name: "oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/debug" } file = sled-storage/src/manager.rs:1431
5992024-12-21T07:41:05.645ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002024-12-21T07:41:05.645ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012024-12-21T07:41:05.645ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6022024-12-21T07:41:05.721ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032024-12-21T07:41:05.721ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6042024-12-21T07:41:05.721ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone" } file = sled-storage/src/manager.rs:1431
6052024-12-21T07:41:05.764ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062024-12-21T07:41:05.764ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6072024-12-21T07:41:05.764ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone"), full_name: "oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/zone" } file = sled-storage/src/manager.rs:1431
6082024-12-21T07:41:05.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092024-12-21T07:41:05.797ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102024-12-21T07:41:05.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6112024-12-21T07:41:05.851ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122024-12-21T07:41:05.851ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6132024-12-21T07:41:05.851ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/debug"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/debug" } file = sled-storage/src/manager.rs:1431
6142024-12-21T07:41:05.876ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6152024-12-21T07:41:05.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162024-12-21T07:41:05.891ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172024-12-21T07:41:05.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible" } file = sled-storage/src/manager.rs:1431
6182024-12-21T07:41:05.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192024-12-21T07:41:05.955ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202024-12-21T07:41:05.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone/oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d"), full_name: "oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/zone/oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d" } file = sled-storage/src/manager.rs:1431
6212024-12-21T07:41:06.023ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222024-12-21T07:41:06.023ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232024-12-21T07:41:06.023ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1"), full_name: "oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/zone/oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1" } file = sled-storage/src/manager.rs:1431
6242024-12-21T07:41:06.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252024-12-21T07:41:06.094ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6262024-12-21T07:41:06.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone"), full_name: "oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone" } file = sled-storage/src/manager.rs:1431
6272024-12-21T07:41:06.136ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282024-12-21T07:41:06.136ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292024-12-21T07:41:06.136ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crucible" } file = sled-storage/src/manager.rs:1431
6302024-12-21T07:41:06.206ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312024-12-21T07:41:06.206ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322024-12-21T07:41:06.206ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone/oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89"), full_name: "oxp_45666343-e064-4cc6-881c-0d53aea79e05/crypt/zone/oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89" } file = sled-storage/src/manager.rs:1431
6332024-12-21T07:41:06.279ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342024-12-21T07:41:06.279ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6352024-12-21T07:41:06.279ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone"), full_name: "oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/zone" } file = sled-storage/src/manager.rs:1431
6362024-12-21T07:41:06.320ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372024-12-21T07:41:06.320ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382024-12-21T07:41:06.320ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone/oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537"), full_name: "oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crypt/zone/oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537" } file = sled-storage/src/manager.rs:1431
6392024-12-21T07:41:06.391ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402024-12-21T07:41:06.391ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412024-12-21T07:41:06.391ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crucible" } file = sled-storage/src/manager.rs:1431
6422024-12-21T07:41:06.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432024-12-21T07:41:06.455ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442024-12-21T07:41:06.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crucible" } file = sled-storage/src/manager.rs:1431
6452024-12-21T07:41:06.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462024-12-21T07:41:06.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472024-12-21T07:41:06.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crucible" } file = sled-storage/src/manager.rs:1431
6482024-12-21T07:41:06.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492024-12-21T07:41:06.581ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502024-12-21T07:41:06.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crucible" } file = sled-storage/src/manager.rs:1431
6512024-12-21T07:41:06.644ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522024-12-21T07:41:06.644ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532024-12-21T07:41:06.645ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6542024-12-21T07:41:06.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4138688 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37105 req_id = 61bdd27a-8778-4634-957e-8aeea21e0a4b response_code = 200 uri = /datasets
6552024-12-21T07:41:06.676ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7c426166-4f75-4a87-b9ac-c0d590aea49b (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6bfae345-1659-4377-bca9-c55abec2aeb7 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ea9fa927-131c-4a8f-87ef-b16050c734e7 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6562024-12-21T07:41:06.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61361
6572024-12-21T07:41:06.677ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582024-12-21T07:41:06.677ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592024-12-21T07:41:06.686ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602024-12-21T07:41:06.686ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612024-12-21T07:41:06.694ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622024-12-21T07:41:06.694ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632024-12-21T07:41:06.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642024-12-21T07:41:06.704ZINFOSledAgent (ServiceManager): No ledger in /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:188
6652024-12-21T07:41:06.704ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-12-21T07:41:06.704ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672024-12-21T07:41:06.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-21T07:41:06.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-21T07:41:06.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-21T07:41:06.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7 file = illumos-utils/src/zone.rs:325
6712024-12-21T07:41:06.805ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7 file = illumos-utils/src/zone.rs:325
6722024-12-21T07:41:06.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b file = illumos-utils/src/zone.rs:325
6732024-12-21T07:41:06.821ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7 file = illumos-utils/src/zone.rs:363
6742024-12-21T07:41:06.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7 file = illumos-utils/src/zone.rs:363
6752024-12-21T07:41:06.829ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b file = illumos-utils/src/zone.rs:363
6762024-12-21T07:41:06.878ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6772024-12-21T07:41:07.881ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8) file = sled-agent/src/probe_manager.rs:231 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
6782024-12-21T07:41:08.017ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4307
6792024-12-21T07:41:08.017ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4317 gateway = fd00:1122:3344:101::1
6802024-12-21T07:41:08.023ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4331 gateway = fd00:1122:3344:101::1
6812024-12-21T07:41:08.023ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4396
6822024-12-21T07:41:08.166ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4462
6832024-12-21T07:41:08.166ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4489
6842024-12-21T07:41:08.202ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4502
6852024-12-21T07:41:08.202ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4348
6862024-12-21T07:41:08.252ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4390
6872024-12-21T07:41:08.252ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4469 rack_subnet = fd00:1122:3344::
6882024-12-21T07:41:08.271ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4480
6892024-12-21T07:41:08.271ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4522
6902024-12-21T07:41:08.338ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4554
6912024-12-21T07:41:08.338ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4560
6922024-12-21T07:41:08.425ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4601
6932024-12-21T07:41:08.425ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6942024-12-21T07:41:08.445ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6952024-12-21T07:41:08.445ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6962024-12-21T07:41:08.445ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
6972024-12-21T07:41:08.474ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6982024-12-21T07:41:08.505ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6992024-12-21T07:41:08.505ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7002024-12-21T07:41:08.506ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7012024-12-21T07:41:08.506ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7022024-12-21T07:41:08.542ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12848765616885474704 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7032024-12-21T07:41:08.542ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11615114659759073333 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7042024-12-21T07:41:08.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
7052024-12-21T07:41:08.595ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7062024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7072024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7082024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7092024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7102024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7112024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7122024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7132024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7142024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7152024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7162024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7172024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7182024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7192024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7202024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7212024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7222024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7232024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7242024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7252024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7262024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7272024-12-21T07:41:08.595ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7282024-12-21T07:41:08.929ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7292024-12-21T07:41:08.930ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7302024-12-21T07:41:09.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16320947476623976589 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7312024-12-21T07:41:09.278ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 550342150322993620 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
7322024-12-21T07:41:09.411ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7332024-12-21T07:41:09.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 28.531979ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7342024-12-21T07:41:09.419ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7352024-12-21T07:41:09.423ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7362024-12-21T07:41:09.423ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7372024-12-21T07:41:09.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 148.561945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7382024-12-21T07:41:09.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 41.307861ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7392024-12-21T07:41:09.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 65.101863ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7402024-12-21T07:41:09.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 133.865169ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7412024-12-21T07:41:09.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 196.224454ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7422024-12-21T07:41:09.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 112.167768ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7432024-12-21T07:41:09.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 276.905121ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7442024-12-21T07:41:09.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 461.739829ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7452024-12-21T07:41:09.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 156.804496ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7462024-12-21T07:41:10.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 202.721923ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7472024-12-21T07:41:10.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 278.266969ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7482024-12-21T07:41:10.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 795.501632ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7492024-12-21T07:41:10.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 565.914522ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7502024-12-21T07:41:10.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 803.926243ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7512024-12-21T07:41:10.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 574.850215ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7522024-12-21T07:41:11.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 732.70037ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7532024-12-21T07:41:11.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 1.063044994s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7542024-12-21T07:41:11.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 1.24468854s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7552024-12-21T07:41:11.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 1.199091217s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7562024-12-21T07:41:12.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 894.599641ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7572024-12-21T07:41:12.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 982.097348ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7582024-12-21T07:41:13.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 943.871812ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7592024-12-21T07:41:13.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 997.691211ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7602024-12-21T07:41:13.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7") failed: Property not found. retry in 1.253933162s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7612024-12-21T07:41:14.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7") failed: Property not found. retry in 958.364529ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7622024-12-21T07:41:14.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b") failed: Property not found. retry in 1.210024486s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7632024-12-21T07:41:15.490ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_ea9fa927-131c-4a8f-87ef-b16050c734e7
7642024-12-21T07:41:15.490ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_6bfae345-1659-4377-bca9-c55abec2aeb7
7652024-12-21T07:41:15.490ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_internal_dns_7c426166-4f75-4a87-b9ac-c0d590aea49b
7662024-12-21T07:41:15.490ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-12-21T07:41:15.491ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-12-21T07:41:15.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8814410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61361 req_id = 6a15c46e-80e9-49c0-9006-f4b7047dc9ac response_code = 204 uri = /omicron-zones
7692024-12-21T07:41:15.493ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702024-12-21T07:41:15.832ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 115.797666ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712024-12-21T07:41:15.973ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722024-12-21T07:41:16.033ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732024-12-21T07:41:16.088ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742024-12-21T07:41:16.088ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752024-12-21T07:41:16.119ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762024-12-21T07:41:16.120ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772024-12-21T07:41:16.120ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782024-12-21T07:41:16.149ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7c426166-4f75-4a87-b9ac-c0d590aea49b (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6bfae345-1659-4377-bca9-c55abec2aeb7 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ea9fa927-131c-4a8f-87ef-b16050c734e7 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 358ae4ef-45d8-4ee2-a644-f757269c9015 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6daa1b2e-7c5a-4239-881f-64e0bd5a2218, kind: Service { id: 358ae4ef-45d8-4ee2-a644-f757269c9015 }, name: Name("ntp-358ae4ef-45d8-4ee2-a644-f757269c9015"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792024-12-21T07:41:16.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42045
7802024-12-21T07:41:16.150ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812024-12-21T07:41:16.150ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822024-12-21T07:41:16.160ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-21T07:41:16.161ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-21T07:41:16.170ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-21T07:41:16.170ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-21T07:41:16.181ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872024-12-21T07:41:16.181ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
7882024-12-21T07:41:16.181ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
7892024-12-21T07:41:16.181ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902024-12-21T07:41:16.192ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7912024-12-21T07:41:16.224ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7922024-12-21T07:41:16.226ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7932024-12-21T07:41:16.226ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7942024-12-21T07:41:16.256ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 207, 136]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7952024-12-21T07:41:16.256ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7962024-12-21T07:41:16.257ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7972024-12-21T07:41:16.257ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7982024-12-21T07:41:16.257ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7992024-12-21T07:41:16.258ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8002024-12-21T07:41:16.281ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015 file = illumos-utils/src/zone.rs:325
8012024-12-21T07:41:16.300ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015 file = illumos-utils/src/zone.rs:363
8022024-12-21T07:41:16.914ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8032024-12-21T07:41:16.914ZINFOSledAgent (ServiceManager): Booting oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8042024-12-21T07:41:17.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 38.873945ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8052024-12-21T07:41:17.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 100.637516ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8062024-12-21T07:41:17.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 163.295896ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8072024-12-21T07:41:17.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 499.687644ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8082024-12-21T07:41:17.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 699.903255ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8092024-12-21T07:41:18.543ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12848765616885474704 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8102024-12-21T07:41:18.543ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11615114659759073333 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8112024-12-21T07:41:18.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 773.761078ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8122024-12-21T07:41:19.279ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16320947476623976589 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8132024-12-21T07:41:19.279ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 550342150322993620 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8142024-12-21T07:41:19.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 872.986105ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8152024-12-21T07:41:20.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 820.463546ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8162024-12-21T07:41:21.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015") failed: Property not found. retry in 1.486247674s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8172024-12-21T07:41:22.607ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015
8182024-12-21T07:41:22.607ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8192024-12-21T07:41:22.608ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202024-12-21T07:41:22.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6458342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42045 req_id = 081d9aad-b5ac-4745-b4a4-aa568c7b764b response_code = 204 uri = /omicron-zones
8212024-12-21T07:41:22.610ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8222024-12-21T07:41:22.639ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8232024-12-21T07:41:22.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38517
8242024-12-21T07:41:22.648ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8252024-12-21T07:41:22.648ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38517 req_id = 06b5c0c0-02e8-4118-aff9-68379e5fb091 response_code = 500 uri = /timesync
8262024-12-21T07:41:22.650ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8272024-12-21T07:41:22.777ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8282024-12-21T07:41:22.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33439
8292024-12-21T07:41:25.075ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13414437965709075501 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8302024-12-21T07:41:25.079ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8784104206848179590 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8312024-12-21T07:41:25.493ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16750760443636445800 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8322024-12-21T07:41:26.786ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8332024-12-21T07:41:26.786ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33439 req_id = 961f53df-472e-4744-a433-ff74cdefb239 response_code = 500 uri = /timesync
8342024-12-21T07:41:26.788ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8352024-12-21T07:41:26.968ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8362024-12-21T07:41:26.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45442
8372024-12-21T07:41:26.976ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8382024-12-21T07:41:26.976ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45442 req_id = a4a94720-ffd2-4055-ac7f-7a77df034954 response_code = 500 uri = /timesync
8392024-12-21T07:41:26.979ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8402024-12-21T07:41:27.202ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412024-12-21T07:41:27.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37586
8422024-12-21T07:41:27.211ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_358ae4ef-45d8-4ee2-a644-f757269c9015': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3915
8432024-12-21T07:41:27.211ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8735 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37586 req_id = b7a0ed82-e09d-4f7a-a4b7-ba175cec1b55 response_code = 500 uri = /timesync
8442024-12-21T07:41:27.212ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452024-12-21T07:41:27.492ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8462024-12-21T07:41:27.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45784
8472024-12-21T07:41:28.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1009324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45784 req_id = 0d8474e4-21a0-4dd4-bdf1-e2a5953704b3 response_code = 200 uri = /timesync
8482024-12-21T07:41:28.503ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8492024-12-21T07:41:28.503ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8502024-12-21T07:41:28.546ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12848765616885474704 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8512024-12-21T07:41:28.546ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11615114659759073333 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8522024-12-21T07:41:28.664ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8532024-12-21T07:41:28.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44133
8542024-12-21T07:41:28.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44133 req_id = ee31defe-a643-477c-825d-1f566cf8e34a response_code = 200 uri = /timesync
8552024-12-21T07:41:28.674ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8562024-12-21T07:41:28.674ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8572024-12-21T07:41:29.029ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582024-12-21T07:41:29.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50014
8592024-12-21T07:41:29.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8482 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50014 req_id = 42ba10e3-72a8-4b41-b8e0-5c9888ab793a response_code = 200 uri = /timesync
8602024-12-21T07:41:29.040ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8612024-12-21T07:41:29.040ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622024-12-21T07:41:29.282ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16320947476623976589 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8632024-12-21T07:41:29.282ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 550342150322993620 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
8642024-12-21T07:41:29.401ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8652024-12-21T07:41:29.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64840
8662024-12-21T07:41:29.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8560 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64840 req_id = 1bf63fa5-deb3-4e47-9ba6-a60e8e5dbc3b response_code = 200 uri = /timesync
8672024-12-21T07:41:29.414ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8682024-12-21T07:41:29.414ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8692024-12-21T07:41:29.692ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8702024-12-21T07:41:29.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36291
8712024-12-21T07:41:29.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7608 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36291 req_id = 21338c53-e86b-4460-87fe-0ed5f010b206 response_code = 200 uri = /timesync
8722024-12-21T07:41:29.704ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734766889.5398042, correction: 0.057264853 } file = sled-agent/src/rack_setup/service.rs:743
8732024-12-21T07:41:29.704ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8742024-12-21T07:41:30.165ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8752024-12-21T07:41:30.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52893
8762024-12-21T07:41:30.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52893 req_id = aaae449c-3074-43f2-9e1b-81bb735e77cd response_code = 200 uri = /timesync
8772024-12-21T07:41:30.174ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734766888.0810137, correction: 0.055989221 } file = sled-agent/src/rack_setup/service.rs:743
8782024-12-21T07:41:30.174ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8792024-12-21T07:41:30.905ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8802024-12-21T07:41:30.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41978
8812024-12-21T07:41:30.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8446 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41978 req_id = 5a3a2c72-6484-4e4b-92e4-d75c457a38f3 response_code = 200 uri = /timesync
8822024-12-21T07:41:30.915ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734766888.0810137, correction: 0.054011721 } file = sled-agent/src/rack_setup/service.rs:743
8832024-12-21T07:41:30.915ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8842024-12-21T07:41:31.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8852024-12-21T07:41:31.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34552
8862024-12-21T07:41:31.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7929 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34552 req_id = 438f80c9-6724-43b0-8a17-3fbf8b7e07e6 response_code = 200 uri = /timesync
8872024-12-21T07:41:31.496ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734766888.0810137, correction: 0.052442756 } file = sled-agent/src/rack_setup/service.rs:743
8882024-12-21T07:41:31.496ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8892024-12-21T07:41:32.589ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902024-12-21T07:41:32.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37559
8912024-12-21T07:41:32.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37559 req_id = 3401eb30-63f6-4f5e-b555-02283ea39b8c response_code = 200 uri = /timesync
8922024-12-21T07:41:32.613ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2728380539, ip_addr: 162.159.200.123, stratum: 4, ref_time: 1734766892.132022, correction: 0.049817108 } file = sled-agent/src/rack_setup/service.rs:743
8932024-12-21T07:41:32.613ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8942024-12-21T07:41:32.644ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7c426166-4f75-4a87-b9ac-c0d590aea49b (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6bfae345-1659-4377-bca9-c55abec2aeb7 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ea9fa927-131c-4a8f-87ef-b16050c734e7 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 358ae4ef-45d8-4ee2-a644-f757269c9015 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6daa1b2e-7c5a-4239-881f-64e0bd5a2218, kind: Service { id: 358ae4ef-45d8-4ee2-a644-f757269c9015 }, name: Name("ntp-358ae4ef-45d8-4ee2-a644-f757269c9015"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 10834ad5-ac3a-49f0-b9ca-7223fb0705c1 (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } } } }, OmicronZoneConfig { id: b505f4dc-c153-4394-923d-446ec4211550 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } } } }, OmicronZoneConfig { id: 488e56d5-6075-4027-af35-6135314b2c89 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } } } }, OmicronZoneConfig { id: 88fee475-a668-47b3-b9f2-f3eedf4d3aee (service), filesystem_pool: Some(ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: c2672fd3-ded0-496d-87b5-7806539a9a12 (service), filesystem_pool: Some(ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8952024-12-21T07:41:32.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33185
8962024-12-21T07:41:32.644ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8972024-12-21T07:41:32.644ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8982024-12-21T07:41:32.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8992024-12-21T07:41:32.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9002024-12-21T07:41:32.665ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9012024-12-21T07:41:32.665ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9022024-12-21T07:41:32.675ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9032024-12-21T07:41:32.675ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9042024-12-21T07:41:32.684ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9052024-12-21T07:41:32.684ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9062024-12-21T07:41:32.693ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9072024-12-21T07:41:32.693ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9082024-12-21T07:41:32.702ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9092024-12-21T07:41:32.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9102024-12-21T07:41:32.710ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9112024-12-21T07:41:32.710ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9122024-12-21T07:41:32.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9132024-12-21T07:41:32.720ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
9142024-12-21T07:41:32.720ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
9152024-12-21T07:41:32.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9162024-12-21T07:41:32.802ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9172024-12-21T07:41:32.802ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9182024-12-21T07:41:32.802ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9192024-12-21T07:41:32.802ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202024-12-21T07:41:32.802ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9212024-12-21T07:41:32.893ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89 file = illumos-utils/src/zone.rs:325
9222024-12-21T07:41:32.897ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 file = illumos-utils/src/zone.rs:325
9232024-12-21T07:41:32.901ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee file = illumos-utils/src/zone.rs:325
9242024-12-21T07:41:32.906ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550 file = illumos-utils/src/zone.rs:325
9252024-12-21T07:41:32.911ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12 file = illumos-utils/src/zone.rs:325
9262024-12-21T07:41:32.915ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89 file = illumos-utils/src/zone.rs:363
9272024-12-21T07:41:32.920ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 file = illumos-utils/src/zone.rs:363
9282024-12-21T07:41:32.924ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee file = illumos-utils/src/zone.rs:363
9292024-12-21T07:41:32.929ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550 file = illumos-utils/src/zone.rs:363
9302024-12-21T07:41:32.933ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12 file = illumos-utils/src/zone.rs:363
9312024-12-21T07:41:34.879ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 196.101726ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
9322024-12-21T07:41:35.932ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='88fee475-a668-47b3-b9f2-f3eedf4d3aee'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9332024-12-21T07:41:35.932ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9342024-12-21T07:41:36.005ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c2672fd3-ded0-496d-87b5-7806539a9a12'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9352024-12-21T07:41:36.005ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9362024-12-21T07:41:36.022ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='10834ad5-ac3a-49f0-b9ca-7223fb0705c1'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9372024-12-21T07:41:36.022ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b505f4dc-c153-4394-923d-446ec4211550'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9382024-12-21T07:41:36.022ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='488e56d5-6075-4027-af35-6135314b2c89'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9392024-12-21T07:41:36.022ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9402024-12-21T07:41:36.035ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9412024-12-21T07:41:36.047ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9422024-12-21T07:41:36.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 26.311036ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9432024-12-21T07:41:36.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 25.44855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9442024-12-21T07:41:36.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 48.793232ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9452024-12-21T07:41:36.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 76.528692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9462024-12-21T07:41:36.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 44.33918ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9472024-12-21T07:41:36.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 146.55959ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9482024-12-21T07:41:36.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 55.271746ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9492024-12-21T07:41:36.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 130.410026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9502024-12-21T07:41:36.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 76.742074ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9512024-12-21T07:41:37.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 130.287593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9522024-12-21T07:41:37.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 194.158098ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9532024-12-21T07:41:37.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 237.504073ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9542024-12-21T07:41:37.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 298.92585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9552024-12-21T07:41:37.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 290.055282ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9562024-12-21T07:41:37.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 218.905619ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9572024-12-21T07:41:37.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 272.791564ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9582024-12-21T07:41:37.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 405.101249ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9592024-12-21T07:41:37.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 557.313881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9602024-12-21T07:41:37.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 225.817615ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9612024-12-21T07:41:37.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 351.789903ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9622024-12-21T07:41:37.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 910.955116ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9632024-12-21T07:41:37.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 683.391389ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9642024-12-21T07:41:37.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 644.681926ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9652024-12-21T07:41:37.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 961.576315ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9662024-12-21T07:41:38.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 518.608922ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9672024-12-21T07:41:38.264ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43062
9682024-12-21T07:41:38.264ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43062 req_id = 01837bb7-b97b-4479-af9e-876905908f85 response_code = 200 uri = /baseboard
9692024-12-21T07:41:38.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 800.172253ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9702024-12-21T07:41:38.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 1.1808207s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9712024-12-21T07:41:38.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.252769645s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9722024-12-21T07:41:38.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 1.312856478s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9732024-12-21T07:41:38.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 1.401455743s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9742024-12-21T07:41:39.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 1.015761559s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9752024-12-21T07:41:39.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 869.090842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9762024-12-21T07:41:39.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.002088469s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9772024-12-21T07:41:39.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 1.413044367s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9782024-12-21T07:41:40.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 1.271887521s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9792024-12-21T07:41:40.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 1.052308077s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9802024-12-21T07:41:40.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 1.232116754s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9812024-12-21T07:41:40.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 747.060589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9822024-12-21T07:41:41.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 757.262996ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9832024-12-21T07:41:41.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 1.335700948s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9842024-12-21T07:41:41.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 1.487244126s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9852024-12-21T07:41:41.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 685.897134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9862024-12-21T07:41:41.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 1.11461553s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9872024-12-21T07:41:42.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 1.281985221s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9882024-12-21T07:41:42.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.229446354s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9892024-12-21T07:41:42.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 632.312902ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9902024-12-21T07:41:42.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 642.955552ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9912024-12-21T07:41:43.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 508.191507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9922024-12-21T07:41:43.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 734.322678ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9932024-12-21T07:41:43.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 1.189836422s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
9942024-12-21T07:41:43.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.099070897s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
9952024-12-21T07:41:43.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 773.19311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9962024-12-21T07:41:43.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 1.49509206s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
9972024-12-21T07:41:44.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 1.038962152s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
9982024-12-21T07:41:44.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 1.372035799s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
9992024-12-21T07:41:44.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 703.600969ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
10002024-12-21T07:41:44.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 506.937867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
10012024-12-21T07:41:45.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 1.393453502s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
10022024-12-21T07:41:45.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 692.474242ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
10032024-12-21T07:41:45.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.239083706s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
10042024-12-21T07:41:45.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 713.917858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
10052024-12-21T07:41:45.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 1.168215913s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
10062024-12-21T07:41:45.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 959.860382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
10072024-12-21T07:41:46.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 1.279629205s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
10082024-12-21T07:41:46.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.463878187s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
10092024-12-21T07:41:46.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 1.27303429s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
10102024-12-21T07:41:46.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 1.022262525s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
10112024-12-21T07:41:46.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 1.385193519s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
10122024-12-21T07:41:47.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 790.966496ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
10132024-12-21T07:41:47.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 546.325349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
10142024-12-21T07:41:47.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550") failed: Property not found. retry in 1.364640847s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
10152024-12-21T07:41:47.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89") failed: Property not found. retry in 1.461789279s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
10162024-12-21T07:41:48.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1") failed: Property not found. retry in 843.772209ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
10172024-12-21T07:41:48.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12") failed: Property not found. retry in 755.737937ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
10182024-12-21T07:41:48.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee") failed: Property not found. retry in 710.640322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
10192024-12-21T07:41:49.408ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_488e56d5-6075-4027-af35-6135314b2c89
10202024-12-21T07:41:49.408ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1
10212024-12-21T07:41:49.408ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_88fee475-a668-47b3-b9f2-f3eedf4d3aee
10222024-12-21T07:41:49.408ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_b505f4dc-c153-4394-923d-446ec4211550
10232024-12-21T07:41:49.408ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_cockroachdb_c2672fd3-ded0-496d-87b5-7806539a9a12
10242024-12-21T07:41:49.408ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10252024-12-21T07:41:49.409ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10262024-12-21T07:41:49.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16717701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33185 req_id = 6f46c897-9c81-4315-85a4-e83d081902c2 response_code = 204 uri = /omicron-zones
10272024-12-21T07:41:49.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63032
10282024-12-21T07:41:49.475ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 31773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = 7529706c-aa5e-43d2-bc6e-b33b3d3bf8e6 response_code = 500 uri = /cockroachdb
10292024-12-21T07:41:49.475ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7529706c-aa5e-43d2-bc6e-b33b3d3bf8e6", "content-length": "124", "date": "Sat, 21 Dec 2024 07:41:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7529706c-aa5e-43d2-bc6e-b33b3d3bf8e6" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 130.516485ms
10302024-12-21T07:41:49.637ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = fb144a9c-6c63-4c88-9a32-05d004bef574 response_code = 500 uri = /cockroachdb
10312024-12-21T07:41:49.638ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fb144a9c-6c63-4c88-9a32-05d004bef574", "content-length": "124", "date": "Sat, 21 Dec 2024 07:41:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fb144a9c-6c63-4c88-9a32-05d004bef574" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 86.311412ms
10322024-12-21T07:41:49.753ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27238 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = a4d5d6fe-2fe0-4d43-88c0-c2a1617389eb response_code = 500 uri = /cockroachdb
10332024-12-21T07:41:49.753ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a4d5d6fe-2fe0-4d43-88c0-c2a1617389eb", "content-length": "124", "date": "Sat, 21 Dec 2024 07:41:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a4d5d6fe-2fe0-4d43-88c0-c2a1617389eb" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 99.373838ms
10342024-12-21T07:41:49.882ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28657 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = 0abdc921-5728-40ea-bd6b-c9936f3c9165 response_code = 500 uri = /cockroachdb
10352024-12-21T07:41:49.882ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0abdc921-5728-40ea-bd6b-c9936f3c9165", "content-length": "124", "date": "Sat, 21 Dec 2024 07:41:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0abdc921-5728-40ea-bd6b-c9936f3c9165" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 121.059356ms
10362024-12-21T07:41:50.031ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = b5bf0142-cb24-40c1-aaf6-7a97be90116c response_code = 500 uri = /cockroachdb
10372024-12-21T07:41:50.031ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b5bf0142-cb24-40c1-aaf6-7a97be90116c", "content-length": "124", "date": "Sat, 21 Dec 2024 07:41:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b5bf0142-cb24-40c1-aaf6-7a97be90116c" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 263.643343ms
10382024-12-21T07:41:50.151ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 330.470183ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
10392024-12-21T07:41:50.322ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_10834ad5-ac3a-49f0-b9ca-7223fb0705c1 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = b5a7f6c7-984e-4fd7-a1a1-82188d992c97 response_code = 500 uri = /cockroachdb
10402024-12-21T07:41:50.322ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b5a7f6c7-984e-4fd7-a1a1-82188d992c97", "content-length": "124", "date": "Sat, 21 Dec 2024 07:41:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b5a7f6c7-984e-4fd7-a1a1-82188d992c97" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 362.531294ms
10412024-12-21T07:41:50.719ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3758
10422024-12-21T07:42:08.497ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3776
10432024-12-21T07:42:20.400ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3799
10442024-12-21T07:42:20.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29715370 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = c7661fb1-9cad-43c4-ac9f-f17128be6d5a response_code = 204 uri = /cockroachdb
10452024-12-21T07:42:20.405ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52804
10462024-12-21T07:42:20.406ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52804 req_id = 816d6e2f-4c1e-4657-a79b-f537ecf83a34 response_code = 200 uri = /baseboard
10472024-12-21T07:42:20.417ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.020219855s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
10482024-12-21T07:42:20.450ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7c426166-4f75-4a87-b9ac-c0d590aea49b (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 6bfae345-1659-4377-bca9-c55abec2aeb7 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ea9fa927-131c-4a8f-87ef-b16050c734e7 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 358ae4ef-45d8-4ee2-a644-f757269c9015 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 6daa1b2e-7c5a-4239-881f-64e0bd5a2218, kind: Service { id: 358ae4ef-45d8-4ee2-a644-f757269c9015 }, name: Name("ntp-358ae4ef-45d8-4ee2-a644-f757269c9015"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 10834ad5-ac3a-49f0-b9ca-7223fb0705c1 (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } } } }, OmicronZoneConfig { id: b505f4dc-c153-4394-923d-446ec4211550 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } } } }, OmicronZoneConfig { id: 488e56d5-6075-4027-af35-6135314b2c89 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } } } }, OmicronZoneConfig { id: 88fee475-a668-47b3-b9f2-f3eedf4d3aee (service), filesystem_pool: Some(ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: c2672fd3-ded0-496d-87b5-7806539a9a12 (service), filesystem_pool: Some(ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External } } } }, OmicronZoneConfig { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e640ec59-1392-402a-8715-71c8bdc91537 (service), filesystem_pool: Some(ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a920b126-b55b-45c8-9984-5279bf662759 (service), filesystem_pool: Some(ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: bf6abf36-caab-412a-b734-038cee4a46b6 (service), filesystem_pool: Some(ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 782bf979-9f7a-465e-8dc9-4ac9e0c82e87 (service), filesystem_pool: Some(ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 8d2c7f84-82c9-41e0-bb8e-f16e74547ae2 (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } } } }, OmicronZoneConfig { id: aded2b24-64ef-4eb1-805b-129d5c8784cc (service), filesystem_pool: Some(ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 7e8840f0-42d8-4ef5-8e2f-6b442ca83dda (service), filesystem_pool: Some(ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 410db28a-a04b-46d1-b760-a6618c06ed88 (service), filesystem_pool: Some(ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 392e67a7-f550-4b39-b900-8b57c79b0b4a (service), filesystem_pool: Some(ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External } } } }, OmicronZoneConfig { id: a48c39d0-20f6-487a-be00-045f2e367dc0 (service), filesystem_pool: Some(ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External } } } }, OmicronZoneConfig { id: 54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3 (service), filesystem_pool: Some(ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External } } } }, OmicronZoneConfig { id: f1cf604a-7b70-480c-bdbf-3ebc7ab94a17 (service), filesystem_pool: Some(ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4345246c-4223-4b25-aee7-06d274ab05a4 (service), filesystem_pool: Some(ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External } } } }, OmicronZoneConfig { id: 3d9a1f09-e884-4dd8-9d67-2dd81b482de5 (service), filesystem_pool: Some(ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External } } } }, OmicronZoneConfig { id: 30eb190d-d472-46a8-86c2-6c7f05fb7e98 (service), filesystem_pool: Some(ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External } } } }, OmicronZoneConfig { id: 71eeaec0-de33-4f98-931a-e5bd21ba655d (service), filesystem_pool: Some(ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External } } } }, OmicronZoneConfig { id: 35bf18d0-7f09-47f1-b94d-7b9ca7619fec (service), filesystem_pool: Some(ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10492024-12-21T07:42:20.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40306
10502024-12-21T07:42:20.453ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10512024-12-21T07:42:20.453ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10522024-12-21T07:42:20.466ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10532024-12-21T07:42:20.466ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10542024-12-21T07:42:20.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10552024-12-21T07:42:20.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10562024-12-21T07:42:20.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10572024-12-21T07:42:20.487ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10582024-12-21T07:42:20.496ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10592024-12-21T07:42:20.496ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10602024-12-21T07:42:20.506ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10612024-12-21T07:42:20.506ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10622024-12-21T07:42:20.515ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10632024-12-21T07:42:20.515ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10642024-12-21T07:42:20.524ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10652024-12-21T07:42:20.524ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10662024-12-21T07:42:20.533ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10672024-12-21T07:42:20.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10682024-12-21T07:42:20.544ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10692024-12-21T07:42:20.544ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10702024-12-21T07:42:20.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10712024-12-21T07:42:20.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10722024-12-21T07:42:20.565ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10732024-12-21T07:42:20.565ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, kind: Crucible }, responder: ... }
10742024-12-21T07:42:20.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10752024-12-21T07:42:20.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, kind: Crucible }, responder: ... }
10762024-12-21T07:42:20.585ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10772024-12-21T07:42:20.585ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, kind: Crucible }, responder: ... }
10782024-12-21T07:42:20.595ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10792024-12-21T07:42:20.595ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, kind: Crucible }, responder: ... }
10802024-12-21T07:42:20.605ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10812024-12-21T07:42:20.605ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, kind: Crucible }, responder: ... }
10822024-12-21T07:42:20.614ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10832024-12-21T07:42:20.614ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, kind: Crucible }, responder: ... }
10842024-12-21T07:42:20.627ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10852024-12-21T07:42:20.627ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, kind: Crucible }, responder: ... }
10862024-12-21T07:42:20.637ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10872024-12-21T07:42:20.637ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, kind: Crucible }, responder: ... }
10882024-12-21T07:42:20.648ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10892024-12-21T07:42:20.648ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, kind: Crucible }, responder: ... }
10902024-12-21T07:42:20.661ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912024-12-21T07:42:20.662ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
10922024-12-21T07:42:20.662ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
10932024-12-21T07:42:20.662ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942024-12-21T07:42:20.784ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10952024-12-21T07:42:20.785ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10962024-12-21T07:42:20.799ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10972024-12-21T07:42:20.799ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10982024-12-21T07:42:20.801ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10992024-12-21T07:42:20.802ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11002024-12-21T07:42:20.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11012024-12-21T07:42:20.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11022024-12-21T07:42:20.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11032024-12-21T07:42:20.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11042024-12-21T07:42:20.856ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11052024-12-21T07:42:21.044ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11062024-12-21T07:42:21.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11072024-12-21T07:42:21.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11082024-12-21T07:42:21.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11092024-12-21T07:42:21.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11102024-12-21T07:42:21.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11112024-12-21T07:42:21.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11122024-12-21T07:42:21.058ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11132024-12-21T07:42:21.059ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5 file = illumos-utils/src/zone.rs:325
11142024-12-21T07:42:21.065ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc file = illumos-utils/src/zone.rs:325
11152024-12-21T07:42:21.069ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2 file = illumos-utils/src/zone.rs:325
11162024-12-21T07:42:21.074ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0 file = illumos-utils/src/zone.rs:325
11172024-12-21T07:42:21.079ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17 file = illumos-utils/src/zone.rs:325
11182024-12-21T07:42:21.084ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4 file = illumos-utils/src/zone.rs:325
11192024-12-21T07:42:21.089ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d file = illumos-utils/src/zone.rs:325
11202024-12-21T07:42:21.226ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5 file = illumos-utils/src/zone.rs:363
11212024-12-21T07:42:21.231ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc file = illumos-utils/src/zone.rs:363
11222024-12-21T07:42:21.236ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2 file = illumos-utils/src/zone.rs:363
11232024-12-21T07:42:21.241ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0 file = illumos-utils/src/zone.rs:363
11242024-12-21T07:42:21.245ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17 file = illumos-utils/src/zone.rs:363
11252024-12-21T07:42:21.249ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4 file = illumos-utils/src/zone.rs:363
11262024-12-21T07:42:21.254ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d file = illumos-utils/src/zone.rs:363
11272024-12-21T07:42:21.258ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda file = illumos-utils/src/zone.rs:325
11282024-12-21T07:42:21.263ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec file = illumos-utils/src/zone.rs:325
11292024-12-21T07:42:21.268ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3 file = illumos-utils/src/zone.rs:325
11302024-12-21T07:42:21.274ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98 file = illumos-utils/src/zone.rs:325
11312024-12-21T07:42:21.279ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88 file = illumos-utils/src/zone.rs:325
11322024-12-21T07:42:21.285ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = illumos-utils/src/zone.rs:325
11332024-12-21T07:42:21.292ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a file = illumos-utils/src/zone.rs:325
11342024-12-21T07:42:21.354ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11352024-12-21T07:42:21.355ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda file = illumos-utils/src/zone.rs:363
11362024-12-21T07:42:21.364ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec file = illumos-utils/src/zone.rs:363
11372024-12-21T07:42:21.374ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3 file = illumos-utils/src/zone.rs:363
11382024-12-21T07:42:21.381ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98 file = illumos-utils/src/zone.rs:363
11392024-12-21T07:42:21.388ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88 file = illumos-utils/src/zone.rs:363
11402024-12-21T07:42:21.399ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87 file = illumos-utils/src/zone.rs:363
11412024-12-21T07:42:21.407ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a file = illumos-utils/src/zone.rs:363
11422024-12-21T07:42:21.520ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11432024-12-21T07:42:21.717ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11442024-12-21T07:42:21.780ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11452024-12-21T07:42:21.843ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11462024-12-21T07:42:21.846ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11472024-12-21T07:42:21.846ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11482024-12-21T07:42:21.903ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 202, 32]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11492024-12-21T07:42:21.903ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11502024-12-21T07:42:21.910ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11512024-12-21T07:42:21.910ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11522024-12-21T07:42:21.967ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 219, 32]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11532024-12-21T07:42:21.967ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11542024-12-21T07:42:21.969ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11552024-12-21T07:42:21.969ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11562024-12-21T07:42:22.035ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 135, 242]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11572024-12-21T07:42:22.035ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11582024-12-21T07:42:22.036ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11592024-12-21T07:42:22.036ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11602024-12-21T07:42:22.095ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 174, 220]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11612024-12-21T07:42:22.095ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11622024-12-21T07:42:22.097ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11632024-12-21T07:42:22.097ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11642024-12-21T07:42:22.157ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 248, 195]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11652024-12-21T07:42:22.157ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11662024-12-21T07:42:22.161ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11672024-12-21T07:42:22.161ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11682024-12-21T07:42:22.162ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11692024-12-21T07:42:22.162ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11702024-12-21T07:42:22.194ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11712024-12-21T07:42:22.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11722024-12-21T07:42:22.242ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11732024-12-21T07:42:22.246ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11742024-12-21T07:42:22.246ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11752024-12-21T07:42:22.246ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11762024-12-21T07:42:22.246ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11772024-12-21T07:42:22.246ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11782024-12-21T07:42:22.246ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11792024-12-21T07:42:22.246ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11802024-12-21T07:42:22.288ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11812024-12-21T07:42:22.292ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11822024-12-21T07:42:22.295ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11832024-12-21T07:42:22.296ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11842024-12-21T07:42:22.296ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11852024-12-21T07:42:22.298ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11862024-12-21T07:42:22.299ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537 file = illumos-utils/src/zone.rs:325
11872024-12-21T07:42:22.311ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084 file = illumos-utils/src/zone.rs:325
11882024-12-21T07:42:22.453ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537 file = illumos-utils/src/zone.rs:363
11892024-12-21T07:42:22.471ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084 file = illumos-utils/src/zone.rs:363
11902024-12-21T07:42:22.492ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759 file = illumos-utils/src/zone.rs:325
11912024-12-21T07:42:22.509ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6 file = illumos-utils/src/zone.rs:325
11922024-12-21T07:42:22.521ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49 file = illumos-utils/src/zone.rs:325
11932024-12-21T07:42:22.545ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759 file = illumos-utils/src/zone.rs:363
11942024-12-21T07:42:22.563ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6 file = illumos-utils/src/zone.rs:363
11952024-12-21T07:42:22.586ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49 file = illumos-utils/src/zone.rs:363
11962024-12-21T07:42:25.660ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11972024-12-21T07:42:25.660ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
11982024-12-21T07:42:25.746ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b3aa79d0-1804-47bc-bf7a-d4e9f32437b7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992024-12-21T07:42:25.746ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='31d99e8d-c853-4fad-b310-4a6179fd5f2d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12002024-12-21T07:42:25.747ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='69d6893d-f690-4d3b-a778-66d920c50c60'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12012024-12-21T07:42:25.750ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12022024-12-21T07:42:25.784ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12032024-12-21T07:42:25.856ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5526e381-bcd9-49d4-8757-1e9025b3348f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12042024-12-21T07:42:25.856ZINFOSledAgent (ServiceManager): Booting oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12052024-12-21T07:42:25.876ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_45666343-e064-4cc6-881c-0d53aea79e05/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='90232984-40cc-479b-b5e3-32c69a5a1c57'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062024-12-21T07:42:25.914ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_54c8850c-5a87-4b82-9026-6ccf6d846961/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='58adcc66-4903-42fd-952c-705126d8dbb9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12072024-12-21T07:42:25.914ZINFOSledAgent (ServiceManager): Booting oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12082024-12-21T07:42:25.920ZINFOSledAgent (ServiceManager): Booting oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12092024-12-21T07:42:25.952ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12102024-12-21T07:42:26.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 54.070539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
12112024-12-21T07:42:26.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 60.954394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12122024-12-21T07:42:26.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 25.703196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12132024-12-21T07:42:26.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 56.171007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12142024-12-21T07:42:26.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 43.456607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12152024-12-21T07:42:26.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 65.939012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12162024-12-21T07:42:26.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 42.744377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12172024-12-21T07:42:26.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 71.875766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12182024-12-21T07:42:26.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 83.307942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
12192024-12-21T07:42:26.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 90.190505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12202024-12-21T07:42:26.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 169.303409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12212024-12-21T07:42:27.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 137.041959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12222024-12-21T07:42:27.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 110.753729ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12232024-12-21T07:42:27.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 142.913194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12242024-12-21T07:42:27.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 79.557202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12252024-12-21T07:42:27.114ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12262024-12-21T07:42:27.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 111.750642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
12272024-12-21T07:42:27.145ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='782bf979-9f7a-465e-8dc9-4ac9e0c82e87'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282024-12-21T07:42:27.145ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='75742e37-1f3a-47ec-ade6-851759886e6a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292024-12-21T07:42:27.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 208.154808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12302024-12-21T07:42:27.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 289.515563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12312024-12-21T07:42:27.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 168.860338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12322024-12-21T07:42:27.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 266.517968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12332024-12-21T07:42:27.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 198.920022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12342024-12-21T07:42:27.234ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12352024-12-21T07:42:27.244ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12362024-12-21T07:42:27.252ZINFOSledAgent (ServiceManager): Booting oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12372024-12-21T07:42:27.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 128.682749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12382024-12-21T07:42:27.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 330.92858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
12392024-12-21T07:42:27.288ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402024-12-21T07:42:27.288ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12412024-12-21T07:42:27.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 368.561587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12422024-12-21T07:42:27.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 261.329244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12432024-12-21T07:42:27.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 536.457023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12442024-12-21T07:42:27.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 562.523177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12452024-12-21T07:42:27.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 857.284369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12462024-12-21T07:42:27.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 278.328274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12472024-12-21T07:42:27.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 37.770486ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12482024-12-21T07:42:27.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 37.693527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12492024-12-21T07:42:27.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 46.666294ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12502024-12-21T07:42:27.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 129.397641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12512024-12-21T07:42:27.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 49.875409ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12522024-12-21T07:42:27.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 148.593199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12532024-12-21T07:42:27.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 92.842769ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12542024-12-21T07:42:27.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.02484984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
12552024-12-21T07:42:27.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 86.631791ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12562024-12-21T07:42:27.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 196.601643ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12572024-12-21T07:42:27.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 696.793425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12582024-12-21T07:42:27.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 725.498064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12592024-12-21T07:42:27.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.154745585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12602024-12-21T07:42:27.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 136.475575ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12612024-12-21T07:42:28.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 270.260322ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12622024-12-21T07:42:28.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 152.847003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12632024-12-21T07:42:28.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 201.851519ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12642024-12-21T07:42:28.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 552.638513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12652024-12-21T07:42:28.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 770.953314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12662024-12-21T07:42:28.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 209.900886ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12672024-12-21T07:42:28.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 397.272881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12682024-12-21T07:42:28.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 778.421763ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12692024-12-21T07:42:28.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 227.112281ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12702024-12-21T07:42:28.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 956.354644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12712024-12-21T07:42:28.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 567.575516ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12722024-12-21T07:42:28.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 586.181627ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12732024-12-21T07:42:28.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.117777123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
12742024-12-21T07:42:28.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.207553233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
12752024-12-21T07:42:28.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 808.228831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
12762024-12-21T07:42:28.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 720.4981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
12772024-12-21T07:42:28.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 600.392741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12782024-12-21T07:42:28.770ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12792024-12-21T07:42:28.775ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
12802024-12-21T07:42:28.849ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f16a4591-8357-4fd5-b354-0deda45e4488/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c9ecca0e-df91-465d-98a6-5220b0267a8d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812024-12-21T07:42:28.849ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
12822024-12-21T07:42:28.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.14024892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
12832024-12-21T07:42:28.936ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12842024-12-21T07:42:28.938ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
12852024-12-21T07:42:28.947ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862024-12-21T07:42:28.947ZINFOSledAgent (ServiceManager): Booting oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
12872024-12-21T07:42:28.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 875.500406ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
12882024-12-21T07:42:29.034ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2a541087-8b1e-46c1-a334-47fd3fe9721d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12892024-12-21T07:42:29.034ZINFOSledAgent (ServiceManager): Booting oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
12902024-12-21T07:42:29.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 36.88779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
12912024-12-21T07:42:29.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.125075144s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
12922024-12-21T07:42:29.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.362037666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
12932024-12-21T07:42:29.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 58.813116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
12942024-12-21T07:42:29.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 108.327358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
12952024-12-21T07:42:29.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.416288347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
12962024-12-21T07:42:29.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 784.949714ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
12972024-12-21T07:42:29.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.162943696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
12982024-12-21T07:42:29.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 80.040889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
12992024-12-21T07:42:29.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.268995072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
13002024-12-21T07:42:29.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 119.032058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13012024-12-21T07:42:29.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.193907687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
13022024-12-21T07:42:29.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 235.022031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13032024-12-21T07:42:29.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 27.971899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13042024-12-21T07:42:29.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 35.007094ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13052024-12-21T07:42:29.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 116.324743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13062024-12-21T07:42:29.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 440.686023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13072024-12-21T07:42:29.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 31.99371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13082024-12-21T07:42:29.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 136.17182ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13092024-12-21T07:42:29.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.390629859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
13102024-12-21T07:42:29.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 494.533766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13112024-12-21T07:42:29.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 273.46454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13122024-12-21T07:42:29.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.34697269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
13132024-12-21T07:42:29.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 88.946171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13142024-12-21T07:42:29.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.162534755s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
13152024-12-21T07:42:30.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 217.3628ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13162024-12-21T07:42:30.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.370309359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
13172024-12-21T07:42:30.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 123.729265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13182024-12-21T07:42:30.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 253.9172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13192024-12-21T07:42:30.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 1.185188037s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13202024-12-21T07:42:30.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 682.00576ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
13212024-12-21T07:42:30.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 658.42416ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
13222024-12-21T07:42:30.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 375.782851ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13232024-12-21T07:42:30.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 293.469218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13242024-12-21T07:42:30.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 410.786008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13252024-12-21T07:42:30.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.071248059s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13262024-12-21T07:42:31.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 717.707014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13272024-12-21T07:42:31.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 999.977198ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
13282024-12-21T07:42:31.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 665.428361ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13292024-12-21T07:42:31.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 611.513346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
13302024-12-21T07:42:31.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.231728643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
13312024-12-21T07:42:31.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.333890134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
13322024-12-21T07:42:31.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 770.10589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
13332024-12-21T07:42:31.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.366071722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
13342024-12-21T07:42:31.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 958.232001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13352024-12-21T07:42:31.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 723.804764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
13362024-12-21T07:42:31.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 932.77755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
13372024-12-21T07:42:31.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 587.488527ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
13382024-12-21T07:42:31.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.398857679s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
13392024-12-21T07:42:31.382ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13402024-12-21T07:42:31.382ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13412024-12-21T07:42:31.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 744.864752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13422024-12-21T07:42:31.453ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432024-12-21T07:42:31.453ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13442024-12-21T07:42:31.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.337444098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
13452024-12-21T07:42:31.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 586.472054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13462024-12-21T07:42:31.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 66.928889ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13472024-12-21T07:42:31.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 29.223934ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13482024-12-21T07:42:31.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 135.044231ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13492024-12-21T07:42:31.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.132162648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
13502024-12-21T07:42:31.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 140.004495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13512024-12-21T07:42:31.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.287730774s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13522024-12-21T07:42:31.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 605.375632ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
13532024-12-21T07:42:32.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 171.837761ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13542024-12-21T07:42:32.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 976.564819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13552024-12-21T07:42:32.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 975.035037ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
13562024-12-21T07:42:32.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 107.626989ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13572024-12-21T07:42:32.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 834.702666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
13582024-12-21T07:42:32.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.038372666s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
13592024-12-21T07:42:32.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 573.213634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13602024-12-21T07:42:32.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 589.410383ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13612024-12-21T07:42:32.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 264.322337ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13622024-12-21T07:42:32.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.483146837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
13632024-12-21T07:42:32.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 622.055178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13642024-12-21T07:42:32.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 841.798745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13652024-12-21T07:42:32.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.193957068s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13662024-12-21T07:42:32.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.204368996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
13672024-12-21T07:42:32.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 544.343613ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
13682024-12-21T07:42:32.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.308406016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
13692024-12-21T07:42:32.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.060165006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
13702024-12-21T07:42:32.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.278754282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
13712024-12-21T07:42:32.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 1.304290005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13722024-12-21T07:42:32.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 609.574629ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13732024-12-21T07:42:32.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.040115408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
13742024-12-21T07:42:32.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.313914825s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
13752024-12-21T07:42:32.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.464532621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
13762024-12-21T07:42:33.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.164567526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13772024-12-21T07:42:33.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 844.13351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
13782024-12-21T07:42:33.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.24066544s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
13792024-12-21T07:42:33.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 623.579681ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
13802024-12-21T07:42:33.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 891.964973ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
13812024-12-21T07:42:33.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 841.306873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13822024-12-21T07:42:33.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.054953622s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13832024-12-21T07:42:33.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 903.916756ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
13842024-12-21T07:42:33.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 749.942605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
13852024-12-21T07:42:33.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 893.122781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
13862024-12-21T07:42:33.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 715.079463ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
13872024-12-21T07:42:33.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.419435302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
13882024-12-21T07:42:33.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.07596158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
13892024-12-21T07:42:33.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 923.002965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
13902024-12-21T07:42:33.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.498100716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
13912024-12-21T07:42:33.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.044806291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
13922024-12-21T07:42:34.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 858.72138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
13932024-12-21T07:42:34.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 897.207083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
13942024-12-21T07:42:34.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 661.36586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
13952024-12-21T07:42:34.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.394312541s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
13962024-12-21T07:42:34.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.143393079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
13972024-12-21T07:42:34.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 731.364933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
13982024-12-21T07:42:34.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.033088168s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
13992024-12-21T07:42:34.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.169439333s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
14002024-12-21T07:42:34.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 543.468015ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
14012024-12-21T07:42:34.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 769.684875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
14022024-12-21T07:42:34.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.154621463s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
14032024-12-21T07:42:34.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 680.962599ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
14042024-12-21T07:42:34.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 737.36661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
14052024-12-21T07:42:34.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 848.88198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
14062024-12-21T07:42:34.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.088051017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
14072024-12-21T07:42:34.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.419994159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
14082024-12-21T07:42:34.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 1.44258568s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
14092024-12-21T07:42:34.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 657.050119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
14102024-12-21T07:42:35.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 865.500836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
14112024-12-21T07:42:35.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 906.264902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
14122024-12-21T07:42:35.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.33701024s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
14132024-12-21T07:42:35.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 1.106150412s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
14142024-12-21T07:42:35.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 849.252114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
14152024-12-21T07:42:35.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.208515798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
14162024-12-21T07:42:35.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 950.154376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
14172024-12-21T07:42:35.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.231548659s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
14182024-12-21T07:42:35.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 576.086724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
14192024-12-21T07:42:35.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 522.35285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
14202024-12-21T07:42:35.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.106990262s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
14212024-12-21T07:42:35.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.363036341s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
14222024-12-21T07:42:35.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.234089914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
14232024-12-21T07:42:35.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.091322462s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
14242024-12-21T07:42:35.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 761.413049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
14252024-12-21T07:42:35.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 609.127726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
14262024-12-21T07:42:35.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 535.919741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
14272024-12-21T07:42:35.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 706.800678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
14282024-12-21T07:42:35.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.137197335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
14292024-12-21T07:42:36.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.028539552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
14302024-12-21T07:42:36.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 893.196031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
14312024-12-21T07:42:36.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 769.61658ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
14322024-12-21T07:42:36.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.222295038s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
14332024-12-21T07:42:36.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.291012369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
14342024-12-21T07:42:36.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 842.82202ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
14352024-12-21T07:42:36.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 712.979803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
14362024-12-21T07:42:36.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.39062253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
14372024-12-21T07:42:36.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.010771158s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
14382024-12-21T07:42:36.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 848.659788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
14392024-12-21T07:42:36.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 1.136138177s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
14402024-12-21T07:42:36.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 528.128057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
14412024-12-21T07:42:36.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.442261638s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
14422024-12-21T07:42:36.681ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.198646805s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
14432024-12-21T07:42:36.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.280269357s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
14442024-12-21T07:42:36.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.204409401s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
14452024-12-21T07:42:36.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.037034123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
14462024-12-21T07:42:36.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.361799351s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
14472024-12-21T07:42:37.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.377551448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
14482024-12-21T07:42:37.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.120632688s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
14492024-12-21T07:42:37.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 1.072633361s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
14502024-12-21T07:42:37.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 775.89277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
14512024-12-21T07:42:37.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 1.036464465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
14522024-12-21T07:42:37.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.054598986s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
14532024-12-21T07:42:37.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 866.058651ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
14542024-12-21T07:42:37.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 932.713506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
14552024-12-21T07:42:37.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.247577888s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
14562024-12-21T07:42:37.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.124583822s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
14572024-12-21T07:42:37.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.222750186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
14582024-12-21T07:42:37.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 829.179921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
14592024-12-21T07:42:37.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 643.827865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
14602024-12-21T07:42:37.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.320550919s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
14612024-12-21T07:42:37.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 999.102969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
14622024-12-21T07:42:38.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.296682764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
14632024-12-21T07:42:38.003ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14642024-12-21T07:42:38.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.32572474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
14652024-12-21T07:42:38.022ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
14662024-12-21T07:42:38.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 734.403685ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
14672024-12-21T07:42:38.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 945.080315ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
14682024-12-21T07:42:38.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.214766479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
14692024-12-21T07:42:38.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 857.143357ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
14702024-12-21T07:42:38.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 1.438392097s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
14712024-12-21T07:42:38.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.364289907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
14722024-12-21T07:42:38.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 639.251936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
14732024-12-21T07:42:38.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 74.480154ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
14742024-12-21T07:42:38.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.443796481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
14752024-12-21T07:42:38.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 123.391667ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
14762024-12-21T07:42:38.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.219097078s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
14772024-12-21T07:42:38.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 710.024617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
14782024-12-21T07:42:38.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 667.902933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
14792024-12-21T07:42:38.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 235.115763ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
14802024-12-21T07:42:38.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.263621595s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
14812024-12-21T07:42:38.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 736.035774ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
14822024-12-21T07:42:38.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 838.144422ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
14832024-12-21T07:42:38.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.124831754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
14842024-12-21T07:42:38.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 288.167046ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
14852024-12-21T07:42:38.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.086439065s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
14862024-12-21T07:42:38.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 769.444859ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
14872024-12-21T07:42:39.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 817.868379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
14882024-12-21T07:42:39.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 864.825533ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
14892024-12-21T07:42:39.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 984.56558ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
14902024-12-21T07:42:39.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 689.070714ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
14912024-12-21T07:42:39.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.189022349s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
14922024-12-21T07:42:39.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 828.067757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
14932024-12-21T07:42:39.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 513.116602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
14942024-12-21T07:42:39.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 654.8933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
14952024-12-21T07:42:39.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 541.93945ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
14962024-12-21T07:42:39.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 711.12955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
14972024-12-21T07:42:39.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.381951608s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
14982024-12-21T07:42:39.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 735.852772ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
14992024-12-21T07:42:39.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 887.309507ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
15002024-12-21T07:42:39.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.338268584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
15012024-12-21T07:42:39.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 546.93223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
15022024-12-21T07:42:39.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 1.184213018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
15032024-12-21T07:42:39.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.071384466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
15042024-12-21T07:42:39.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 844.304476ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
15052024-12-21T07:42:39.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 836.303021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
15062024-12-21T07:42:39.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 969.02702ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
15072024-12-21T07:42:39.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 794.961312ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
15082024-12-21T07:42:40.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.088534071s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
15092024-12-21T07:42:40.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 615.653704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
15102024-12-21T07:42:40.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.423771111s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
15112024-12-21T07:42:40.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 935.252471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
15122024-12-21T07:42:40.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 591.289687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
15132024-12-21T07:42:40.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 1.306086687s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15142024-12-21T07:42:40.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.379985163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
15152024-12-21T07:42:40.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 644.27194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
15162024-12-21T07:42:40.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 1.472738714s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
15172024-12-21T07:42:40.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 1.441368113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
15182024-12-21T07:42:40.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 668.816533ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
15192024-12-21T07:42:40.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 757.110026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
15202024-12-21T07:42:40.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 1.0325917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
15212024-12-21T07:42:40.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 1.322257583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
15222024-12-21T07:42:40.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.431156477s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
15232024-12-21T07:42:40.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 797.707888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
15242024-12-21T07:42:40.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 977.322652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
15252024-12-21T07:42:40.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 746.302401ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
15262024-12-21T07:42:40.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 970.171182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
15272024-12-21T07:42:41.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 851.995726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
15282024-12-21T07:42:41.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.305598334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
15292024-12-21T07:42:41.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.284853042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
15302024-12-21T07:42:41.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 729.903981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
15312024-12-21T07:42:41.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 753.941471ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
15322024-12-21T07:42:41.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 638.70756ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
15332024-12-21T07:42:41.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.164182097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
15342024-12-21T07:42:41.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 687.535323ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
15352024-12-21T07:42:41.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 566.362127ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15362024-12-21T07:42:41.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 614.08093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
15372024-12-21T07:42:41.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 864.418015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
15382024-12-21T07:42:41.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 1.231955064s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
15392024-12-21T07:42:41.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 704.971646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
15402024-12-21T07:42:41.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 899.683133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
15412024-12-21T07:42:41.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.143119284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
15422024-12-21T07:42:41.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 1.12894253s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
15432024-12-21T07:42:41.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 1.16230183s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
15442024-12-21T07:42:41.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.116524262s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
15452024-12-21T07:42:41.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 1.226012215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
15462024-12-21T07:42:41.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 549.425008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
15472024-12-21T07:42:41.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 594.307837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
15482024-12-21T07:42:42.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 744.480344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
15492024-12-21T07:42:42.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 529.227282ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15502024-12-21T07:42:42.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 948.776068ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
15512024-12-21T07:42:42.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 940.606008ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
15522024-12-21T07:42:42.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.010901047s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
15532024-12-21T07:42:42.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 1.161026918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
15542024-12-21T07:42:42.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88") failed: Property not found. retry in 1.194031233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
15552024-12-21T07:42:42.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17") failed: Property not found. retry in 1.025575118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
15562024-12-21T07:42:42.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda") failed: Property not found. retry in 1.045545973s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
15572024-12-21T07:42:42.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 921.38134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
15582024-12-21T07:42:42.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 773.223609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
15592024-12-21T07:42:42.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.243511769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
15602024-12-21T07:42:42.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 526.272234ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15612024-12-21T07:42:42.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec") failed: Property not found. retry in 1.45532512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
15622024-12-21T07:42:42.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc") failed: Property not found. retry in 1.291008853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
15632024-12-21T07:42:42.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759") failed: Property not found. retry in 933.372805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
15642024-12-21T07:42:43.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0") failed: Property not found. retry in 1.15134555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
15652024-12-21T07:42:43.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537") failed: Property not found. retry in 841.295568ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
15662024-12-21T07:42:43.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49") failed: Property not found. retry in 1.460758219s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
15672024-12-21T07:42:43.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87") failed: Property not found. retry in 1.157234154s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
15682024-12-21T07:42:43.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084") failed: Property not found. retry in 1.074006863s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
15692024-12-21T07:42:43.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d") failed: Property not found. retry in 570.52834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
15702024-12-21T07:42:43.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6") failed: Property not found. retry in 1.456056165s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
15712024-12-21T07:42:43.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 860.841701ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15722024-12-21T07:42:43.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98") failed: Property not found. retry in 1.32165452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
15732024-12-21T07:42:43.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 529.504071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
15742024-12-21T07:42:43.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3") failed: Property not found. retry in 786.797173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
15752024-12-21T07:42:43.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5") failed: Property not found. retry in 698.139409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
15762024-12-21T07:42:43.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4") failed: Property not found. retry in 1.457072396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
15772024-12-21T07:42:43.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a") failed: Property not found. retry in 582.334049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
15782024-12-21T07:42:44.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 1.105048645s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15792024-12-21T07:42:45.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 1.124063183s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15802024-12-21T07:42:46.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 630.914453ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15812024-12-21T07:42:47.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 596.567502ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15822024-12-21T07:42:47.385ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.486483033s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
15832024-12-21T07:42:47.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2") failed: Property not found. retry in 751.503431ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15842024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_3d9a1f09-e884-4dd8-9d67-2dd81b482de5
15852024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_e640ec59-1392-402a-8715-71c8bdc91537
15862024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_aded2b24-64ef-4eb1-805b-129d5c8784cc
15872024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_b2ae004a-4c01-4dcf-8e90-49ba61c66084
15882024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_a920b126-b55b-45c8-9984-5279bf662759
15892024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_nexus_bf6abf36-caab-412a-b734-038cee4a46b6
15902024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_clickhouse_8d2c7f84-82c9-41e0-bb8e-f16e74547ae2
15912024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_a48c39d0-20f6-487a-be00-045f2e367dc0
15922024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_f1cf604a-7b70-480c-bdbf-3ebc7ab94a17
15932024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_4345246c-4223-4b25-aee7-06d274ab05a4
15942024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_71eeaec0-de33-4f98-931a-e5bd21ba655d
15952024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_7e8840f0-42d8-4ef5-8e2f-6b442ca83dda
15962024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_35bf18d0-7f09-47f1-b94d-7b9ca7619fec
15972024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_54beebc8-b7ac-49b8-a0b1-c73d0b70a7c3
15982024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_30eb190d-d472-46a8-86c2-6c7f05fb7e98
15992024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_external_dns_4dd95bbd-e009-486c-8c96-451a6e195a49
16002024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_pantry_410db28a-a04b-46d1-b760-a6618c06ed88
16012024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_oximeter_782bf979-9f7a-465e-8dc9-4ac9e0c82e87
16022024-12-21T07:42:48.440ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3325 zone = oxz_crucible_392e67a7-f550-4b39-b900-8b57c79b0b4a
16032024-12-21T07:42:48.442ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16042024-12-21T07:42:48.445ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16052024-12-21T07:42:48.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27996574 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40306 req_id = 5f00f5b3-3b16-41d9-b910-a31973970792 response_code = 204 uri = /omicron-zones
16062024-12-21T07:42:48.457ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16072024-12-21T07:42:48.471ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16082024-12-21T07:42:48.478ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
16092024-12-21T07:42:48.525ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
16102024-12-21T07:42:48.528ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16112024-12-21T07:42:48.676ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16122024-12-21T07:42:48.827ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16132024-12-21T07:42:48.949ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16142024-12-21T07:42:49.111ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16152024-12-21T07:42:49.301ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16162024-12-21T07:42:49.608ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16172024-12-21T07:42:49.910ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.65329797s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16182024-12-21T07:42:49.922ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16192024-12-21T07:42:50.236ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16202024-12-21T07:42:50.478ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55172
16212024-12-21T07:42:50.479ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55172 req_id = 76689ca3-5510-42b8-a528-7254b2643f89 response_code = 200 uri = /baseboard
16222024-12-21T07:42:50.837ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16232024-12-21T07:42:51.127ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16242024-12-21T07:42:51.502ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/e92af880-4a9b-4c79-a3ae-829b6394cf0b/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16252024-12-21T07:42:56.215ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f72ad24e-a792-4070-88da-6882e7096892", "content-length": "173", "date": "Sat, 21 Dec 2024 07:42:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e92af880-4a9b-4c79-a3ae-829b6394cf0b\"", request_id: "f72ad24e-a792-4070-88da-6882e7096892" } file = sled-agent/src/rack_setup/service.rs:1078
16262024-12-21T07:42:57.384ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9800f29c-e879-4c5a-89d4-0631282d95ad", "content-length": "173", "date": "Sat, 21 Dec 2024 07:42:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e92af880-4a9b-4c79-a3ae-829b6394cf0b\"", request_id: "9800f29c-e879-4c5a-89d4-0631282d95ad" } file = sled-agent/src/rack_setup/service.rs:1078
16272024-12-21T07:42:58.249ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "15aa0487-1f53-4cdc-9d2d-ee6a28cd4fef", "content-length": "173", "date": "Sat, 21 Dec 2024 07:42:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e92af880-4a9b-4c79-a3ae-829b6394cf0b\"", request_id: "15aa0487-1f53-4cdc-9d2d-ee6a28cd4fef" } file = sled-agent/src/rack_setup/service.rs:1078
16282024-12-21T07:42:59.002ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d7ce2133-7038-4d76-af67-7cf2cefe81ef", "content-length": "173", "date": "Sat, 21 Dec 2024 07:42:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"e92af880-4a9b-4c79-a3ae-829b6394cf0b\"", request_id: "d7ce2133-7038-4d76-af67-7cf2cefe81ef" } file = sled-agent/src/rack_setup/service.rs:1078
16292024-12-21T07:43:00.642ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 17.483102091s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"df849751-37a3-40a1-8a15-47e9a1b73f3f\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Sat, 21 Dec 2024 07:43:00 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"df849751-37a3-40a1-8a15-47e9a1b73f3f\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16302024-12-21T07:43:02.294ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0342b4a5-9b39-43c8-830e-925bf6ad27ba", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "0342b4a5-9b39-43c8-830e-925bf6ad27ba" } file = sled-agent/src/rack_setup/service.rs:1078
16312024-12-21T07:43:05.139ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "788dd1b0-5f5b-4d04-b402-fe84dc398556", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "788dd1b0-5f5b-4d04-b402-fe84dc398556" } file = sled-agent/src/rack_setup/service.rs:1078
16322024-12-21T07:43:07.103ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5155a8e9-063e-42c8-b050-005d27995aa9", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "5155a8e9-063e-42c8-b050-005d27995aa9" } file = sled-agent/src/rack_setup/service.rs:1078
16332024-12-21T07:43:09.862ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "086c10f2-3102-45b2-b6a3-2a34517e1c30", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "086c10f2-3102-45b2-b6a3-2a34517e1c30" } file = sled-agent/src/rack_setup/service.rs:1078
16342024-12-21T07:43:12.430ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "efc939a2-5ca6-4ea1-bd5a-11f2cf4c3038", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "efc939a2-5ca6-4ea1-bd5a-11f2cf4c3038" } file = sled-agent/src/rack_setup/service.rs:1078
16352024-12-21T07:43:17.174ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ccd62e22-3dd6-4f99-8f8e-3167401dbe9d", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "ccd62e22-3dd6-4f99-8f8e-3167401dbe9d" } file = sled-agent/src/rack_setup/service.rs:1078
16362024-12-21T07:43:19.759ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "540c9d30-eae0-464d-9666-2d43046832dd", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "540c9d30-eae0-464d-9666-2d43046832dd" } file = sled-agent/src/rack_setup/service.rs:1078
16372024-12-21T07:43:20.515ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46706
16382024-12-21T07:43:20.515ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46706 req_id = 30cdad35-0d6d-43ba-8de6-8872b8092e9e response_code = 200 uri = /baseboard
16392024-12-21T07:43:28.183ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b6034253-282b-4fef-b71c-2f7466c093b0", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "b6034253-282b-4fef-b71c-2f7466c093b0" } file = sled-agent/src/rack_setup/service.rs:1078
16402024-12-21T07:43:33.137ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2f5be187-09ec-4d87-a624-f2ff0ce32412", "content-length": "173", "date": "Sat, 21 Dec 2024 07:43:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8\"", request_id: "2f5be187-09ec-4d87-a624-f2ff0ce32412" } file = sled-agent/src/rack_setup/service.rs:1078
16412024-12-21T07:43:35.034ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
16422024-12-21T07:43:35.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37436
16432024-12-21T07:43:35.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16442024-12-21T07:43:35.130ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16452024-12-21T07:43:35.130ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
16462024-12-21T07:43:35.136ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
16472024-12-21T07:43:35.150ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16482024-12-21T07:43:35.150ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62
16492024-12-21T07:43:35.175ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16502024-12-21T07:43:35.175ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54c8850c-5a87-4b82-9026-6ccf6d846961
16512024-12-21T07:43:35.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16522024-12-21T07:43:35.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45666343-e064-4cc6-881c-0d53aea79e05
16532024-12-21T07:43:35.219ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16542024-12-21T07:43:35.219ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5
16552024-12-21T07:43:35.239ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16562024-12-21T07:43:35.239ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a
16572024-12-21T07:43:35.260ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16582024-12-21T07:43:35.260ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f16a4591-8357-4fd5-b354-0deda45e4488
16592024-12-21T07:43:35.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16602024-12-21T07:43:35.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87
16612024-12-21T07:43:35.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16622024-12-21T07:43:35.303ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83
16632024-12-21T07:43:35.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16642024-12-21T07:43:35.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026
16652024-12-21T07:43:35.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37436 req_id = 3367010c-7a0f-48fc-bed0-31100a210804 response_code = 200 uri = /inventory
16662024-12-21T07:43:41.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58611
16672024-12-21T07:43:41.530ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16682024-12-21T07:43:41.531ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16692024-12-21T07:43:41.531ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16702024-12-21T07:43:41.531ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16712024-12-21T07:43:41.531ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16722024-12-21T07:43:41.531ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16732024-12-21T07:43:41.531ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16742024-12-21T07:43:41.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58611 req_id = 6d2e3ad4-a9ea-4ddf-8394-56dc7df2eb33 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16752024-12-21T07:43:41.533ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
16762024-12-21T07:43:41.537ZINFOSledAgent (RSS): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16772024-12-21T07:43:41.537ZINFOSledAgent (RSS): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16782024-12-21T07:43:41.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34604
16792024-12-21T07:43:41.967ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16802024-12-21T07:43:41.967ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16812024-12-21T07:43:41.967ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
16822024-12-21T07:43:41.967ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
16832024-12-21T07:43:41.979ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16842024-12-21T07:43:41.979ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62
16852024-12-21T07:43:42.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16862024-12-21T07:43:42.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54c8850c-5a87-4b82-9026-6ccf6d846961
16872024-12-21T07:43:42.027ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16882024-12-21T07:43:42.027ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45666343-e064-4cc6-881c-0d53aea79e05
16892024-12-21T07:43:42.048ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16902024-12-21T07:43:42.048ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5
16912024-12-21T07:43:42.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16922024-12-21T07:43:42.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a
16932024-12-21T07:43:42.090ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16942024-12-21T07:43:42.090ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f16a4591-8357-4fd5-b354-0deda45e4488
16952024-12-21T07:43:42.111ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16962024-12-21T07:43:42.111ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87
16972024-12-21T07:43:42.130ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16982024-12-21T07:43:42.131ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83
16992024-12-21T07:43:42.151ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17002024-12-21T07:43:42.151ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026
17012024-12-21T07:43:42.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194812 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34604 req_id = 2d07da97-4858-4a99-90cc-bd7a63b310c1 response_code = 200 uri = /inventory
17022024-12-21T07:43:42.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60027
17032024-12-21T07:43:42.445ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17042024-12-21T07:43:42.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17052024-12-21T07:43:42.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17062024-12-21T07:43:42.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17072024-12-21T07:43:42.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17082024-12-21T07:43:42.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17092024-12-21T07:43:42.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17102024-12-21T07:43:42.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60027 req_id = d6f4d5b4-b69f-4932-9819-51a9a90d9721 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17112024-12-21T07:43:42.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42463
17122024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17132024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17142024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17152024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17162024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17172024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17182024-12-21T07:43:42.521ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17192024-12-21T07:43:42.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42463 req_id = d800919d-7ac5-4961-a2f9-0f4129109538 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17202024-12-21T07:43:43.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33323
17212024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17222024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17232024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17242024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17252024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17262024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17272024-12-21T07:43:43.324ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17282024-12-21T07:43:43.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 377 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33323 req_id = 5d56294c-35b6-4859-a015-64467927465f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17292024-12-21T07:43:49.773ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:52235 remote_addr = [fd00:1122:3344:101::d]:60071 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17302024-12-21T07:43:49.806ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29733 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = dcbecb7e-9f31-4206-9039-9ae3e899fd3f response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17312024-12-21T07:43:50.555ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64307
17322024-12-21T07:43:50.555ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64307 req_id = 2bff3895-64d2-4d8c-b8ab-454399120620 response_code = 200 uri = /baseboard
17332024-12-21T07:43:51.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63243
17342024-12-21T07:43:51.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63243 req_id = a43ae365-e14e-4126-9e27-ad511c889d24 response_code = 200 uri = /vpc-routes
17352024-12-21T07:43:51.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
17362024-12-21T07:43:51.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63243 req_id = 5de3ff19-856d-4adc-8db7-1e8664cf5fe5 response_code = 204 uri = /eip-gateways
17372024-12-21T07:43:51.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2915 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63243 req_id = a68c1044-0c53-41b5-8de8-4aef0ca1999a response_code = 204 uri = /vpc-routes
17382024-12-21T07:43:59.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38639
17392024-12-21T07:43:59.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38639 req_id = 61eba1a8-3d3e-4edf-9f05-c5d3816fb810 response_code = 200 uri = /vpc-routes
17402024-12-21T07:44:00.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50151
17412024-12-21T07:44:00.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 624 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50151 req_id = bd947cdc-da32-457c-9525-d67ff2ffc502 response_code = 200 uri = /v2p
17422024-12-21T07:44:00.203ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
17432024-12-21T07:44:00.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38639 req_id = 52ea9f35-504f-4e59-83bc-5ed37bcf8896 response_code = 204 uri = /eip-gateways
17442024-12-21T07:44:00.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38639 req_id = db41b799-7b57-4162-bce4-cc72840b1c80 response_code = 204 uri = /vpc-routes
17452024-12-21T07:44:00.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63563
17462024-12-21T07:44:00.463ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17472024-12-21T07:44:00.570ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17482024-12-21T07:44:00.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63563 req_id = dcb0ffc0-6807-437f-8d82-38d2e67e3f0b response_code = 204 uri = /switch-ports
17492024-12-21T07:44:00.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63563 req_id = 1243f60f-0006-4b93-8f81-961a5f9c26ab response_code = 200 uri = /network-bootstore-config
17502024-12-21T07:44:00.697ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17512024-12-21T07:44:00.698ZINFOSledAgent (bootstore): Writing ledger to /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17522024-12-21T07:44:00.700ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17532024-12-21T07:44:00.701ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17542024-12-21T07:44:00.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4706 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63563 req_id = e38719ee-355b-467a-9cff-aef020648d17 response_code = 204 uri = /network-bootstore-config
17552024-12-21T07:44:00.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58689
17562024-12-21T07:44:00.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58689 req_id = 312f5318-3dad-4537-adf7-39a4f3a7379b response_code = 200 uri = /vpc-routes
17572024-12-21T07:44:01.057ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
17582024-12-21T07:44:01.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58689 req_id = c0b51058-c225-4101-9148-93dbd9e1ac25 response_code = 204 uri = /eip-gateways
17592024-12-21T07:44:01.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58689 req_id = e0f38164-cc1b-46d0-bd54-e47d1e3ab38c response_code = 204 uri = /vpc-routes
17602024-12-21T07:44:01.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33812
17612024-12-21T07:44:01.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33812 req_id = 0d2d5904-112d-4242-9db2-b6f208c3d1f8 response_code = 200 uri = /vpc-routes
17622024-12-21T07:44:01.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
17632024-12-21T07:44:01.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33812 req_id = c15a99ae-2e3d-4c05-bb52-a19573301700 response_code = 204 uri = /eip-gateways
17642024-12-21T07:44:01.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33812 req_id = c4630b38-a501-41f0-b121-9e388d0a3c29 response_code = 204 uri = /vpc-routes
17652024-12-21T07:44:01.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45011
17662024-12-21T07:44:01.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45011 req_id = 3ab46a94-a5f5-450b-87ec-656494854c26 response_code = 200 uri = /v2p
17672024-12-21T07:44:01.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64671
17682024-12-21T07:44:01.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17692024-12-21T07:44:01.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17702024-12-21T07:44:01.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64671 req_id = 9a56f756-6790-4852-9409-5516ebea9601 response_code = 204 uri = /switch-ports
17712024-12-21T07:44:01.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64671 req_id = 39354f8e-3277-465c-acae-b8250d9d72df response_code = 200 uri = /network-bootstore-config
17722024-12-21T07:44:01.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44642
17732024-12-21T07:44:01.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44642 req_id = e3dbfc79-b17b-470d-895c-7215a884ae1e response_code = 200 uri = /v2p
17742024-12-21T07:44:01.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45616
17752024-12-21T07:44:01.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17762024-12-21T07:44:01.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17772024-12-21T07:44:01.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45616 req_id = 4a79ad0d-62de-4570-9fef-d76986055718 response_code = 204 uri = /switch-ports
17782024-12-21T07:44:01.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45616 req_id = 68400d84-fb96-4fc1-903e-53d5bb761181 response_code = 200 uri = /network-bootstore-config
17792024-12-21T07:44:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8259 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 5671f8f5-5736-44bc-bff6-5b64ab17fe8c response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
17802024-12-21T07:44:20.588ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39891
17812024-12-21T07:44:20.588ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39891 req_id = 024b0226-1c86-455d-beee-b8a9463107df response_code = 200 uri = /baseboard
17822024-12-21T07:44:29.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51814
17832024-12-21T07:44:29.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51814 req_id = e8530eca-2aa3-4e76-ae54-0631559524f4 response_code = 200 uri = /vpc-routes
17842024-12-21T07:44:29.697ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
17852024-12-21T07:44:29.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51814 req_id = 99ae1574-aae8-4fcd-891a-f90924ba64e9 response_code = 204 uri = /eip-gateways
17862024-12-21T07:44:29.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51814 req_id = 6f39a2fb-58a4-47c7-82aa-af5fedcb1de9 response_code = 204 uri = /vpc-routes
17872024-12-21T07:44:29.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52169
17882024-12-21T07:44:29.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52169 req_id = b8cb9815-d316-4881-91fe-cb6a1270aff4 response_code = 200 uri = /v2p
17892024-12-21T07:44:29.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64615
17902024-12-21T07:44:29.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
17912024-12-21T07:44:29.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
17922024-12-21T07:44:30.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64615 req_id = af99dad0-1cbf-4b02-9bc9-a2cbe7307a94 response_code = 204 uri = /switch-ports
17932024-12-21T07:44:30.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64615 req_id = 66badd0e-53a8-48c4-b975-f06b99ff38f5 response_code = 200 uri = /network-bootstore-config
17942024-12-21T07:44:30.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61878
17952024-12-21T07:44:30.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61878 req_id = edf5630d-1f1b-40a9-868c-51e4e2def8ad response_code = 200 uri = /vpc-routes
17962024-12-21T07:44:30.880ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
17972024-12-21T07:44:30.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61878 req_id = a5c0c09d-9c47-469d-95b7-ae20a6113c14 response_code = 204 uri = /eip-gateways
17982024-12-21T07:44:30.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61878 req_id = 27c8475f-c572-45af-9246-9e6818bed093 response_code = 204 uri = /vpc-routes
17992024-12-21T07:44:31.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52740
18002024-12-21T07:44:31.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50348
18012024-12-21T07:44:31.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52740 req_id = cdef7587-e7b8-470a-8374-978295dac9fc response_code = 200 uri = /vpc-routes
18022024-12-21T07:44:31.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50348 req_id = 12a5115e-244c-41f4-93c1-476a1a05cad6 response_code = 200 uri = /v2p
18032024-12-21T07:44:31.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38816
18042024-12-21T07:44:31.048ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18052024-12-21T07:44:31.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18062024-12-21T07:44:31.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93851 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38816 req_id = 594600cd-fec5-4cdd-bb61-3083e1b930cd response_code = 204 uri = /switch-ports
18072024-12-21T07:44:31.142ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18082024-12-21T07:44:31.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52740 req_id = a6b98bd8-60fc-4071-b0ba-d610161d70f8 response_code = 204 uri = /eip-gateways
18092024-12-21T07:44:31.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38816 req_id = 61b4682f-aad2-4cf5-9087-d8c63c7635a2 response_code = 200 uri = /network-bootstore-config
18102024-12-21T07:44:31.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40216
18112024-12-21T07:44:31.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40216 req_id = b99fc39a-c874-4d90-a768-1e3325eb25fa response_code = 200 uri = /v2p
18122024-12-21T07:44:31.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52740 req_id = 39bba948-3d48-4bb1-aa60-9f8c64ba3761 response_code = 204 uri = /vpc-routes
18132024-12-21T07:44:31.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52460
18142024-12-21T07:44:31.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18152024-12-21T07:44:31.291ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18162024-12-21T07:44:31.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52460 req_id = fb568978-e9d5-48ba-8844-5cf28b835489 response_code = 204 uri = /switch-ports
18172024-12-21T07:44:31.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52460 req_id = 67fc98ca-8a4b-44f5-925a-13bc5e910321 response_code = 200 uri = /network-bootstore-config
18182024-12-21T07:44:49.783ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10067 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = a33caf52-a9c0-45d6-b41b-f1ae06cb80fc response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
18192024-12-21T07:44:50.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62174
18202024-12-21T07:44:50.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62174 req_id = 1ac3362a-6e5e-4945-9334-201dde1cf676 response_code = 200 uri = /baseboard
18212024-12-21T07:44:59.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56720
18222024-12-21T07:44:59.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56720 req_id = 6cc3fa1c-5428-4792-aaf5-6a91c6fe0a54 response_code = 200 uri = /vpc-routes
18232024-12-21T07:44:59.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34547
18242024-12-21T07:44:59.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 772 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34547 req_id = 757bf641-9576-4cb5-b20b-58470f7b91f7 response_code = 200 uri = /v2p
18252024-12-21T07:44:59.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18262024-12-21T07:44:59.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56720 req_id = 471e1a29-5c4f-47bd-906a-ee9d7fba0f3c response_code = 204 uri = /eip-gateways
18272024-12-21T07:44:59.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56720 req_id = 742ad49d-f6cc-4fb1-9c41-815f34c549a2 response_code = 204 uri = /vpc-routes
18282024-12-21T07:44:59.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40181
18292024-12-21T07:44:59.975ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18302024-12-21T07:45:00.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18312024-12-21T07:45:00.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40181 req_id = cd96fa07-525c-482a-8416-733be0899c7a response_code = 204 uri = /switch-ports
18322024-12-21T07:45:00.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40181 req_id = 59dd3ce4-1775-4268-ba23-1e830cc2667f response_code = 200 uri = /network-bootstore-config
18332024-12-21T07:45:01.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32900
18342024-12-21T07:45:01.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32900 req_id = d80d8c95-a88a-417f-a946-b95d446ea1a1 response_code = 200 uri = /vpc-routes
18352024-12-21T07:45:01.139ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18362024-12-21T07:45:01.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32900 req_id = e5b0f10a-4f0f-4d43-87d4-f38af3d1a877 response_code = 204 uri = /eip-gateways
18372024-12-21T07:45:01.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34112
18382024-12-21T07:45:01.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34112 req_id = 9b137555-7231-4bd4-87fb-4379588550f2 response_code = 200 uri = /v2p
18392024-12-21T07:45:01.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32900 req_id = cea1d76a-6fa5-4d07-b17c-94928b99bf7a response_code = 204 uri = /vpc-routes
18402024-12-21T07:45:01.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34502
18412024-12-21T07:45:01.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34502 req_id = 64f40970-1c99-4373-9f3f-2ea2120978ad response_code = 200 uri = /vpc-routes
18422024-12-21T07:45:01.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48759
18432024-12-21T07:45:01.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48759 req_id = 760f4254-a051-4835-8359-4673b9978767 response_code = 200 uri = /v2p
18442024-12-21T07:45:01.209ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18452024-12-21T07:45:01.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34502 req_id = 6aa24a9a-edd4-4200-8bc7-3fc1533cc1c7 response_code = 204 uri = /eip-gateways
18462024-12-21T07:45:01.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34502 req_id = 1aaea67b-adf9-4e98-ad44-8c82336dbad2 response_code = 204 uri = /vpc-routes
18472024-12-21T07:45:01.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41480
18482024-12-21T07:45:01.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18492024-12-21T07:45:01.395ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18502024-12-21T07:45:01.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41480 req_id = 35281438-eecd-40a0-8b92-0a8a3314b388 response_code = 204 uri = /switch-ports
18512024-12-21T07:45:01.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45692
18522024-12-21T07:45:01.520ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18532024-12-21T07:45:01.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4456 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41480 req_id = 13ceac57-18c0-462d-82f2-749f0fb1e89d response_code = 200 uri = /network-bootstore-config
18542024-12-21T07:45:01.609ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18552024-12-21T07:45:01.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188536 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45692 req_id = d873636c-0357-4180-a94e-5e3a4a367e93 response_code = 204 uri = /switch-ports
18562024-12-21T07:45:01.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45692 req_id = 8155b997-29c9-4fb4-bb58-9bf39d9efba7 response_code = 200 uri = /network-bootstore-config
18572024-12-21T07:45:19.781ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7846 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 2fb137cd-98fe-45c5-9d97-ceb1b097d366 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
18582024-12-21T07:45:20.657ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44138
18592024-12-21T07:45:20.657ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44138 req_id = 55175afc-5449-48bd-9f4f-1c61ab82fe81 response_code = 200 uri = /baseboard
18602024-12-21T07:45:29.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51552
18612024-12-21T07:45:29.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51552 req_id = f1465516-37b5-4fe0-b2ce-fd99b0c25148 response_code = 200 uri = /vpc-routes
18622024-12-21T07:45:29.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18632024-12-21T07:45:29.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51552 req_id = f8a2eba6-a4a2-48ec-91b9-72e8c79a90d9 response_code = 204 uri = /eip-gateways
18642024-12-21T07:45:29.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51552 req_id = ae109f72-ef72-442d-99b1-f61e1dd6f720 response_code = 204 uri = /vpc-routes
18652024-12-21T07:45:29.748ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40284
18662024-12-21T07:45:29.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40284 req_id = 34ba5539-1698-47ad-a222-b2f34919602b response_code = 200 uri = /v2p
18672024-12-21T07:45:29.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61686
18682024-12-21T07:45:29.811ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18692024-12-21T07:45:29.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18702024-12-21T07:45:29.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91104 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61686 req_id = 9a2a7aac-4514-4c4e-b0ee-a83b99e82d6b response_code = 204 uri = /switch-ports
18712024-12-21T07:45:29.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61686 req_id = f67ebde9-9469-44c9-bf94-bedbc6910fdc response_code = 200 uri = /network-bootstore-config
18722024-12-21T07:45:30.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64375
18732024-12-21T07:45:30.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64375 req_id = 831859bf-ef63-4e4b-ad69-656f955a7011 response_code = 200 uri = /vpc-routes
18742024-12-21T07:45:30.860ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18752024-12-21T07:45:30.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64375 req_id = 0edc1ed6-3c96-401d-a1bd-1667a52e8d92 response_code = 204 uri = /eip-gateways
18762024-12-21T07:45:30.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64375 req_id = fb52da31-6ae9-4268-9966-ad2a692f947c response_code = 204 uri = /vpc-routes
18772024-12-21T07:45:30.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46772
18782024-12-21T07:45:30.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46772 req_id = e6ff8c8d-6046-4c22-b9ed-2be1a714fd7a response_code = 200 uri = /vpc-routes
18792024-12-21T07:45:30.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
18802024-12-21T07:45:30.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46772 req_id = f587dacd-8ef9-4c67-93f8-d81ef9eec3b2 response_code = 204 uri = /eip-gateways
18812024-12-21T07:45:30.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53064
18822024-12-21T07:45:30.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18832024-12-21T07:45:31.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18842024-12-21T07:45:31.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53064 req_id = ca4f650e-4c03-49b9-a493-9e6b06c019d6 response_code = 204 uri = /switch-ports
18852024-12-21T07:45:31.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34961
18862024-12-21T07:45:31.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57955
18872024-12-21T07:45:31.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34961 req_id = df0ce587-3e98-4500-93ac-ebdba135d34c response_code = 200 uri = /v2p
18882024-12-21T07:45:31.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57955 req_id = de9c2539-3b1c-4e7b-95fa-94437ea0567a response_code = 200 uri = /v2p
18892024-12-21T07:45:31.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53064 req_id = a6b6983d-c73f-4508-be62-ca64c115d6ab response_code = 200 uri = /network-bootstore-config
18902024-12-21T07:45:31.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 454 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46772 req_id = e5140272-c5f6-4959-b3d1-56cfaee24fbf response_code = 204 uri = /vpc-routes
18912024-12-21T07:45:31.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53932
18922024-12-21T07:45:31.089ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
18932024-12-21T07:45:31.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
18942024-12-21T07:45:31.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53932 req_id = 4b61a3a6-ae84-4dc3-bee0-b7019b8cad4e response_code = 204 uri = /switch-ports
18952024-12-21T07:45:31.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53932 req_id = 5af43c7f-f25a-4fa0-90e7-a577c643f41a response_code = 200 uri = /network-bootstore-config
18962024-12-21T07:45:49.783ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9511 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 911a72ea-fadf-4bcb-93bc-ced40a8b46e5 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
18972024-12-21T07:45:50.689ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63428
18982024-12-21T07:45:50.689ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63428 req_id = 0a06d8b1-9fee-476a-919a-46c7c4b2f42a response_code = 200 uri = /baseboard
18992024-12-21T07:45:59.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43870
19002024-12-21T07:45:59.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43870 req_id = 65672943-4771-4d02-9030-17b0042add20 response_code = 200 uri = /vpc-routes
19012024-12-21T07:45:59.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19022024-12-21T07:45:59.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43870 req_id = 4132a0b7-7ef9-4bb7-a23a-4d86beeade0d response_code = 204 uri = /eip-gateways
19032024-12-21T07:45:59.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43870 req_id = d089fb70-8799-4a43-90bc-fb7f01740f9d response_code = 204 uri = /vpc-routes
19042024-12-21T07:45:59.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63285
19052024-12-21T07:45:59.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63285 req_id = d6db71af-4822-4fa1-ac39-bc548fc2a15b response_code = 200 uri = /v2p
19062024-12-21T07:45:59.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42546
19072024-12-21T07:45:59.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19082024-12-21T07:46:00.033ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19092024-12-21T07:46:00.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42546 req_id = 5ada8712-f301-4473-b85d-ebb99c5f64f0 response_code = 204 uri = /switch-ports
19102024-12-21T07:46:00.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42546 req_id = 88374b01-00a0-4608-b5d2-87646ee6d77e response_code = 200 uri = /network-bootstore-config
19112024-12-21T07:46:01.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38724
19122024-12-21T07:46:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38724 req_id = 51407e8c-d4c5-4975-a7fe-d1f71d59fa7c response_code = 200 uri = /v2p
19132024-12-21T07:46:01.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54559
19142024-12-21T07:46:01.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54559 req_id = 78da7aff-0fd3-46a8-8c13-777bda2c5b93 response_code = 200 uri = /vpc-routes
19152024-12-21T07:46:01.229ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19162024-12-21T07:46:01.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54559 req_id = a30d7aa7-16e9-4085-88be-8ba5483f99de response_code = 204 uri = /eip-gateways
19172024-12-21T07:46:01.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54559 req_id = f7ac4f19-fccc-4c29-be9f-7b411b5ed9ef response_code = 204 uri = /vpc-routes
19182024-12-21T07:46:01.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56739
19192024-12-21T07:46:01.256ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19202024-12-21T07:46:01.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19212024-12-21T07:46:01.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56739 req_id = 08d9a5fc-1493-4959-a4d8-da5925055684 response_code = 204 uri = /switch-ports
19222024-12-21T07:46:01.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33747
19232024-12-21T07:46:01.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62783
19242024-12-21T07:46:01.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53481
19252024-12-21T07:46:01.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56739 req_id = 5d96cb10-0b27-4fd7-9e2b-07b5cf76b26e response_code = 200 uri = /network-bootstore-config
19262024-12-21T07:46:01.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33747 req_id = 70583ac0-108f-4d1f-99f6-c81ac8f79a31 response_code = 200 uri = /vpc-routes
19272024-12-21T07:46:01.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62783 req_id = 9824450c-7202-45a7-aba3-f53096243824 response_code = 200 uri = /v2p
19282024-12-21T07:46:01.352ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19292024-12-21T07:46:01.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19302024-12-21T07:46:01.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33747 req_id = 500684eb-bea5-409f-b318-1fb4d2a51472 response_code = 204 uri = /eip-gateways
19312024-12-21T07:46:01.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 873 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33747 req_id = b4dbf2bb-5511-4da9-a246-b083f0bf6004 response_code = 204 uri = /vpc-routes
19322024-12-21T07:46:01.390ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19332024-12-21T07:46:01.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53481 req_id = 924c7d9e-43a1-4f4d-b60f-5bb96c13320c response_code = 204 uri = /switch-ports
19342024-12-21T07:46:01.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53481 req_id = 1bc322ad-ff4e-42ef-83d8-e6c9942d0ba4 response_code = 200 uri = /network-bootstore-config
19352024-12-21T07:46:02.534ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19362024-12-21T07:46:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8648 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = a9134efa-bd28-49f8-bb93-f214ca633b3d response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
19372024-12-21T07:46:20.724ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37270
19382024-12-21T07:46:20.724ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37270 req_id = b6feb53b-5353-404b-b4b1-0a4ea2070447 response_code = 200 uri = /baseboard
19392024-12-21T07:46:29.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34955
19402024-12-21T07:46:29.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34955 req_id = 44508c4d-54a9-4e27-8233-31f48e88bcb3 response_code = 200 uri = /vpc-routes
19412024-12-21T07:46:29.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19422024-12-21T07:46:29.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34955 req_id = a79b8060-f801-4140-9e47-c7634107d0c0 response_code = 204 uri = /eip-gateways
19432024-12-21T07:46:29.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34955 req_id = ae711369-fecd-4ebe-b423-8b7b9eb4e1e9 response_code = 204 uri = /vpc-routes
19442024-12-21T07:46:29.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43632
19452024-12-21T07:46:29.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43632 req_id = ba9a4e9a-dcb8-4488-b6d0-69c70558b9f5 response_code = 200 uri = /v2p
19462024-12-21T07:46:29.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62526
19472024-12-21T07:46:29.736ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19482024-12-21T07:46:29.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19492024-12-21T07:46:29.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62526 req_id = 8b382d1a-27a9-4395-9253-7cc0de5aa49b response_code = 204 uri = /switch-ports
19502024-12-21T07:46:29.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62526 req_id = 2032eaa3-7b86-48fa-88e2-a2aab4da5c17 response_code = 200 uri = /network-bootstore-config
19512024-12-21T07:46:30.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41071
19522024-12-21T07:46:30.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41071 req_id = 20c06407-5fb7-468f-9c0a-43eec082d7ed response_code = 200 uri = /vpc-routes
19532024-12-21T07:46:30.908ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19542024-12-21T07:46:30.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41071 req_id = ca4b0e98-ba10-4c26-bc48-8da05f3a32b7 response_code = 204 uri = /eip-gateways
19552024-12-21T07:46:30.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59508
19562024-12-21T07:46:30.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59508 req_id = 10a5ad4f-de4f-42e7-8ea8-452dd61ae856 response_code = 200 uri = /vpc-routes
19572024-12-21T07:46:30.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19582024-12-21T07:46:30.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59508 req_id = c4bad76f-bd2b-4322-a6c4-44b4594252fc response_code = 204 uri = /eip-gateways
19592024-12-21T07:46:31.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38608
19602024-12-21T07:46:31.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38608 req_id = bede5b71-b6f9-4eff-b7d3-4dd7f1c5693c response_code = 200 uri = /v2p
19612024-12-21T07:46:31.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41584
19622024-12-21T07:46:31.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41584 req_id = 3556902b-963a-4d9c-b4c6-e1db7607920d response_code = 200 uri = /v2p
19632024-12-21T07:46:31.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41071 req_id = a975a69e-c128-4ddd-8248-53615b8b64a7 response_code = 204 uri = /vpc-routes
19642024-12-21T07:46:31.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59508 req_id = 7bdd7b88-9944-4956-81b0-91174efc564c response_code = 204 uri = /vpc-routes
19652024-12-21T07:46:31.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53379
19662024-12-21T07:46:31.074ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19672024-12-21T07:46:31.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19682024-12-21T07:46:31.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53379 req_id = 2fd2a33d-0b6d-442b-ba5c-72f8e50ffdf4 response_code = 204 uri = /switch-ports
19692024-12-21T07:46:31.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46327
19702024-12-21T07:46:31.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53379 req_id = d583ba95-c2c7-4124-a87d-8dc5c98bad8a response_code = 200 uri = /network-bootstore-config
19712024-12-21T07:46:31.162ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19722024-12-21T07:46:31.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19732024-12-21T07:46:31.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93772 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46327 req_id = 0d188d3e-1d43-4cb1-8b23-50152dc88ac1 response_code = 204 uri = /switch-ports
19742024-12-21T07:46:31.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46327 req_id = e7d2389c-89bd-4940-b466-4303396326b7 response_code = 200 uri = /network-bootstore-config
19752024-12-21T07:46:49.781ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7009 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 612deb3d-ec79-4e51-b6b9-5794bbaca1d8 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
19762024-12-21T07:46:50.758ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62846
19772024-12-21T07:46:50.759ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62846 req_id = a3a07441-27e8-41b6-8a6e-8b74f4ccd7f6 response_code = 200 uri = /baseboard
19782024-12-21T07:46:59.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48265
19792024-12-21T07:46:59.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48265 req_id = 6e03bf36-7459-429d-a1c8-6b2e647a08ec response_code = 200 uri = /vpc-routes
19802024-12-21T07:46:59.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61431
19812024-12-21T07:46:59.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61431 req_id = 4151183e-b255-421a-a6d1-a8e5bfb3f334 response_code = 200 uri = /v2p
19822024-12-21T07:46:59.803ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19832024-12-21T07:46:59.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48265 req_id = 4264dd39-2906-4560-ba7d-900dfa01c1f1 response_code = 204 uri = /eip-gateways
19842024-12-21T07:46:59.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48265 req_id = c81b123f-6d02-4445-a043-5bf63a485635 response_code = 204 uri = /vpc-routes
19852024-12-21T07:46:59.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35296
19862024-12-21T07:46:59.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
19872024-12-21T07:46:59.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
19882024-12-21T07:47:00.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35296 req_id = 9191c654-1526-4234-9409-3bbca512f3c8 response_code = 204 uri = /switch-ports
19892024-12-21T07:47:00.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35296 req_id = 134b42b7-fc46-4b88-b144-19920d94ccf6 response_code = 200 uri = /network-bootstore-config
19902024-12-21T07:47:00.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50884
19912024-12-21T07:47:00.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50884 req_id = e12a83e5-db4e-4ab2-a734-4cfc9dfe8560 response_code = 200 uri = /vpc-routes
19922024-12-21T07:47:01.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19932024-12-21T07:47:01.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50884 req_id = afc9d807-94ae-4f73-8119-2e91116a9639 response_code = 204 uri = /eip-gateways
19942024-12-21T07:47:01.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50884 req_id = 8181f09b-77df-4e63-9f64-a6227242d9cb response_code = 204 uri = /vpc-routes
19952024-12-21T07:47:01.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48603
19962024-12-21T07:47:01.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48603 req_id = 95321572-96d9-4336-bd58-9a2d66ffc4de response_code = 200 uri = /vpc-routes
19972024-12-21T07:47:01.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
19982024-12-21T07:47:01.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48603 req_id = e66a2825-1029-4c06-9b77-1baf27aecd4c response_code = 204 uri = /eip-gateways
19992024-12-21T07:47:01.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48603 req_id = c1fc9db4-7172-4643-9a91-e9e58e9fb6fd response_code = 204 uri = /vpc-routes
20002024-12-21T07:47:01.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62269
20012024-12-21T07:47:01.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62269 req_id = b1b82a92-1b36-43bf-94af-919dd893b7e0 response_code = 200 uri = /v2p
20022024-12-21T07:47:01.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46957
20032024-12-21T07:47:01.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20042024-12-21T07:47:01.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20052024-12-21T07:47:01.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49250
20062024-12-21T07:47:01.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49250 req_id = a923bcd1-0808-4054-864e-683bbf9c1310 response_code = 200 uri = /v2p
20072024-12-21T07:47:01.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46957 req_id = 963a6d77-3a12-4883-8299-acf075890f13 response_code = 204 uri = /switch-ports
20082024-12-21T07:47:01.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46957 req_id = 8f843488-2f02-4d9f-bbcc-dfeb796a6fe0 response_code = 200 uri = /network-bootstore-config
20092024-12-21T07:47:01.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54992
20102024-12-21T07:47:01.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20112024-12-21T07:47:01.373ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20122024-12-21T07:47:01.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90633 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54992 req_id = b1f220ff-9a67-4d11-927c-b1c52a5ac9e7 response_code = 204 uri = /switch-ports
20132024-12-21T07:47:01.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54992 req_id = 7fa4e068-79e9-45ce-ba7e-e92926bafe35 response_code = 200 uri = /network-bootstore-config
20142024-12-21T07:47:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8100 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 03551a56-bf45-4117-b6af-9c52f8f3bcff response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
20152024-12-21T07:47:20.791ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52220
20162024-12-21T07:47:20.791ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52220 req_id = 54e7d64c-0897-4d54-9da4-f95ddc4466e8 response_code = 200 uri = /baseboard
20172024-12-21T07:47:29.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59579
20182024-12-21T07:47:29.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59579 req_id = 21c04b97-f57f-4773-be04-5507a11cd76d response_code = 200 uri = /vpc-routes
20192024-12-21T07:47:29.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55497
20202024-12-21T07:47:29.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55497 req_id = addcf888-c5c2-48b2-9f69-b41b0ff4df59 response_code = 200 uri = /v2p
20212024-12-21T07:47:29.801ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
20222024-12-21T07:47:29.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59579 req_id = 63406ba9-43ad-48ed-985c-d179cb15e341 response_code = 204 uri = /eip-gateways
20232024-12-21T07:47:29.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59579 req_id = b0b380b8-6107-4a1b-a2a7-498289c34162 response_code = 204 uri = /vpc-routes
20242024-12-21T07:47:29.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35870
20252024-12-21T07:47:29.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20262024-12-21T07:47:29.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20272024-12-21T07:47:29.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35870 req_id = 7febeb33-b3e6-4573-9015-6f12ba344058 response_code = 204 uri = /switch-ports
20282024-12-21T07:47:29.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35870 req_id = e118e2e3-b63a-4cf4-952f-208c16ca537c response_code = 200 uri = /network-bootstore-config
20292024-12-21T07:47:30.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63973
20302024-12-21T07:47:30.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63973 req_id = fb646e5d-424a-4642-bcb1-0a72b5bc30e6 response_code = 200 uri = /vpc-routes
20312024-12-21T07:47:30.909ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
20322024-12-21T07:47:30.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63973 req_id = 7188aecb-3404-4d61-ab37-b1461348bf1d response_code = 204 uri = /eip-gateways
20332024-12-21T07:47:30.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63973 req_id = 76c44084-57c4-4e30-9578-1fddd908dddb response_code = 204 uri = /vpc-routes
20342024-12-21T07:47:30.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60248
20352024-12-21T07:47:30.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20362024-12-21T07:47:31.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20372024-12-21T07:47:31.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60248 req_id = 5f3a29a1-e814-4d1d-8549-45f2b4723df8 response_code = 204 uri = /switch-ports
20382024-12-21T07:47:31.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63193
20392024-12-21T07:47:31.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56868
20402024-12-21T07:47:31.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56868 req_id = fdf392a7-0c8f-4ada-8ec2-d56ddaf27f18 response_code = 200 uri = /v2p
20412024-12-21T07:47:31.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63193 req_id = 02c1a7fc-97e8-46fc-bc75-6a5a79cff39c response_code = 200 uri = /vpc-routes
20422024-12-21T07:47:31.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60248 req_id = 6d66e400-9cb5-44ef-a77b-7a0542f067e2 response_code = 200 uri = /network-bootstore-config
20432024-12-21T07:47:31.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
20442024-12-21T07:47:31.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63193 req_id = 420fd43e-6d80-4f5f-840a-3a1c6c51bbfe response_code = 204 uri = /eip-gateways
20452024-12-21T07:47:31.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54574
20462024-12-21T07:47:31.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54574 req_id = ae6d94e9-fe27-4ab3-ac56-7b74d919511d response_code = 200 uri = /v2p
20472024-12-21T07:47:31.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63193 req_id = 8d70d465-fc11-4ba9-8532-bf78658c3fd9 response_code = 204 uri = /vpc-routes
20482024-12-21T07:47:31.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44095
20492024-12-21T07:47:31.135ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20502024-12-21T07:47:31.175ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20512024-12-21T07:47:31.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44095 req_id = 24f4d70a-d655-4d96-80b1-3937b9dc6901 response_code = 204 uri = /switch-ports
20522024-12-21T07:47:31.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44095 req_id = 581139cd-574a-43b5-a2c4-373bc9cc5a77 response_code = 200 uri = /network-bootstore-config
20532024-12-21T07:47:49.781ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7696 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 1fb20425-84ce-444e-9402-04533b54dc64 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
20542024-12-21T07:47:50.824ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65361
20552024-12-21T07:47:50.825ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65361 req_id = 8597bd04-8d17-45b7-b650-3dc39937eb47 response_code = 200 uri = /baseboard
20562024-12-21T07:47:59.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42356
20572024-12-21T07:47:59.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42356 req_id = 31daee0c-33ba-4680-b748-0ca2b89c9a2c response_code = 200 uri = /vpc-routes
20582024-12-21T07:47:59.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
20592024-12-21T07:47:59.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42356 req_id = 969e489c-3f01-48d8-88ae-57542783f4a0 response_code = 204 uri = /eip-gateways
20602024-12-21T07:47:59.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42356 req_id = 37193733-102a-450d-9cb5-3c5ddc7a0c51 response_code = 204 uri = /vpc-routes
20612024-12-21T07:48:00.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48178
20622024-12-21T07:48:00.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48178 req_id = 3a559e98-7629-4f02-ae74-56ba5034e038 response_code = 200 uri = /v2p
20632024-12-21T07:48:00.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45477
20642024-12-21T07:48:00.063ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20652024-12-21T07:48:00.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20662024-12-21T07:48:00.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45477 req_id = 72031819-6462-49b3-9fa8-30977eb11004 response_code = 204 uri = /switch-ports
20672024-12-21T07:48:00.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45477 req_id = ab53fa47-0b5f-40bb-a283-7a88435ee4e2 response_code = 200 uri = /network-bootstore-config
20682024-12-21T07:48:00.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56148
20692024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20702024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20712024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20722024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20732024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20742024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20752024-12-21T07:48:00.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20762024-12-21T07:48:00.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56148 req_id = 2df3c9d4-6e4e-42b3-add5-303b772f486a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20772024-12-21T07:48:00.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39644
20782024-12-21T07:48:00.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39644 req_id = 80c97eba-b460-4cf5-8ecf-9ad99ee4945e response_code = 200 uri = /vpc-routes
20792024-12-21T07:48:01.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
20802024-12-21T07:48:01.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39644 req_id = 96510b12-a185-487d-b18f-91bb22f89bda response_code = 204 uri = /eip-gateways
20812024-12-21T07:48:01.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39644 req_id = 5ad0aa37-36d7-4008-8f0a-df6ba2241d3a response_code = 204 uri = /vpc-routes
20822024-12-21T07:48:01.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40052
20832024-12-21T07:48:01.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40052 req_id = 21d83c87-e3df-4e22-a5cb-145a03603b06 response_code = 200 uri = /vpc-routes
20842024-12-21T07:48:01.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
20852024-12-21T07:48:01.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40052 req_id = af3de0c0-949d-4de5-9dae-b490e20692ad response_code = 204 uri = /eip-gateways
20862024-12-21T07:48:01.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40052 req_id = e0b9cbaa-4596-4779-8499-c2df22b191cc response_code = 204 uri = /vpc-routes
20872024-12-21T07:48:01.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46497
20882024-12-21T07:48:01.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46497 req_id = 576a3503-1dff-4dce-82c1-9b9ba6d09986 response_code = 200 uri = /v2p
20892024-12-21T07:48:01.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55410
20902024-12-21T07:48:01.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20912024-12-21T07:48:01.208ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20922024-12-21T07:48:01.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100142 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55410 req_id = 83d817e1-7065-4d55-bc5e-b980e57c7f29 response_code = 204 uri = /switch-ports
20932024-12-21T07:48:01.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55410 req_id = 16689c13-1e22-45bd-8648-5bc057557baa response_code = 200 uri = /network-bootstore-config
20942024-12-21T07:48:01.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51471
20952024-12-21T07:48:01.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51471 req_id = ba87a24d-7110-4dd7-b5e4-ec9d8a8c143a response_code = 200 uri = /v2p
20962024-12-21T07:48:01.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51638
20972024-12-21T07:48:01.306ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
20982024-12-21T07:48:01.346ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
20992024-12-21T07:48:01.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98875 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51638 req_id = aea2f854-9ebe-46f3-9c9d-be86ea3dd248 response_code = 204 uri = /switch-ports
21002024-12-21T07:48:01.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51638 req_id = 761f26c9-72c5-4f3a-8461-8389f9fd3f47 response_code = 200 uri = /network-bootstore-config
21012024-12-21T07:48:01.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49090
21022024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21032024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21042024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21052024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21062024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21072024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21082024-12-21T07:48:01.437ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21092024-12-21T07:48:01.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49090 req_id = 7c94113e-cffe-4937-9187-64926c05f14e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21102024-12-21T07:48:01.472ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50226
21112024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21122024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21132024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21142024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21152024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21162024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21172024-12-21T07:48:01.473ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21182024-12-21T07:48:01.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50226 req_id = 46641917-6df0-4db3-bc0f-ae3bb1ec3efb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21192024-12-21T07:48:19.784ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8210 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 5fdfacda-3417-44ca-92d0-ba62bf4f0c7a response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21202024-12-21T07:48:20.859ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47084
21212024-12-21T07:48:20.859ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47084 req_id = 41099d89-09a5-4ade-9bcd-b46e6fcfca1c response_code = 200 uri = /baseboard
21222024-12-21T07:48:29.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57368
21232024-12-21T07:48:29.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57368 req_id = ec172c43-f996-4c78-b685-7b736a0c77b5 response_code = 200 uri = /vpc-routes
21242024-12-21T07:48:29.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
21252024-12-21T07:48:29.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57368 req_id = f4376bbb-2e56-4ea4-8c45-aef21852aa89 response_code = 204 uri = /eip-gateways
21262024-12-21T07:48:29.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57368 req_id = f39842ed-07fa-4e46-824c-180dfd067e43 response_code = 204 uri = /vpc-routes
21272024-12-21T07:48:29.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41843
21282024-12-21T07:48:29.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41843 req_id = d9c71520-ada4-42ba-8f53-e8d45ed3c8b0 response_code = 200 uri = /v2p
21292024-12-21T07:48:29.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57077
21302024-12-21T07:48:29.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21312024-12-21T07:48:29.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21322024-12-21T07:48:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57077 req_id = 288f04eb-3138-4d08-9209-e757cd219194 response_code = 204 uri = /switch-ports
21332024-12-21T07:48:29.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57077 req_id = 0b0a000c-15f2-45a3-baf9-8a86176feabe response_code = 200 uri = /network-bootstore-config
21342024-12-21T07:48:30.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43215
21352024-12-21T07:48:30.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43215 req_id = 5534f7ee-d4ae-4106-9944-390e3e888471 response_code = 200 uri = /vpc-routes
21362024-12-21T07:48:31.013ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
21372024-12-21T07:48:31.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43215 req_id = d55abb7d-c498-48b4-bb92-26414b7c0fac response_code = 204 uri = /eip-gateways
21382024-12-21T07:48:31.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60238
21392024-12-21T07:48:31.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60238 req_id = 75100e53-83d2-4dc8-98bc-14a0ca1c8e79 response_code = 200 uri = /v2p
21402024-12-21T07:48:31.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43215 req_id = 6a09eb19-8dfc-4ab7-be10-9d75d39e392e response_code = 204 uri = /vpc-routes
21412024-12-21T07:48:31.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52148
21422024-12-21T07:48:31.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52148 req_id = f82fca71-5d63-4fc5-9a56-f070e0320abe response_code = 200 uri = /vpc-routes
21432024-12-21T07:48:31.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
21442024-12-21T07:48:31.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52148 req_id = 9bee2255-4645-4040-8e0b-366743d13953 response_code = 204 uri = /eip-gateways
21452024-12-21T07:48:31.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52148 req_id = 1c0cacf5-df0f-4e39-b611-1aa5fc1f8a6a response_code = 204 uri = /vpc-routes
21462024-12-21T07:48:31.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50111
21472024-12-21T07:48:31.063ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21482024-12-21T07:48:31.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21492024-12-21T07:48:31.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97016 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50111 req_id = 514a43c6-581e-439d-a8bb-0da22514c8af response_code = 204 uri = /switch-ports
21502024-12-21T07:48:31.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42172
21512024-12-21T07:48:31.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34760
21522024-12-21T07:48:31.160ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21532024-12-21T07:48:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3450 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42172 req_id = cea75e1a-3683-4046-843b-00aa002d2fdc response_code = 200 uri = /v2p
21542024-12-21T07:48:31.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50111 req_id = f346b9ea-8b26-4ede-87d4-382bb71037da response_code = 200 uri = /network-bootstore-config
21552024-12-21T07:48:31.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21562024-12-21T07:48:31.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34760 req_id = 7eaa04f4-ff87-4b5a-a603-f45a0c14cc2e response_code = 204 uri = /switch-ports
21572024-12-21T07:48:31.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34760 req_id = 9f3b782f-7cd0-4897-b9d2-773478ddd2e3 response_code = 200 uri = /network-bootstore-config
21582024-12-21T07:48:49.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8011 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 5be7d0d7-b0d4-4cc9-8dc7-9138652b2e66 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21592024-12-21T07:48:50.893ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37526
21602024-12-21T07:48:50.894ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37526 req_id = ba2873c2-bbbb-48ce-a462-b2e0f779e0d0 response_code = 200 uri = /baseboard
21612024-12-21T07:48:59.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50111
21622024-12-21T07:48:59.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50111 req_id = 29db7aac-17be-4ecc-b8fb-41882ac2bccd response_code = 200 uri = /vpc-routes
21632024-12-21T07:48:59.852ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
21642024-12-21T07:48:59.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50111 req_id = 594b081d-6fdc-4bcf-9031-c9d3c78a18d0 response_code = 204 uri = /eip-gateways
21652024-12-21T07:48:59.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50111 req_id = a2f3aed4-f893-491f-beb3-87c31ca17806 response_code = 204 uri = /vpc-routes
21662024-12-21T07:49:00.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60048
21672024-12-21T07:49:00.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60048 req_id = 311722cd-8043-49bb-bab3-bba8aa32bc2f response_code = 200 uri = /v2p
21682024-12-21T07:49:00.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62949
21692024-12-21T07:49:00.130ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21702024-12-21T07:49:00.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21712024-12-21T07:49:00.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62949 req_id = adf73937-8641-4280-8aaa-1aa1d6386639 response_code = 204 uri = /switch-ports
21722024-12-21T07:49:00.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62949 req_id = 3945328a-b0b8-448e-a4ca-10cc162101de response_code = 200 uri = /network-bootstore-config
21732024-12-21T07:49:00.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45026
21742024-12-21T07:49:00.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45026 req_id = 3b45400a-66ca-49b6-8134-d95d845dfae8 response_code = 200 uri = /vpc-routes
21752024-12-21T07:49:01.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
21762024-12-21T07:49:01.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45026 req_id = 8400cb79-9e1a-487b-975c-8004a909a756 response_code = 204 uri = /eip-gateways
21772024-12-21T07:49:01.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45026 req_id = ff0450ef-4869-42f7-9f9e-dbae5a802830 response_code = 204 uri = /vpc-routes
21782024-12-21T07:49:01.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32988
21792024-12-21T07:49:01.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32988 req_id = 2ef76292-7512-4648-824a-29e3c9941a17 response_code = 200 uri = /vpc-routes
21802024-12-21T07:49:01.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
21812024-12-21T07:49:01.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32988 req_id = 6268b23b-269a-4b5a-8308-9446074c8689 response_code = 204 uri = /eip-gateways
21822024-12-21T07:49:01.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32988 req_id = 227c50b8-2305-4f4b-885f-c2103c643da7 response_code = 204 uri = /vpc-routes
21832024-12-21T07:49:01.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34609
21842024-12-21T07:49:01.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34609 req_id = 87d5d100-65dd-4f83-91d4-2c91fac75af8 response_code = 200 uri = /v2p
21852024-12-21T07:49:01.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37841
21862024-12-21T07:49:01.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37841 req_id = 10b98120-c104-497c-822d-88f4f42adea9 response_code = 200 uri = /v2p
21872024-12-21T07:49:01.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41615
21882024-12-21T07:49:01.295ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21892024-12-21T07:49:01.335ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21902024-12-21T07:49:01.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46980
21912024-12-21T07:49:01.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
21922024-12-21T07:49:01.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41615 req_id = 488a5a9c-249a-400a-9aa6-6a5a43e7bf9d response_code = 204 uri = /switch-ports
21932024-12-21T07:49:01.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41615 req_id = 47d3f3f4-42fd-4597-bafc-e0639a8b431f response_code = 200 uri = /network-bootstore-config
21942024-12-21T07:49:01.424ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
21952024-12-21T07:49:01.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138635 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46980 req_id = bb12715a-2ad1-41a0-b4ac-9c98432c6b73 response_code = 204 uri = /switch-ports
21962024-12-21T07:49:01.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46980 req_id = 8a6af4d9-0eb0-4e2c-a430-32d52c5fac64 response_code = 200 uri = /network-bootstore-config
21972024-12-21T07:49:19.781ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7599 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = ede8110b-3eb9-43e3-afb8-fd15d0761f10 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
21982024-12-21T07:49:20.927ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50762
21992024-12-21T07:49:20.927ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50762 req_id = 4701266b-482a-4f7c-8c0b-dc86ef046758 response_code = 200 uri = /baseboard
22002024-12-21T07:49:29.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50400
22012024-12-21T07:49:29.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50400 req_id = d156348a-8c77-4f39-a1c5-eef5e555ef11 response_code = 200 uri = /vpc-routes
22022024-12-21T07:49:29.656ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22032024-12-21T07:49:29.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50400 req_id = 9c60af90-5897-47fa-8862-04725fff5c18 response_code = 204 uri = /eip-gateways
22042024-12-21T07:49:29.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50400 req_id = bc7385ab-7d0c-46f1-a048-519183589e86 response_code = 204 uri = /vpc-routes
22052024-12-21T07:49:29.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52884
22062024-12-21T07:49:29.722ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22072024-12-21T07:49:29.759ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22082024-12-21T07:49:29.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52884 req_id = 548a1369-c1cd-46a9-9b33-ec70221f47c7 response_code = 204 uri = /switch-ports
22092024-12-21T07:49:29.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47530
22102024-12-21T07:49:29.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52884 req_id = 5ceff460-780a-4d55-9989-96985b7e7d1b response_code = 200 uri = /network-bootstore-config
22112024-12-21T07:49:29.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47530 req_id = e12e69a2-5d56-42c9-8bb2-d2a4ca2d57bf response_code = 200 uri = /v2p
22122024-12-21T07:49:30.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34166
22132024-12-21T07:49:30.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34166 req_id = 3d3ba719-a1c6-4b40-9d04-f7d0fdbf4cb7 response_code = 200 uri = /vpc-routes
22142024-12-21T07:49:30.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22152024-12-21T07:49:30.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34166 req_id = 665c6d7b-e819-452a-81c0-9865e738611e response_code = 204 uri = /eip-gateways
22162024-12-21T07:49:30.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34166 req_id = ae670836-5dba-4a2e-a694-ed819b0b5017 response_code = 204 uri = /vpc-routes
22172024-12-21T07:49:31.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60681
22182024-12-21T07:49:31.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60681 req_id = 50e52f51-3677-496d-bf1d-a88843d197cf response_code = 200 uri = /vpc-routes
22192024-12-21T07:49:31.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49330
22202024-12-21T07:49:31.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22212024-12-21T07:49:31.077ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22222024-12-21T07:49:31.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95076 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49330 req_id = 1be2d6db-6d57-4311-b3e2-a135a519b863 response_code = 204 uri = /switch-ports
22232024-12-21T07:49:31.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39440
22242024-12-21T07:49:31.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58156
22252024-12-21T07:49:31.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48589
22262024-12-21T07:49:31.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22272024-12-21T07:49:31.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60681 req_id = e11e7cd5-fffb-4588-bdc2-43601266ccd2 response_code = 204 uri = /eip-gateways
22282024-12-21T07:49:31.133ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22292024-12-21T07:49:31.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49330 req_id = 9efb8bdf-7c86-4e30-8edb-3c0cedaed8c9 response_code = 200 uri = /network-bootstore-config
22302024-12-21T07:49:31.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3818 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39440 req_id = 64e1b794-4828-46f8-aeba-7db30d60dea5 response_code = 200 uri = /v2p
22312024-12-21T07:49:31.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3799 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58156 req_id = 4fc4352e-1c4a-4a5c-97f6-e86e301359cd response_code = 200 uri = /v2p
22322024-12-21T07:49:31.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60681 req_id = da02533f-94f0-4a65-a846-062916ccabf0 response_code = 204 uri = /vpc-routes
22332024-12-21T07:49:31.170ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22342024-12-21T07:49:31.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48589 req_id = 1f8b1447-6de8-4584-a0eb-ed4f0747c07f response_code = 204 uri = /switch-ports
22352024-12-21T07:49:31.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48589 req_id = 4c73bb4c-b0a8-46a7-8f95-38a9bd6372e0 response_code = 200 uri = /network-bootstore-config
22362024-12-21T07:49:49.781ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7333 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 8f85cd53-bf46-4ccf-9b30-29074818f1e5 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22372024-12-21T07:49:50.962ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35670
22382024-12-21T07:49:50.962ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35670 req_id = 1eaf706e-c6ff-494d-9649-4f9d2184bbeb response_code = 200 uri = /baseboard
22392024-12-21T07:49:59.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51364
22402024-12-21T07:49:59.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51364 req_id = 468cc710-9320-4388-9de7-8c5cdca08689 response_code = 200 uri = /vpc-routes
22412024-12-21T07:49:59.740ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22422024-12-21T07:49:59.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51364 req_id = 6adcfc68-ac75-457e-984b-9b1e1f1f2acd response_code = 204 uri = /eip-gateways
22432024-12-21T07:49:59.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51364 req_id = 3df6a7e0-58fa-44ec-b353-5821070b1083 response_code = 204 uri = /vpc-routes
22442024-12-21T07:49:59.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48666
22452024-12-21T07:49:59.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48666 req_id = b93d29f6-a8b6-4600-b3ea-ea7a6e048043 response_code = 200 uri = /v2p
22462024-12-21T07:49:59.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44793
22472024-12-21T07:49:59.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22482024-12-21T07:50:00.002ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22492024-12-21T07:50:00.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44793 req_id = 10c3e22e-3bf0-465a-a519-7573d80a2f2b response_code = 204 uri = /switch-ports
22502024-12-21T07:50:00.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44793 req_id = 77156c7e-c653-4c23-baa7-63a3bb509b10 response_code = 200 uri = /network-bootstore-config
22512024-12-21T07:50:01.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53266
22522024-12-21T07:50:01.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53266 req_id = 744d4a2f-e797-45a6-93a9-b8e688f92f6b response_code = 200 uri = /vpc-routes
22532024-12-21T07:50:01.121ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22542024-12-21T07:50:01.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53266 req_id = 39abd89b-7c74-4ab5-9eb7-9460865dd312 response_code = 204 uri = /eip-gateways
22552024-12-21T07:50:01.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53266 req_id = d769f8e9-1cba-45d6-beec-9e6420910df8 response_code = 204 uri = /vpc-routes
22562024-12-21T07:50:01.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36238
22572024-12-21T07:50:01.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36238 req_id = 6d646351-81af-47e1-9ac0-bf4cb472084a response_code = 200 uri = /vpc-routes
22582024-12-21T07:50:01.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22592024-12-21T07:50:01.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36238 req_id = f25b1b98-afa5-4273-8e49-43b997b4d645 response_code = 204 uri = /eip-gateways
22602024-12-21T07:50:01.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36238 req_id = a1e2bfe5-06ff-4834-abff-09292d9fc231 response_code = 204 uri = /vpc-routes
22612024-12-21T07:50:01.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56756
22622024-12-21T07:50:01.314ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22632024-12-21T07:50:01.357ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22642024-12-21T07:50:01.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56756 req_id = 29b9648b-6285-4a26-ad60-1ac4b2ffe0ac response_code = 204 uri = /switch-ports
22652024-12-21T07:50:01.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38312
22662024-12-21T07:50:01.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38312 req_id = d23067cc-f3aa-4f2d-aa8e-ff6896aa5782 response_code = 200 uri = /v2p
22672024-12-21T07:50:01.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56756 req_id = f1a65eb3-837a-4fb1-bd55-d8e973892ade response_code = 200 uri = /network-bootstore-config
22682024-12-21T07:50:01.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62937
22692024-12-21T07:50:01.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62937 req_id = 8c89306d-5e79-4d92-afd7-74d81b13d116 response_code = 200 uri = /v2p
22702024-12-21T07:50:01.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41134
22712024-12-21T07:50:01.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22722024-12-21T07:50:01.563ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22732024-12-21T07:50:01.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89862 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41134 req_id = 0445869a-164e-4d5e-9523-0a8a0ced8ae2 response_code = 204 uri = /switch-ports
22742024-12-21T07:50:01.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41134 req_id = d874eb3c-c404-4b58-93d8-a3d69852955f response_code = 200 uri = /network-bootstore-config
22752024-12-21T07:50:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7233 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = ad06233a-dc7e-4944-8999-306c21fa5c44 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
22762024-12-21T07:50:20.995ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42702
22772024-12-21T07:50:20.996ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42702 req_id = 5d13df05-72ec-4979-842a-2862be90684e response_code = 200 uri = /baseboard
22782024-12-21T07:50:29.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62803
22792024-12-21T07:50:29.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62803 req_id = 6848e9ab-7c55-411a-9c9d-9659b10ca51f response_code = 200 uri = /vpc-routes
22802024-12-21T07:50:29.721ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22812024-12-21T07:50:29.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62803 req_id = bcb5e061-6327-4622-a4e8-b01ab30fa0b7 response_code = 204 uri = /eip-gateways
22822024-12-21T07:50:29.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62803 req_id = a18636f0-a40e-4518-a63e-3e33ffd18b07 response_code = 204 uri = /vpc-routes
22832024-12-21T07:50:29.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55952
22842024-12-21T07:50:29.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55952 req_id = 3115c917-bd47-4c13-bc11-640733f4a929 response_code = 200 uri = /v2p
22852024-12-21T07:50:29.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34034
22862024-12-21T07:50:29.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22872024-12-21T07:50:29.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22882024-12-21T07:50:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34034 req_id = 730f0525-f0a0-4e07-9cc7-b980240d2b82 response_code = 204 uri = /switch-ports
22892024-12-21T07:50:29.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34034 req_id = 5b18ed0a-217a-4ea1-9a70-ee1ff94e90d8 response_code = 200 uri = /network-bootstore-config
22902024-12-21T07:50:30.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49251
22912024-12-21T07:50:30.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49251 req_id = 0c32818e-08ad-49db-9469-fcd4d583085c response_code = 200 uri = /vpc-routes
22922024-12-21T07:50:30.903ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
22932024-12-21T07:50:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49251 req_id = 6e24b300-acc2-49ea-a070-2988658e616c response_code = 204 uri = /eip-gateways
22942024-12-21T07:50:30.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49251 req_id = 58fe004b-3d98-4718-b5f2-c15e94347957 response_code = 204 uri = /vpc-routes
22952024-12-21T07:50:30.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43614
22962024-12-21T07:50:30.951ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
22972024-12-21T07:50:30.992ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
22982024-12-21T07:50:31.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43614 req_id = d9ad8ac2-a4ed-4d7a-bf32-0870859909c5 response_code = 204 uri = /switch-ports
22992024-12-21T07:50:31.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36784
23002024-12-21T07:50:31.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36784 req_id = 10be88f6-364b-4b17-95ac-f5ee1eb70da3 response_code = 200 uri = /vpc-routes
23012024-12-21T07:50:31.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43614 req_id = 8029682b-dacb-4e2b-869f-f735b9b877c4 response_code = 200 uri = /network-bootstore-config
23022024-12-21T07:50:31.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44004
23032024-12-21T07:50:31.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44004 req_id = 8a51d8ea-ca29-4409-a679-006ba39ef8d8 response_code = 200 uri = /v2p
23042024-12-21T07:50:31.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41445
23052024-12-21T07:50:31.069ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23062024-12-21T07:50:31.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23072024-12-21T07:50:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41445 req_id = 05936237-ca23-4480-8b70-b6e333c194d0 response_code = 204 uri = /switch-ports
23082024-12-21T07:50:31.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40132
23092024-12-21T07:50:31.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23102024-12-21T07:50:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36784 req_id = 9e27480b-f72f-4b1f-bf75-2a06ee6910c0 response_code = 204 uri = /eip-gateways
23112024-12-21T07:50:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41445 req_id = 8ec8c6f2-0777-47e1-b577-3b5fdac45f49 response_code = 200 uri = /network-bootstore-config
23122024-12-21T07:50:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40132 req_id = e7ef4b91-e208-42e9-a7b8-0bb12a080a76 response_code = 200 uri = /v2p
23132024-12-21T07:50:31.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36784 req_id = 4e1d3f52-be13-484a-b2fb-858c7b0cebbc response_code = 204 uri = /vpc-routes
23142024-12-21T07:50:48.127ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23152024-12-21T07:50:48.129ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23162024-12-21T07:50:48.161ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1981, tv_nsec: 860841605 } time_to_next_cleanup = 599.99999985s
23172024-12-21T07:50:49.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8482 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 4fb28f50-0d3e-4993-a86b-de721bde43d2 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
23182024-12-21T07:50:51.029ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55907
23192024-12-21T07:50:51.029ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55907 req_id = 54bf854b-93ec-4e8c-a778-3f278818c808 response_code = 200 uri = /baseboard
23202024-12-21T07:50:59.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58804
23212024-12-21T07:50:59.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58804 req_id = 89c2fc0f-4aef-4060-bdf4-aa4d09e1f646 response_code = 200 uri = /vpc-routes
23222024-12-21T07:50:59.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23232024-12-21T07:50:59.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58804 req_id = 513a6e2a-b805-4601-9cd5-c7cdc3921737 response_code = 204 uri = /eip-gateways
23242024-12-21T07:50:59.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42836
23252024-12-21T07:50:59.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42836 req_id = 0e330d68-481a-4736-9296-d910b2695262 response_code = 200 uri = /v2p
23262024-12-21T07:50:59.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58804 req_id = b53d0e0a-fc9e-4916-8c63-5cf9c7cf2107 response_code = 204 uri = /vpc-routes
23272024-12-21T07:50:59.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39918
23282024-12-21T07:50:59.979ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23292024-12-21T07:51:00.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23302024-12-21T07:51:00.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87163 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39918 req_id = 9fe7add3-d04a-4eb7-a75e-3a1af08c4149 response_code = 204 uri = /switch-ports
23312024-12-21T07:51:00.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39918 req_id = 4971aa80-6b43-4c60-83a3-c65c85f719d0 response_code = 200 uri = /network-bootstore-config
23322024-12-21T07:51:01.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43325
23332024-12-21T07:51:01.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43325 req_id = 4c0eaa57-c26c-4c54-8346-9905cd711e97 response_code = 200 uri = /vpc-routes
23342024-12-21T07:51:01.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50524
23352024-12-21T07:51:01.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50524 req_id = ecb01139-676f-4c63-a962-96f5870e5510 response_code = 200 uri = /vpc-routes
23362024-12-21T07:51:01.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23372024-12-21T07:51:01.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43325 req_id = c00cbd09-7ffd-49fc-af6b-641671c98fd1 response_code = 204 uri = /eip-gateways
23382024-12-21T07:51:01.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23392024-12-21T07:51:01.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50524 req_id = ceece966-6850-430f-ba76-8b11a4a32e53 response_code = 204 uri = /eip-gateways
23402024-12-21T07:51:01.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50524 req_id = 0f8f95de-b0d1-4055-99f7-5497f204aa02 response_code = 204 uri = /vpc-routes
23412024-12-21T07:51:01.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41300
23422024-12-21T07:51:01.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41300 req_id = 0bf7b3c5-552b-4f7c-99c6-189239fcc7c4 response_code = 200 uri = /v2p
23432024-12-21T07:51:01.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37730
23442024-12-21T07:51:01.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23452024-12-21T07:51:01.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23462024-12-21T07:51:01.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94574 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37730 req_id = 9443a856-e52e-4c06-818d-cc5a49f45740 response_code = 204 uri = /switch-ports
23472024-12-21T07:51:01.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37730 req_id = 97083fcb-da46-476f-b402-aa61b419b409 response_code = 200 uri = /network-bootstore-config
23482024-12-21T07:51:01.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58460
23492024-12-21T07:51:01.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58460 req_id = a2cbbd64-1056-43ce-b9b7-3d575f3d06ff response_code = 200 uri = /v2p
23502024-12-21T07:51:01.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43325 req_id = 5228d941-8467-4ede-a87a-25f8e0a627cc response_code = 204 uri = /vpc-routes
23512024-12-21T07:51:01.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32995
23522024-12-21T07:51:01.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23532024-12-21T07:51:01.435ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23542024-12-21T07:51:01.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83306 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32995 req_id = 2ec0737b-37a1-420c-8829-a16f7c4f9732 response_code = 204 uri = /switch-ports
23552024-12-21T07:51:01.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32995 req_id = 7f9f545e-fc2a-4114-93a7-cd25d2e19dbf response_code = 200 uri = /network-bootstore-config
23562024-12-21T07:51:02.537ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23572024-12-21T07:51:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7254 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 09b86e30-849f-4f6f-9b9f-fccd5f54117f response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
23582024-12-21T07:51:21.063ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60165
23592024-12-21T07:51:21.063ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60165 req_id = a71f2e20-16d4-4ea6-b603-d749447f0342 response_code = 200 uri = /baseboard
23602024-12-21T07:51:29.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46462
23612024-12-21T07:51:29.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46462 req_id = 857f1386-9632-49a3-9eae-f1d9d1ae0171 response_code = 200 uri = /vpc-routes
23622024-12-21T07:51:29.662ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23632024-12-21T07:51:29.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46462 req_id = e418dab9-34dd-4fc0-a45e-b1c4c4662a36 response_code = 204 uri = /eip-gateways
23642024-12-21T07:51:29.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36267
23652024-12-21T07:51:29.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36267 req_id = 694b03ea-0b55-46ce-b908-61152951071c response_code = 200 uri = /v2p
23662024-12-21T07:51:29.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46462 req_id = d9f4112a-5e55-4966-97e7-5e9b179b460b response_code = 204 uri = /vpc-routes
23672024-12-21T07:51:29.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61735
23682024-12-21T07:51:29.813ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23692024-12-21T07:51:29.850ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23702024-12-21T07:51:29.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91097 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61735 req_id = f061c3c8-97c8-4822-a740-8c8b4c351b3f response_code = 204 uri = /switch-ports
23712024-12-21T07:51:29.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61735 req_id = a3882738-7eb3-432e-acb7-25519fb2462f response_code = 200 uri = /network-bootstore-config
23722024-12-21T07:51:30.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51055
23732024-12-21T07:51:30.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51055 req_id = d9ed4096-fd16-458c-9406-3e25be003e86 response_code = 200 uri = /vpc-routes
23742024-12-21T07:51:30.925ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23752024-12-21T07:51:30.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51055 req_id = d295d19b-21e4-4806-bf05-00781d34957f response_code = 204 uri = /eip-gateways
23762024-12-21T07:51:30.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51055 req_id = 9a8d040e-e7af-44ac-87a4-8d481a38974e response_code = 204 uri = /vpc-routes
23772024-12-21T07:51:30.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57719
23782024-12-21T07:51:30.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57719 req_id = 31185c08-4c19-42c1-b15e-1845082971af response_code = 200 uri = /v2p
23792024-12-21T07:51:30.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57113
23802024-12-21T07:51:30.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57113 req_id = 17e568f7-d7a8-48f6-a0f9-7bcbfd849274 response_code = 200 uri = /vpc-routes
23812024-12-21T07:51:30.991ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
23822024-12-21T07:51:30.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57113 req_id = 7203ebed-d2e4-4cf8-926b-42ed49576535 response_code = 204 uri = /eip-gateways
23832024-12-21T07:51:30.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39827
23842024-12-21T07:51:30.992ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23852024-12-21T07:51:31.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23862024-12-21T07:51:31.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39827 req_id = 03d86b16-3dff-4c83-90b8-4c2d37101b9c response_code = 204 uri = /switch-ports
23872024-12-21T07:51:31.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44632
23882024-12-21T07:51:31.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61310
23892024-12-21T07:51:31.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39827 req_id = cf1e7e6e-094e-45a0-9bc1-5b6cc5862b23 response_code = 200 uri = /network-bootstore-config
23902024-12-21T07:51:31.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 611 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57113 req_id = d2e4162d-1817-477e-91d8-2425d268642d response_code = 204 uri = /vpc-routes
23912024-12-21T07:51:31.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
23922024-12-21T07:51:31.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44632 req_id = 0fe0adbc-3481-4f2c-ba14-f4f37afd1c3a response_code = 200 uri = /v2p
23932024-12-21T07:51:31.128ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
23942024-12-21T07:51:31.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61310 req_id = 0dd2e832-a88a-46ba-9a7b-078e33ac61fa response_code = 204 uri = /switch-ports
23952024-12-21T07:51:31.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61310 req_id = b4a0bd5b-da17-41f0-a234-cc4ec5f5057f response_code = 200 uri = /network-bootstore-config
23962024-12-21T07:51:49.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7376 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 1d69fd39-718c-4c57-8c4c-29dbba0330e8 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
23972024-12-21T07:51:51.096ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43648
23982024-12-21T07:51:51.096ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43648 req_id = 4262af65-9e0e-46b4-9049-74811d50452d response_code = 200 uri = /baseboard
23992024-12-21T07:51:59.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61046
24002024-12-21T07:51:59.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61046 req_id = ed7d611a-1695-407a-9efa-8503184d1d91 response_code = 200 uri = /vpc-routes
24012024-12-21T07:51:59.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24022024-12-21T07:51:59.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61046 req_id = f5faf1bb-0d8b-47ee-94d5-421a80b4de14 response_code = 204 uri = /eip-gateways
24032024-12-21T07:51:59.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61046 req_id = 9cb926bb-8e07-46fd-b0e2-25ef335f1ef6 response_code = 204 uri = /vpc-routes
24042024-12-21T07:51:59.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61355
24052024-12-21T07:51:59.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61355 req_id = b7f7eff5-b04e-40ac-8739-7b25ece11566 response_code = 200 uri = /v2p
24062024-12-21T07:52:00.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55174
24072024-12-21T07:52:00.175ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24082024-12-21T07:52:00.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24092024-12-21T07:52:00.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99371 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55174 req_id = 85c72327-27c2-4248-802b-5297fd2df878 response_code = 204 uri = /switch-ports
24102024-12-21T07:52:00.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55174 req_id = f151847f-955b-4dce-acaf-716ab657ab59 response_code = 200 uri = /network-bootstore-config
24112024-12-21T07:52:00.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33034
24122024-12-21T07:52:00.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33034 req_id = 55a6e682-2d6a-46a8-afd2-16e4f90b259e response_code = 200 uri = /vpc-routes
24132024-12-21T07:52:01.045ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24142024-12-21T07:52:01.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33034 req_id = 74a85618-3b3c-47cf-b513-742a4e925291 response_code = 204 uri = /eip-gateways
24152024-12-21T07:52:01.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33034 req_id = 8f1ccab2-37e9-45fe-9d27-1e5057b515f3 response_code = 204 uri = /vpc-routes
24162024-12-21T07:52:01.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48131
24172024-12-21T07:52:01.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48131 req_id = b42080f6-08ae-4831-99e2-386fc463cd51 response_code = 200 uri = /vpc-routes
24182024-12-21T07:52:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64806
24192024-12-21T07:52:01.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64806 req_id = bf25b059-b527-4684-9454-452123230e2b response_code = 200 uri = /v2p
24202024-12-21T07:52:01.104ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24212024-12-21T07:52:01.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48131 req_id = b45e7819-cfe2-45aa-8b88-7ff6906cb334 response_code = 204 uri = /eip-gateways
24222024-12-21T07:52:01.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48131 req_id = c96eca37-4fdc-472f-bfe2-c6091ae0ea86 response_code = 204 uri = /vpc-routes
24232024-12-21T07:52:01.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49788
24242024-12-21T07:52:01.178ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24252024-12-21T07:52:01.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24262024-12-21T07:52:01.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98214 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49788 req_id = dbb9a3ed-594d-496d-9c88-0281709ab803 response_code = 204 uri = /switch-ports
24272024-12-21T07:52:01.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49788 req_id = 023aa9a3-bf8f-4927-af93-c6aa56b86ee7 response_code = 200 uri = /network-bootstore-config
24282024-12-21T07:52:01.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47367
24292024-12-21T07:52:01.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47367 req_id = 45ec5552-504f-4cf3-a89c-f094be35c24f response_code = 200 uri = /v2p
24302024-12-21T07:52:01.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61778
24312024-12-21T07:52:01.591ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24322024-12-21T07:52:01.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24332024-12-21T07:52:01.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61778 req_id = a245e8f8-809d-4ddb-9305-12e5a1b9ea96 response_code = 204 uri = /switch-ports
24342024-12-21T07:52:01.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61778 req_id = 770dfa8d-2ccd-4a6f-8837-47128cf03f06 response_code = 200 uri = /network-bootstore-config
24352024-12-21T07:52:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7309 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 6539dd79-6dd3-49f1-9fc2-e0cc447b5fec response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
24362024-12-21T07:52:21.127ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58892
24372024-12-21T07:52:21.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58892 req_id = d63bf1ba-2aee-474e-96d8-dbfd25529411 response_code = 200 uri = /baseboard
24382024-12-21T07:52:29.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65044
24392024-12-21T07:52:29.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65044 req_id = 3a6d50da-3c25-4def-9155-b63716f2c7df response_code = 200 uri = /vpc-routes
24402024-12-21T07:52:29.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24412024-12-21T07:52:29.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65044 req_id = 4150a60b-a857-4673-aa87-32891c9c3d1a response_code = 204 uri = /eip-gateways
24422024-12-21T07:52:29.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65044 req_id = 6e14d949-cec3-4dd4-b378-d1bd82bc2fd5 response_code = 204 uri = /vpc-routes
24432024-12-21T07:52:29.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33225
24442024-12-21T07:52:29.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33225 req_id = 3e4c87bb-ddd9-4c5e-bccc-dd744dacb2b1 response_code = 200 uri = /v2p
24452024-12-21T07:52:29.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35292
24462024-12-21T07:52:29.763ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24472024-12-21T07:52:29.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24482024-12-21T07:52:29.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35292 req_id = 998f7337-d7f1-47eb-a0e2-fa4ab3b4f16c response_code = 204 uri = /switch-ports
24492024-12-21T07:52:29.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35292 req_id = 20c848bb-9e26-43dc-944b-e84324dd1056 response_code = 200 uri = /network-bootstore-config
24502024-12-21T07:52:30.903ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36392
24512024-12-21T07:52:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36392 req_id = a01faff7-132e-4d5b-96d2-354ccf47f563 response_code = 200 uri = /vpc-routes
24522024-12-21T07:52:30.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24532024-12-21T07:52:30.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36392 req_id = 11cbf173-4d7b-4786-92b7-60c95e1d1821 response_code = 204 uri = /eip-gateways
24542024-12-21T07:52:30.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36392 req_id = 2704db86-81de-462d-8cf4-4e13a2ba26a7 response_code = 204 uri = /vpc-routes
24552024-12-21T07:52:30.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41084
24562024-12-21T07:52:30.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41084 req_id = 7bd745f6-5b7e-4f29-a102-672830a7cfce response_code = 200 uri = /v2p
24572024-12-21T07:52:30.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36031
24582024-12-21T07:52:30.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36031 req_id = 0794c6fb-3ec5-4914-8d63-f1a79fae8c22 response_code = 200 uri = /vpc-routes
24592024-12-21T07:52:31.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41119
24602024-12-21T07:52:31.003ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24612024-12-21T07:52:31.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24622024-12-21T07:52:31.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97660 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41119 req_id = cf89c804-0348-42c3-81e4-ce4ca8390295 response_code = 204 uri = /switch-ports
24632024-12-21T07:52:31.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56974
24642024-12-21T07:52:31.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24652024-12-21T07:52:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36031 req_id = a91e0895-ee2b-453c-85f9-cacddcb15654 response_code = 204 uri = /eip-gateways
24662024-12-21T07:52:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41119 req_id = 1daa3bee-fa6b-4a45-a0ad-150c4805e086 response_code = 200 uri = /network-bootstore-config
24672024-12-21T07:52:31.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56974 req_id = 52c4886d-436e-4c56-ba86-44273783130a response_code = 200 uri = /v2p
24682024-12-21T07:52:31.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36031 req_id = 4965b8e3-8ba4-4884-8ea2-72b5ff986372 response_code = 204 uri = /vpc-routes
24692024-12-21T07:52:31.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40001
24702024-12-21T07:52:31.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24712024-12-21T07:52:31.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24722024-12-21T07:52:31.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40001 req_id = 1deefb84-2dff-472d-95e1-b80e70d19c7a response_code = 204 uri = /switch-ports
24732024-12-21T07:52:31.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40001 req_id = 8301c84b-6b4f-4326-9b54-7b4f03acd91f response_code = 200 uri = /network-bootstore-config
24742024-12-21T07:52:49.783ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8449 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = a2e768ab-898f-4d23-b60e-54ed4264fe76 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
24752024-12-21T07:52:51.160ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60888
24762024-12-21T07:52:51.161ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60888 req_id = 8095a26e-6150-4c73-8e9f-252ce090b25f response_code = 200 uri = /baseboard
24772024-12-21T07:52:59.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34313
24782024-12-21T07:52:59.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34313 req_id = eb9875a2-f5a7-45e5-b734-ae5f9ef0e67e response_code = 200 uri = /vpc-routes
24792024-12-21T07:52:59.819ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
24802024-12-21T07:52:59.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34313 req_id = fcebd6f5-a049-4d9e-80eb-819d407ff2fe response_code = 204 uri = /eip-gateways
24812024-12-21T07:52:59.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34313 req_id = 739a3915-27c6-46a7-84da-8c2f919dbe21 response_code = 204 uri = /vpc-routes
24822024-12-21T07:53:00.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63830
24832024-12-21T07:53:00.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24842024-12-21T07:53:00.011ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24852024-12-21T07:53:00.011ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
24862024-12-21T07:53:00.014ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
24872024-12-21T07:53:00.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58670
24882024-12-21T07:53:00.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58670 req_id = a40580e2-89b6-4a14-a387-688a00f9d9c1 response_code = 200 uri = /v2p
24892024-12-21T07:53:00.025ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24902024-12-21T07:53:00.025ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62
24912024-12-21T07:53:00.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53107
24922024-12-21T07:53:00.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
24932024-12-21T07:53:00.049ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24942024-12-21T07:53:00.049ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54c8850c-5a87-4b82-9026-6ccf6d846961
24952024-12-21T07:53:00.073ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24962024-12-21T07:53:00.073ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45666343-e064-4cc6-881c-0d53aea79e05
24972024-12-21T07:53:00.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
24982024-12-21T07:53:00.097ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24992024-12-21T07:53:00.097ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5
25002024-12-21T07:53:00.122ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25012024-12-21T07:53:00.122ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a
25022024-12-21T07:53:00.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99203 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53107 req_id = 573cd08f-fd91-4b9d-9e28-bbd9df516d8b response_code = 204 uri = /switch-ports
25032024-12-21T07:53:00.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53107 req_id = 7d77a20c-1d6f-4f8c-b81c-8f879c8639f9 response_code = 200 uri = /network-bootstore-config
25042024-12-21T07:53:00.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25052024-12-21T07:53:00.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f16a4591-8357-4fd5-b354-0deda45e4488
25062024-12-21T07:53:00.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54574
25072024-12-21T07:53:00.167ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25082024-12-21T07:53:00.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25092024-12-21T07:53:00.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25102024-12-21T07:53:00.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25112024-12-21T07:53:00.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25122024-12-21T07:53:00.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25132024-12-21T07:53:00.168ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25142024-12-21T07:53:00.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54574 req_id = 50edab57-29fa-47b6-8700-ad6ae20c5b6a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25152024-12-21T07:53:00.170ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25162024-12-21T07:53:00.170ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87
25172024-12-21T07:53:00.193ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25182024-12-21T07:53:00.193ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83
25192024-12-21T07:53:00.213ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25202024-12-21T07:53:00.213ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026
25212024-12-21T07:53:00.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212779 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63830 req_id = 6e20496c-673a-4881-a3b1-060174ee5213 response_code = 200 uri = /inventory
25222024-12-21T07:53:01.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52786
25232024-12-21T07:53:01.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52786 req_id = 89f89460-7530-4fef-89de-341cf4feeebd response_code = 200 uri = /vpc-routes
25242024-12-21T07:53:01.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44713
25252024-12-21T07:53:01.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44713 req_id = 07afa8d7-2143-4a98-9039-d49de3784e4b response_code = 200 uri = /v2p
25262024-12-21T07:53:01.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
25272024-12-21T07:53:01.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52786 req_id = 863aa204-f46e-4e1b-b275-8d7a7ad6604b response_code = 204 uri = /eip-gateways
25282024-12-21T07:53:01.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46599
25292024-12-21T07:53:01.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25302024-12-21T07:53:01.126ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25312024-12-21T07:53:01.126ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
25322024-12-21T07:53:01.127ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
25332024-12-21T07:53:01.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52786 req_id = 778d56cb-d489-4ca8-8187-c6ae037dc580 response_code = 204 uri = /vpc-routes
25342024-12-21T07:53:01.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25352024-12-21T07:53:01.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62
25362024-12-21T07:53:01.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42406
25372024-12-21T07:53:01.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25382024-12-21T07:53:01.170ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25392024-12-21T07:53:01.170ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54c8850c-5a87-4b82-9026-6ccf6d846961
25402024-12-21T07:53:01.200ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25412024-12-21T07:53:01.200ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45666343-e064-4cc6-881c-0d53aea79e05
25422024-12-21T07:53:01.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25432024-12-21T07:53:01.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49425
25442024-12-21T07:53:01.224ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25452024-12-21T07:53:01.224ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25462024-12-21T07:53:01.225ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472024-12-21T07:53:01.225ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25482024-12-21T07:53:01.225ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25492024-12-21T07:53:01.225ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25502024-12-21T07:53:01.225ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25512024-12-21T07:53:01.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49425 req_id = 3a4febc0-543e-4af0-af3d-5dcde0135643 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25522024-12-21T07:53:01.227ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25532024-12-21T07:53:01.227ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5
25542024-12-21T07:53:01.237ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34210
25552024-12-21T07:53:01.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34210 req_id = a3068c94-409a-4c50-86ac-63dcfe171c95 response_code = 200 uri = /v2p
25562024-12-21T07:53:01.251ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25572024-12-21T07:53:01.251ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a
25582024-12-21T07:53:01.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42406 req_id = 52a17797-8fe8-4f9b-b341-84e1a7bd0798 response_code = 204 uri = /switch-ports
25592024-12-21T07:53:01.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42406 req_id = 5ad8b5e7-6fc5-4b8e-aeec-a64af95ec003 response_code = 200 uri = /network-bootstore-config
25602024-12-21T07:53:01.276ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25612024-12-21T07:53:01.276ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f16a4591-8357-4fd5-b354-0deda45e4488
25622024-12-21T07:53:01.297ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25632024-12-21T07:53:01.297ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87
25642024-12-21T07:53:01.318ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25652024-12-21T07:53:01.318ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83
25662024-12-21T07:53:01.337ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25672024-12-21T07:53:01.337ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026
25682024-12-21T07:53:01.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62281
25692024-12-21T07:53:01.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62281 req_id = 94af736c-2161-4a64-93c3-7e30fe72eddd response_code = 200 uri = /vpc-routes
25702024-12-21T07:53:01.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46599 req_id = 4978aa15-cd91-4f99-8373-b0b1893d2247 response_code = 200 uri = /inventory
25712024-12-21T07:53:01.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50325
25722024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 06368864-4b29-42bd-ae60-c6735712620d, kind: Service { id: b2ae004a-4c01-4dcf-8e90-49ba61c66084 }, name: Name("external-dns-b2ae004a-4c01-4dcf-8e90-49ba61c66084"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 32])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa85cda4-dfd2-46dc-aa66-9384e585dcaf, kind: Service { id: 4dd95bbd-e009-486c-8c96-451a6e195a49 }, name: Name("external-dns-4dd95bbd-e009-486c-8c96-451a6e195a49"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 195])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1590b051-5b52-401c-b768-bbef4af00f89, kind: Service { id: bf6abf36-caab-412a-b734-038cee4a46b6 }, name: Name("nexus-bf6abf36-caab-412a-b734-038cee4a46b6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 220])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 2a0ff22a-6a78-4cb0-b61d-38c999331844, kind: Service { id: e640ec59-1392-402a-8715-71c8bdc91537 }, name: Name("nexus-e640ec59-1392-402a-8715-71c8bdc91537"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 32])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd0592d1-5774-4ea2-8826-dec211cc7fec, kind: Service { id: a920b126-b55b-45c8-9984-5279bf662759 }, name: Name("nexus-a920b126-b55b-45c8-9984-5279bf662759"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 135, 242])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25732024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25742024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25752024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25762024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25772024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25782024-12-21T07:53:01.356ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25792024-12-21T07:53:01.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50325 req_id = a62707b9-5414-4bb7-9fb5-1b11d4a2e422 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25802024-12-21T07:53:01.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
25812024-12-21T07:53:01.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62281 req_id = 91d62cb5-9b4c-4622-aea1-de4b32549cca response_code = 204 uri = /eip-gateways
25822024-12-21T07:53:01.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42741
25832024-12-21T07:53:01.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25842024-12-21T07:53:01.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25852024-12-21T07:53:01.487ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/config/omicron-zones.json file = common/src/ledger.rs:177
25862024-12-21T07:53:01.488ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/config/omicron-zones.json file = common/src/ledger.rs:177
25872024-12-21T07:53:01.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62281 req_id = 573031b0-6376-45c4-b194-86a67cb80f0b response_code = 204 uri = /vpc-routes
25882024-12-21T07:53:01.500ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 15031ef1-5ce4-46cf-9cca-61ffe6220c62 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25892024-12-21T07:53:01.500ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_15031ef1-5ce4-46cf-9cca-61ffe6220c62
25902024-12-21T07:53:01.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35369
25912024-12-21T07:53:01.511ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
25922024-12-21T07:53:01.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 54c8850c-5a87-4b82-9026-6ccf6d846961 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25932024-12-21T07:53:01.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_54c8850c-5a87-4b82-9026-6ccf6d846961
25942024-12-21T07:53:01.558ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
25952024-12-21T07:53:01.561ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 45666343-e064-4cc6-881c-0d53aea79e05 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25962024-12-21T07:53:01.561ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_45666343-e064-4cc6-881c-0d53aea79e05
25972024-12-21T07:53:01.588ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1482623f-a17a-45aa-b7a8-d8859ef889d5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25982024-12-21T07:53:01.588ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_1482623f-a17a-45aa-b7a8-d8859ef889d5
25992024-12-21T07:53:01.611ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ac5724dd-ceb6-4376-bb77-343c6be7224a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26002024-12-21T07:53:01.611ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ac5724dd-ceb6-4376-bb77-343c6be7224a
26012024-12-21T07:53:01.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108997 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35369 req_id = 54b7d056-e418-45f1-aae6-b048397d9b28 response_code = 204 uri = /switch-ports
26022024-12-21T07:53:01.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35369 req_id = c3a7a7e3-549b-448d-809e-36598053933e response_code = 200 uri = /network-bootstore-config
26032024-12-21T07:53:01.632ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f16a4591-8357-4fd5-b354-0deda45e4488 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26042024-12-21T07:53:01.632ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f16a4591-8357-4fd5-b354-0deda45e4488
26052024-12-21T07:53:01.653ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5e489682-2a3a-407d-8c08-3d48ddf3ef87 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26062024-12-21T07:53:01.653ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5e489682-2a3a-407d-8c08-3d48ddf3ef87
26072024-12-21T07:53:01.674ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db433b7a-dcc2-4a06-ba23-26f814d97a83 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26082024-12-21T07:53:01.674ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db433b7a-dcc2-4a06-ba23-26f814d97a83
26092024-12-21T07:53:01.694ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 418588b4-b6f1-4ddb-8c6d-76d4eb891026 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26102024-12-21T07:53:01.694ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_418588b4-b6f1-4ddb-8c6d-76d4eb891026
26112024-12-21T07:53:01.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219000 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42741 req_id = 930928c3-9676-4da9-9f34-856cc06bb263 response_code = 200 uri = /inventory
26122024-12-21T07:53:19.783ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8854 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = 099e6b44-3c40-4193-b30a-0ffd6ce4f46b response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26132024-12-21T07:53:21.195ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47063
26142024-12-21T07:53:21.195ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47063 req_id = ce6c2fa3-98bb-478b-b8cf-c6549623582a response_code = 200 uri = /baseboard
26152024-12-21T07:53:29.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39609
26162024-12-21T07:53:29.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39609 req_id = 0f696fba-284c-4faa-8ab7-dcb25f047d54 response_code = 200 uri = /vpc-routes
26172024-12-21T07:53:29.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26182024-12-21T07:53:29.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39609 req_id = 8cf9bac8-bda0-4abc-86ce-b9c55ecb980e response_code = 204 uri = /eip-gateways
26192024-12-21T07:53:29.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39609 req_id = b30ef2d6-8d8b-4c41-a589-3f6b8033486e response_code = 204 uri = /vpc-routes
26202024-12-21T07:53:29.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60148
26212024-12-21T07:53:29.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26222024-12-21T07:53:29.839ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26232024-12-21T07:53:29.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60148 req_id = c8cb632a-5120-4308-b85f-61c61ccaeee7 response_code = 204 uri = /switch-ports
26242024-12-21T07:53:29.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42806
26252024-12-21T07:53:29.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42806 req_id = 800a9148-8200-4910-8558-a0dc87a99f05 response_code = 200 uri = /v2p
26262024-12-21T07:53:29.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60148 req_id = a1ff3637-31f8-4d96-af4e-1a40e894c725 response_code = 200 uri = /network-bootstore-config
26272024-12-21T07:53:30.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38539
26282024-12-21T07:53:30.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38539 req_id = db50eb22-f015-45d9-ad09-b8994b3ab0e6 response_code = 200 uri = /vpc-routes
26292024-12-21T07:53:30.888ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26302024-12-21T07:53:30.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38539 req_id = f4d8c9f0-df15-45c6-b38d-807d805903b3 response_code = 204 uri = /eip-gateways
26312024-12-21T07:53:30.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38539 req_id = f45dc3cc-5cbc-4612-ab56-83729829fc50 response_code = 204 uri = /vpc-routes
26322024-12-21T07:53:30.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58793
26332024-12-21T07:53:30.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58793 req_id = 7c690c6a-b4e7-42a2-998c-5f20a118fd7b response_code = 200 uri = /vpc-routes
26342024-12-21T07:53:30.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50791
26352024-12-21T07:53:30.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50791 req_id = ca4804c2-5e07-4497-abad-ca10c03a3c9f response_code = 200 uri = /v2p
26362024-12-21T07:53:30.978ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26372024-12-21T07:53:30.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58793 req_id = 38029d86-5623-4c2a-900a-2d60063ab39b response_code = 204 uri = /eip-gateways
26382024-12-21T07:53:30.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58793 req_id = c4e7c0f0-4ded-4d91-b594-9fb47b234c4d response_code = 204 uri = /vpc-routes
26392024-12-21T07:53:30.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60852
26402024-12-21T07:53:30.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26412024-12-21T07:53:31.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26422024-12-21T07:53:31.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60852 req_id = 12a85428-575c-46a3-95d1-f05bc8c4982f response_code = 204 uri = /switch-ports
26432024-12-21T07:53:31.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60852 req_id = b81831d9-476b-48b2-ba94-ee0c8e2ed633 response_code = 200 uri = /network-bootstore-config
26442024-12-21T07:53:31.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47283
26452024-12-21T07:53:31.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47283 req_id = 3fb34236-87e9-49cd-ae95-946fecc8c691 response_code = 200 uri = /v2p
26462024-12-21T07:53:31.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49431
26472024-12-21T07:53:31.163ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26482024-12-21T07:53:31.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26492024-12-21T07:53:31.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49431 req_id = 67fd0c25-828e-4fe7-bda7-19574dce1b4f response_code = 204 uri = /switch-ports
26502024-12-21T07:53:31.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49431 req_id = 84485c45-8828-4c35-af28-8e20c82748d6 response_code = 200 uri = /network-bootstore-config
26512024-12-21T07:53:49.783ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8005 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = f1a5df52-4813-4450-9438-faba0c6b5cd8 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26522024-12-21T07:53:51.230ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45807
26532024-12-21T07:53:51.230ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45807 req_id = 52772afd-a995-4f63-984f-e677c0bbbdc2 response_code = 200 uri = /baseboard
26542024-12-21T07:53:59.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34264
26552024-12-21T07:53:59.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34264 req_id = ec8f492f-412f-464a-933b-ec040d295e91 response_code = 200 uri = /vpc-routes
26562024-12-21T07:53:59.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45117
26572024-12-21T07:53:59.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45117 req_id = 9a1ef792-619a-4051-b360-f3e5023c42ed response_code = 200 uri = /v2p
26582024-12-21T07:53:59.898ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26592024-12-21T07:53:59.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34264 req_id = 6613051f-f85d-4d0d-8690-7bfcc9ba38be response_code = 204 uri = /eip-gateways
26602024-12-21T07:53:59.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34264 req_id = d3eeb370-724f-4884-abd2-bf72c0db5a02 response_code = 204 uri = /vpc-routes
26612024-12-21T07:53:59.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65333
26622024-12-21T07:53:59.974ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26632024-12-21T07:54:00.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26642024-12-21T07:54:00.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100632 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65333 req_id = 58a46c60-1153-486a-9e4d-d0864b33d937 response_code = 204 uri = /switch-ports
26652024-12-21T07:54:00.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65333 req_id = d5a7496b-31d1-4a9b-9a86-70138943610a response_code = 200 uri = /network-bootstore-config
26662024-12-21T07:54:01.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42774
26672024-12-21T07:54:01.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42774 req_id = 388c1283-7262-4a26-af1a-98419ff032c3 response_code = 200 uri = /vpc-routes
26682024-12-21T07:54:01.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42166
26692024-12-21T07:54:01.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42166 req_id = 0ac4ab97-43cc-4597-9dfc-c8a6b90300cd response_code = 200 uri = /vpc-routes
26702024-12-21T07:54:01.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53621
26712024-12-21T07:54:01.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53621 req_id = a16e1578-9108-464e-8da6-aecdcf6fdedf response_code = 200 uri = /v2p
26722024-12-21T07:54:01.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26732024-12-21T07:54:01.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42166 req_id = 86c898b2-71a7-44ce-9927-c64d2a6417a8 response_code = 204 uri = /eip-gateways
26742024-12-21T07:54:01.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26752024-12-21T07:54:01.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42774 req_id = ac3a3897-e303-41b8-9a9f-08844d39afdb response_code = 204 uri = /eip-gateways
26762024-12-21T07:54:01.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42166 req_id = f43e8e51-db4b-4fbd-9ae6-6adaa8a1acbd response_code = 204 uri = /vpc-routes
26772024-12-21T07:54:01.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42774 req_id = 2508383a-4f43-433a-b8e3-388d8bfe9690 response_code = 204 uri = /vpc-routes
26782024-12-21T07:54:01.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47217
26792024-12-21T07:54:01.246ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26802024-12-21T07:54:01.287ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26812024-12-21T07:54:01.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47217 req_id = 199d9574-e328-4acb-a23c-5a82d9787514 response_code = 204 uri = /switch-ports
26822024-12-21T07:54:01.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40280
26832024-12-21T07:54:01.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51124
26842024-12-21T07:54:01.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40280 req_id = 2294eb5e-9df1-4bc2-87c4-5b6ed099109b response_code = 200 uri = /v2p
26852024-12-21T07:54:01.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
26862024-12-21T07:54:01.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47217 req_id = 964f9ad6-700b-4482-8ac7-7a7ed7b4e8ee response_code = 200 uri = /network-bootstore-config
26872024-12-21T07:54:01.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
26882024-12-21T07:54:01.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51124 req_id = 55beb4db-ed5b-4f3d-b53e-c71898fc7505 response_code = 204 uri = /switch-ports
26892024-12-21T07:54:01.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51124 req_id = 07796df5-7bd5-4a2a-8f66-aa42e7d1e66f response_code = 200 uri = /network-bootstore-config
26902024-12-21T07:54:19.782ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7315 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = b45dcfad-e730-4f08-a2b6-368a01dc06e5 response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
26912024-12-21T07:54:21.263ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55642
26922024-12-21T07:54:21.263ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55642 req_id = 9ef07880-50d9-414f-9a8a-14b3b9b2b0af response_code = 200 uri = /baseboard
26932024-12-21T07:54:29.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38317
26942024-12-21T07:54:29.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38317 req_id = 03e1e033-2b61-45af-a57a-571cb55852fd response_code = 200 uri = /vpc-routes
26952024-12-21T07:54:29.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52617
26962024-12-21T07:54:29.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52617 req_id = de949d3f-eb21-4369-8b0c-847402ffb116 response_code = 200 uri = /v2p
26972024-12-21T07:54:29.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
26982024-12-21T07:54:29.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38317 req_id = eb9a34c8-fdba-4f3c-8b25-d348fa63373c response_code = 204 uri = /eip-gateways
26992024-12-21T07:54:29.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38317 req_id = 489b731c-3f30-4604-b1d6-b5bc72870df1 response_code = 204 uri = /vpc-routes
27002024-12-21T07:54:29.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51973
27012024-12-21T07:54:29.763ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27022024-12-21T07:54:29.798ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27032024-12-21T07:54:29.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51973 req_id = 79b8bf3e-40ef-4dd8-b99d-1c87bee41453 response_code = 204 uri = /switch-ports
27042024-12-21T07:54:29.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51973 req_id = 0ffded7a-4258-480f-8931-35460220d236 response_code = 200 uri = /network-bootstore-config
27052024-12-21T07:54:30.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64298
27062024-12-21T07:54:30.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64298 req_id = 1f3d30bd-3166-4288-aa83-3a2e19bc0fef response_code = 200 uri = /vpc-routes
27072024-12-21T07:54:30.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
27082024-12-21T07:54:30.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64298 req_id = 7910bbf2-76da-4263-95dd-3d352e5e59ed response_code = 204 uri = /eip-gateways
27092024-12-21T07:54:30.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64298 req_id = 1278a35c-3ef0-4c20-98f4-50f49b50575d response_code = 204 uri = /vpc-routes
27102024-12-21T07:54:30.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41443
27112024-12-21T07:54:30.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41443 req_id = 44f82394-ac1a-47b9-988d-9faae06ba510 response_code = 200 uri = /v2p
27122024-12-21T07:54:31.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43539
27132024-12-21T07:54:31.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62375
27142024-12-21T07:54:31.034ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27152024-12-21T07:54:31.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43539 req_id = 3e030baa-4285-4c90-bff2-8441a576888f response_code = 200 uri = /vpc-routes
27162024-12-21T07:54:31.048ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
27172024-12-21T07:54:31.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43539 req_id = a21bd67d-8ebf-44bb-ac92-1652bfab6ffa response_code = 204 uri = /eip-gateways
27182024-12-21T07:54:31.075ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27192024-12-21T07:54:31.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62964
27202024-12-21T07:54:31.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62964 req_id = 860625b6-323e-4bd9-9381-613467e8a55e response_code = 200 uri = /v2p
27212024-12-21T07:54:31.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43539 req_id = c6efeaf8-be46-45b1-81fa-3ef9501c981a response_code = 204 uri = /vpc-routes
27222024-12-21T07:54:31.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62375 req_id = f5c24ff2-2f3e-414e-b461-7fc30ee0b0f0 response_code = 204 uri = /switch-ports
27232024-12-21T07:54:31.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62375 req_id = 66f8e29c-e7f1-44da-8c00-ef2963932926 response_code = 200 uri = /network-bootstore-config
27242024-12-21T07:54:31.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63251
27252024-12-21T07:54:31.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27262024-12-21T07:54:31.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27272024-12-21T07:54:31.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63251 req_id = 75a6a261-8838-47a3-a831-de7067b1e49d response_code = 204 uri = /switch-ports
27282024-12-21T07:54:31.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63251 req_id = 12abd0a1-0f2e-498d-bf18-de4dca8c0a70 response_code = 200 uri = /network-bootstore-config
27292024-12-21T07:54:49.783ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7692 local_addr = [fd00:1122:3344:101::1]:52235 method = GET remote_addr = [fd00:1122:3344:101::d]:60071 req_id = b4007271-e5d7-47e1-9314-3d97662eb32f response_code = 200 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 uri = /fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
27302024-12-21T07:54:51.295ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33998
27312024-12-21T07:54:51.295ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33998 req_id = 6d356761-53ae-4489-8150-ef2e9a2b1433 response_code = 200 uri = /baseboard
27322024-12-21T07:54:54.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56022
27332024-12-21T07:54:54.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56022 req_id = 1e20d7c8-51ad-4d89-940d-94d533017814 response_code = 200 uri = /v2p
27342024-12-21T07:54:54.811ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10875858) }
27352024-12-21T07:54:54.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56022 req_id = 3cb84181-b887-46e2-a929-1b1665535e96 response_code = 204 uri = /v2p
27362024-12-21T07:54:54.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50264
27372024-12-21T07:54:54.945ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10875858))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 51af3bdb-e089-46aa-9bcf-b81a9233ba82, slot: 0, read_only: false, vcr_json: .., name: "disk-92c3a2add39" }], boot_settings: Some(InstanceBootSettings { order: [51af3bdb-e089-46aa-9bcf-b81a9233ba82] }), cloud_init_bytes: Some(..) } instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 metadata = InstanceMetadata { silo_id: 623f0f1c-4347-40f3-8cf7-f7d7c77efac3, project_id: cab4c109-6d88-4009-bc4c-2833c9647a13 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T07:54:54.929444068Z }
27382024-12-21T07:54:54.946ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 migration_id = None propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27392024-12-21T07:54:54.946ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 migration_id = None propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10875858))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7531d270-453f-488d-a6ea-cbbd8f6fea82, kind: Instance { id: d05e2a1f-945e-4e85-9195-e6992ffaf129 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10875858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 51af3bdb-e089-46aa-9bcf-b81a9233ba82, slot: 0, read_only: false, vcr_json: .., name: "disk-92c3a2add39" }], boot_settings: Some(InstanceBootSettings { order: [51af3bdb-e089-46aa-9bcf-b81a9233ba82] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-21T07:54:54.929444068Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27402024-12-21T07:54:54.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15883 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50264 req_id = 98e264ff-f027-4576-bb89-122f5c84282d response_code = 200 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850
27412024-12-21T07:54:55.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65300
27422024-12-21T07:54:55.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 806 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65300 req_id = 1995ce5b-bf6b-41ce-970a-2abfcd2aeab8 response_code = 200 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state
27432024-12-21T07:54:55.035ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10875858 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27442024-12-21T07:54:55.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27452024-12-21T07:54:55.076ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850 file = illumos-utils/src/zone.rs:325 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27462024-12-21T07:54:55.100ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850 file = illumos-utils/src/zone.rs:363 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27472024-12-21T07:54:55.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33505
27482024-12-21T07:54:55.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33505 req_id = b6c8531c-3dea-430a-9f5d-9a8fdc28744b response_code = 200 uri = /vpc-routes
27492024-12-21T07:54:55.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} }
27502024-12-21T07:54:56.760ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27512024-12-21T07:54:56.760ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850 zone file = illumos-utils/src/running_zone.rs:488 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27522024-12-21T07:54:56.946ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 47.544723ms file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27532024-12-21T07:54:57.004ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 104.208579ms file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27542024-12-21T07:54:57.124ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 174.394358ms file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27552024-12-21T07:54:57.310ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 350.819914ms file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27562024-12-21T07:54:57.675ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 400.962159ms file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27572024-12-21T07:54:58.091ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 532.427886ms file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27582024-12-21T07:54:58.635ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 1.072787804s file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27592024-12-21T07:54:59.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54682
27602024-12-21T07:54:59.719ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 1.377785995s file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27612024-12-21T07:54:59.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34390
27622024-12-21T07:54:59.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34390 req_id = 16bca45f-d440-40be-86b8-896a710c32f4 response_code = 200 uri = /vpc-routes
27632024-12-21T07:54:59.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} }
27642024-12-21T07:54:59.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34390 req_id = d1c3580e-9be2-4538-9219-1cdb70e28080 response_code = 204 uri = /eip-gateways
27652024-12-21T07:54:59.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54076
27662024-12-21T07:54:59.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54076 req_id = 5c98ae77-f2f5-4212-918c-8ca27090bac0 response_code = 200 uri = /v2p
27672024-12-21T07:54:59.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38339
27682024-12-21T07:54:59.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27692024-12-21T07:54:59.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27702024-12-21T07:55:00.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38339 req_id = 2b926218-8d27-41fb-b776-9dab823fe4a6 response_code = 204 uri = /switch-ports
27712024-12-21T07:55:00.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34390 req_id = 4e65f24c-d88b-4e51-8ca1-024290af4f87 response_code = 204 uri = /vpc-routes
27722024-12-21T07:55:00.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38339 req_id = 11efe432-47a5-42b1-a848-17469c673a34 response_code = 200 uri = /network-bootstore-config
27732024-12-21T07:55:01.034ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53838
27742024-12-21T07:55:01.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55039
27752024-12-21T07:55:01.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59917
27762024-12-21T07:55:01.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59917 req_id = 3346eb57-30d9-4a93-8a47-0c67319f908c response_code = 200 uri = /vpc-routes
27772024-12-21T07:55:01.116ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850") failed: Property not found. retry in 1.495766679s file = illumos-utils/src/svc.rs:36 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 zone = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
27782024-12-21T07:55:01.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} }
27792024-12-21T07:55:01.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59917 req_id = 1de7de45-3af1-4d7c-a46b-c43e3b8ee89e response_code = 204 uri = /eip-gateways
27802024-12-21T07:55:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59917 req_id = ff8b1c6e-8b66-46c9-9afd-d79353b31405 response_code = 204 uri = /vpc-routes
27812024-12-21T07:55:01.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48226
27822024-12-21T07:55:01.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27832024-12-21T07:55:01.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27842024-12-21T07:55:01.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48226 req_id = de2b83d6-ff49-499a-90a0-cd9f8647f88a response_code = 204 uri = /switch-ports
27852024-12-21T07:55:01.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54148
27862024-12-21T07:55:01.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54148 req_id = d1de2743-35cf-4e4b-8741-acaef6bd071d response_code = 200 uri = /v2p
27872024-12-21T07:55:01.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48226 req_id = 8dcd3145-1c6f-4ebc-816a-205688efbeae response_code = 200 uri = /network-bootstore-config
27882024-12-21T07:55:01.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53856
27892024-12-21T07:55:01.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53856 req_id = e084ef2d-173e-43cf-90c3-b6c670251614 response_code = 200 uri = /v2p
27902024-12-21T07:55:01.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64468
27912024-12-21T07:55:01.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4134
27922024-12-21T07:55:01.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4158
27932024-12-21T07:55:01.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64468 req_id = 988787c8-b0ae-4cdc-811b-a3279faaac0d response_code = 204 uri = /switch-ports
27942024-12-21T07:55:01.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64468 req_id = 735abe44-801e-4add-9fcf-b9927827ea5d response_code = 200 uri = /network-bootstore-config
27952024-12-21T07:55:02.643ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850 file = sled-agent/src/instance.rs:2067 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27962024-12-21T07:55:02.653ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27972024-12-21T07:55:02.692ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27982024-12-21T07:55:02.835ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
27992024-12-21T07:55:02.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3222690 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54682 req_id = 4b2f7c9d-f5f6-405d-8fcf-4aa07b4a05c4 response_code = 200 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state
28002024-12-21T07:55:02.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783556 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55039 req_id = b7a86928-7ca4-4fe4-98ae-d15988f8c542 response_code = 200 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state
28012024-12-21T07:55:02.836ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
28022024-12-21T07:55:02.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801738 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53838 req_id = b984b4c9-7461-4b05-a92f-30462b8ad13f response_code = 200 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state
28032024-12-21T07:55:02.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7707027 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33505 req_id = 06150bc1-8ddd-4c67-8b6d-124a94dcca92 response_code = 204 uri = /eip-gateways
28042024-12-21T07:55:02.836ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-21T07:55:02.836857407Z } file = sled-agent/src/instance.rs:780 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28052024-12-21T07:55:02.836ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T07:55:02.836857407Z } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28062024-12-21T07:55:02.836ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T07:55:02.836857407Z }, migration_in: None, migration_out: None }
28072024-12-21T07:55:02.887ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-21T07:55:02.887179564Z } file = sled-agent/src/instance.rs:780 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28082024-12-21T07:55:02.887ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:55:02.887179564Z } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28092024-12-21T07:55:02.887ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T07:55:02.887179564Z }, migration_in: None, migration_out: None }
28102024-12-21T07:55:02.958ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 6cc1b6b6-0d13-4336-af8b-72f94b7c9c69, version: 3 } old_vers = RouterVersion { router_id: 6cc1b6b6-0d13-4336-af8b-72f94b7c9c69, version: 3 } subnet = RouterId { vni: Vni(10875858), kind: System }
28112024-12-21T07:55:02.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33505 req_id = d69576ef-f770-4897-9b27-7e4b3af7afef response_code = 204 uri = /vpc-routes
28122024-12-21T07:55:03.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52920
28132024-12-21T07:55:03.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52920 req_id = 8a998850-7014-47aa-a418-1246bf1915f3 response_code = 200 uri = /vpc-routes
28142024-12-21T07:55:03.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} }
28152024-12-21T07:55:03.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52920 req_id = d4e99044-070d-4777-b47c-8de93626f856 response_code = 204 uri = /eip-gateways
28162024-12-21T07:55:03.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52920 req_id = 4b642801-f020-40bb-89ca-6f3da7f671f9 response_code = 204 uri = /vpc-routes
28172024-12-21T07:55:12.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44001
28182024-12-21T07:55:12.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 586 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44001 req_id = 49da9115-2806-4862-8ccb-f8425503ce3e response_code = 200 uri = /vmms/f7931a2d-2429-4377-a5f1-dcdb79a45850/state
28192024-12-21T07:55:12.533ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-21T07:55:12.533311304Z } file = sled-agent/src/instance.rs:780 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28202024-12-21T07:55:12.533ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T07:55:12.533311304Z } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28212024-12-21T07:55:12.533ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T07:55:12.533311304Z }, migration_in: None, migration_out: None }
28222024-12-21T07:55:12.546ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-21T07:55:12.546041335Z } file = sled-agent/src/instance.rs:780 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28232024-12-21T07:55:12.546ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-21T07:55:12.546041335Z } propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28242024-12-21T07:55:12.546ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28252024-12-21T07:55:12.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28262024-12-21T07:55:12.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28272024-12-21T07:55:12.546ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/38e50563-d6f1-4512-81d8-478fc24b0465/debug/bundle/zone", "/pool/int/e31b4f07-f674-4ea7-9881-8af97296ef9c/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/15031ef1-5ce4-46cf-9cca-61ffe6220c62/crypt/debug", "/pool/ext/54c8850c-5a87-4b82-9026-6ccf6d846961/crypt/debug", "/pool/ext/45666343-e064-4cc6-881c-0d53aea79e05/crypt/debug", "/pool/ext/1482623f-a17a-45aa-b7a8-d8859ef889d5/crypt/debug", "/pool/ext/ac5724dd-ceb6-4376-bb77-343c6be7224a/crypt/debug", "/pool/ext/f16a4591-8357-4fd5-b354-0deda45e4488/crypt/debug", "/pool/ext/5e489682-2a3a-407d-8c08-3d48ddf3ef87/crypt/debug", "/pool/ext/db433b7a-dcc2-4a06-ba23-26f814d97a83/crypt/debug", "/pool/ext/418588b4-b6f1-4ddb-8c6d-76d4eb891026/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850
28282024-12-21T07:55:13.177ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850", bundle_id: 3729e54b-5a24-4033-83cb-016ca8848129 }, time_created: 2024-12-21T07:55:12.548441625Z, version: 0, cause: TerminatedInstance }
28292024-12-21T07:55:13.177ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_f7931a2d-2429-4377-a5f1-dcdb79a45850 file = sled-agent/src/instance.rs:1313 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28302024-12-21T07:55:14.962ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28312024-12-21T07:55:14.979ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(10875858), kind: System }
28322024-12-21T07:55:14.979ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(10875858), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28332024-12-21T07:55:14.980ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:55:14.980852808Z }, migration_in: None, migration_out: None }
28342024-12-21T07:55:15.008ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T07:55:14.980852808Z }, migration_in: None, migration_out: None }
28352024-12-21T07:55:15.013ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = d05e2a1f-945e-4e85-9195-e6992ffaf129 propolis_id = f7931a2d-2429-4377-a5f1-dcdb79a45850
28362024-12-21T07:55:15.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52233
28372024-12-21T07:55:15.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52233 req_id = 5a10a4a9-5b25-4c4e-b28f-92e09088e7e5 response_code = 200 uri = /vpc-routes
28382024-12-21T07:55:15.484ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {7531d270-453f-488d-a6ea-cbbd8f6fea82: {10.151.2.176: {a26a91b6-4a41-45df-b044-cd3728d02b93}, 10.151.2.175: {a26a91b6-4a41-45df-b044-cd3728d02b93}}} }
28392024-12-21T07:55:15.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52233 req_id = d475fec2-d216-4710-b711-01cd7a83666e response_code = 204 uri = /eip-gateways
28402024-12-21T07:55:15.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52233 req_id = 8d7144c0-7dcb-4789-89c9-9c0a8c53ceba response_code = 204 uri = /vpc-routes
28412024-12-21T07:55:15.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37325
28422024-12-21T07:55:15.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37325 req_id = 3273b97a-0338-4491-95df-0cec74e3dec1 response_code = 200 uri = /v2p
28432024-12-21T07:55:15.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49272
28442024-12-21T07:55:15.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49272 req_id = 88943d55-41f0-4bf2-91a5-330e1eece00b response_code = 200 uri = /v2p
28452024-12-21T07:55:15.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35357
28462024-12-21T07:55:15.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35357 req_id = fa86865f-9a7a-4964-ab66-c58325b5d51d response_code = 200 uri = /vpc-routes
28472024-12-21T07:55:15.926ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
28482024-12-21T07:55:15.927ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8
28492024-12-21T07:55:15.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35357 req_id = 0df3c8ce-3a42-4512-b737-8b22163df676 response_code = 204 uri = /eip-gateways
28502024-12-21T07:55:15.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35357 req_id = dc4938dc-5d1c-4b99-84a0-b68dd574a21b response_code = 204 uri = /vpc-routes
28512024-12-21T07:55:16.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48889
28522024-12-21T07:55:16.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48889 req_id = 9c7d5aef-d670-4c02-86d1-7a87fec17b37 response_code = 200 uri = /vpc-routes
28532024-12-21T07:55:16.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = fd17e5b1-1ee7-403e-934f-3c6e24c5b9c8 values = ExternalIpGatewayMap { mappings: {} }
28542024-12-21T07:55:16.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48889 req_id = 7eb79e21-8a3d-4ae1-8b12-3a961d33193a response_code = 204 uri = /eip-gateways
28552024-12-21T07:55:16.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48889 req_id = 1b7f756d-58c7-484d-aea2-2f8d670b173d response_code = 204 uri = /vpc-routes