Max level shown:
1 [ Dec 19 21:38:52 Enabled. ]
2 [ Dec 19 21:38:52 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 19 21:38:52 Method "start" exited with status 0. ]
4 [ Dec 19 21:38:52 Rereading configuration. ]
5 [ Dec 19 21:38:52 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-19T21:38:52.893ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-19T21:38:52.894ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-19T21:38:52.946ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-19T21:38:52.946ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-19T21:38:53.061ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-19T21:38:53.070ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-19T21:38:53.077ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-19T21:38:53.676ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-12-19T21:38:53.818ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-19T21:38:53.818ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-19T21:38:53.818ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-19T21:38:53.818ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192024-12-19T21:38:53.818ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202024-12-19T21:38:53.818ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-19T21:38:53.821ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-19T21:38:53.821ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-19T21:38:53.821ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-19T21:38:53.821ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-19T21:38:53.821ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-19T21:38:53.821ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-19T21:38:53.821ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-19T21:38:53.821ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-19T21:38:53.821ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-19T21:38:53.833ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-19T21:38:53.833ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool)
322024-12-19T21:38:53.934ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal }
332024-12-19T21:38:54.412ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-19T21:38:54.412ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-19T21:38:54.412ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-19T21:38:54.412ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-19T21:38:54.412ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-19T21:38:54.414ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-19T21:38:54.414ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-19T21:38:54.421ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-19T21:38:54.421ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool)
422024-12-19T21:38:54.511ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal }
432024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
462024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
482024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
492024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
522024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
532024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
652024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
662024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-19T21:38:54.992ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-19T21:38:54.992ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-12-19T21:38:54.992ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-19T21:38:54.992ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-19T21:38:54.992ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
842024-12-19T21:38:54.993ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-12-19T21:38:54.993ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
862024-12-19T21:38:54.993ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
872024-12-19T21:38:54.993ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-19T21:38:54.993ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892024-12-19T21:38:54.993ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
902024-12-19T21:38:54.993ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-12-19T21:38:54.993ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
922024-12-19T21:38:54.993ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
932024-12-19T21:38:54.993ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-12-19T21:38:54.993ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952024-12-19T21:38:54.993ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962024-12-19T21:38:54.993ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
972024-12-19T21:38:54.993ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
982024-12-19T21:38:54.993ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-12-19T21:38:54.993ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-12-19T21:38:54.993ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-12-19T21:38:54.993ZINFOSledAgent (bootstore): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1022024-12-19T21:38:54.993ZINFOSledAgent (bootstore): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1032024-12-19T21:38:54.993ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1042024-12-19T21:38:54.993ZINFOSledAgent (bootstore): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-12-19T21:38:54.993ZINFOSledAgent (bootstore): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-12-19T21:38:54.993ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1072024-12-19T21:38:54.993ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-12-19T21:38:54.993ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-12-19T21:38:55.003ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:794
1102024-12-19T21:38:55.003ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1647, tv_nsec: 999718838 } time_to_next_cleanup = 599.999952749s
1112024-12-19T21:38:55.003ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3988
1122024-12-19T21:38:55.003ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1132024-12-19T21:38:55.003ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-12-19T21:38:55.003ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-12-19T21:38:55.006ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1162024-12-19T21:38:55.008ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1172024-12-19T21:38:55.009ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1182024-12-19T21:38:55.009ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192024-12-19T21:38:55.009ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1202024-12-19T21:38:55.009ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1212024-12-19T21:38:55.009ZINFOSledAgent (RSS): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/rss-started.marker file = common/src/ledger.rs:188
1222024-12-19T21:38:55.009ZINFOSledAgent (RSS): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/rss-started.marker file = common/src/ledger.rs:188
1232024-12-19T21:38:55.009ZINFOSledAgent (RSS): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-12-19T21:38:55.009ZINFOSledAgent (RSS): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-12-19T21:38:55.009ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1262024-12-19T21:38:55.009ZINFOSledAgent (RSS): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1272024-12-19T21:38:55.009ZINFOSledAgent (RSS): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1282024-12-19T21:38:55.009ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1292024-12-19T21:38:55.009ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1302024-12-19T21:38:55.009ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1312024-12-19T21:38:55.009ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1322024-12-19T21:38:55.009ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1332024-12-19T21:38:55.009ZINFOSledAgent (bootstore): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1342024-12-19T21:38:55.010ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1352024-12-19T21:38:55.010ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1362024-12-19T21:38:55.010ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e282623f-c8b6-42e1-8711-fe2573bc5d47 (sled), rack_id: 693b0cf3-c773-407e-bdfd-9ad08967cf46, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1372024-12-19T21:38:55.010ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4285
1382024-12-19T21:38:55.010ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4691
1392024-12-19T21:38:55.015ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1402024-12-19T21:38:55.021ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1412024-12-19T21:38:55.021ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1422024-12-19T21:38:55.026ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432024-12-19T21:38:55.026ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442024-12-19T21:38:55.026ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:45567
1452024-12-19T21:38:55.026ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e282623f-c8b6-42e1-8711-fe2573bc5d47 (sled), rack_id: 693b0cf3-c773-407e-bdfd-9ad08967cf46, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1462024-12-19T21:38:55.026ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1472024-12-19T21:38:55.026ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1492024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1502024-12-19T21:38:55.026ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1512024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1522024-12-19T21:38:55.026ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1532024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1542024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1552024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1562024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1572024-12-19T21:38:55.026ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1582024-12-19T21:38:55.026ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1592024-12-19T21:38:55.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1602024-12-19T21:38:55.063ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1612024-12-19T21:38:55.080ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1622024-12-19T21:38:55.107ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1632024-12-19T21:38:55.107ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1642024-12-19T21:38:55.107ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1652024-12-19T21:38:55.107ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662024-12-19T21:38:55.110ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 81.804451ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "625ef23e-3e5a-4a52-9fa9-a8d0abc27c77", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "625ef23e-3e5a-4a52-9fa9-a8d0abc27c77" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-12-19T21:38:55.120ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_11590bd1-5f0c-4942-ab1c-f5a5c84179e5/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-12-19T21:38:55.144ZINFOSledAgent: successfully created encrypted zvol: name="oxi_11590bd1-5f0c-4942-ab1c-f5a5c84179e5/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-12-19T21:38:55.144ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_11590bd1-5f0c-4942-ab1c-f5a5c84179e5/swap" file = sled-agent/src/swap_device.rs:96
1702024-12-19T21:38:55.149ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1712024-12-19T21:38:55.149ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1722024-12-19T21:38:55.149ZINFOSledAgent (BackingFs): Ensuring dataset oxi_11590bd1-5f0c-4942-ab1c-f5a5c84179e5/backing/fmd file = sled-agent/src/backing_fs.rs:138
1732024-12-19T21:38:55.193ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-12-19T21:38:55.193ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 139.234897ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "21c5c10f-77dd-4f62-91a1-617244beb117", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "21c5c10f-77dd-4f62-91a1-617244beb117" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-12-19T21:38:55.237ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1762024-12-19T21:38:55.334ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-19T21:38:55.334ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 197.047207ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4427a5a3-a288-4698-8965-859b0b6137d1", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4427a5a3-a288-4698-8965-859b0b6137d1" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-19T21:38:55.456ZINFOSledAgent (BackingFs): Mounting oxi_11590bd1-5f0c-4942-ab1c-f5a5c84179e5/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1792024-12-19T21:38:55.469ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1802024-12-19T21:38:55.469ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1812024-12-19T21:38:55.469ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1822024-12-19T21:38:55.469ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1832024-12-19T21:38:55.535ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842024-12-19T21:38:55.535ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 192.331747ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1e9f7b83-f7d2-4957-8569-29f1674fd14a", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1e9f7b83-f7d2-4957-8569-29f1674fd14a" } file = clients/ddm-admin-client/src/lib.rs:177
1852024-12-19T21:38:55.728ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-12-19T21:38:55.729ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 165.161114ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0057ceb3-d1c6-45ee-915f-209420521f33", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0057ceb3-d1c6-45ee-915f-209420521f33" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-12-19T21:38:55.895ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-12-19T21:38:55.896ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 229.074442ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "561d7431-a2ae-4b9f-ac1d-1cc3b1a3e054", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "561d7431-a2ae-4b9f-ac1d-1cc3b1a3e054" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-12-19T21:38:56.126ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-12-19T21:38:56.127ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 325.671333ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2e136a47-84f5-4286-863b-98ae42c72237", "content-length": "124", "date": "Thu, 19 Dec 2024 21:38:56 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2e136a47-84f5-4286-863b-98ae42c72237" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-12-19T21:38:56.210ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1922024-12-19T21:38:56.215ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:48203 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1932024-12-19T21:38:56.215ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1942024-12-19T21:38:56.215ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48203 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1952024-12-19T21:38:56.216ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 191.853435ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1962024-12-19T21:38:56.217ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1972024-12-19T21:38:56.217ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
1982024-12-19T21:38:56.217ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:978 underlay_address = fd00:1122:3344:101::1
1992024-12-19T21:38:56.217ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2002024-12-19T21:38:56.410ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 320.628861ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2012024-12-19T21:38:56.454ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-12-19T21:38:56.732ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 796.544092ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2032024-12-19T21:38:57.530ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.12318806s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2042024-12-19T21:38:59.048ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2726
2052024-12-19T21:38:59.048ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2954
2062024-12-19T21:38:59.048ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2596
2072024-12-19T21:38:59.048ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2643
2082024-12-19T21:38:59.048ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3035
2092024-12-19T21:38:59.048ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3080
2102024-12-19T21:38:59.050ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2862
2112024-12-19T21:38:59.051ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2637
2122024-12-19T21:38:59.051ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='cd36a716-3788-4cb6-8a79-cc86288ad0c7'/> <propval type="astring" name="rack_id" value='693b0cf3-c773-407e-bdfd-9ad08967cf46'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe42:bada'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='693b0cf3-c773-407e-bdfd-9ad08967cf46'/> <propval type="astring" name="sled_id" value='e282623f-c8b6-42e1-8711-fe2573bc5d47'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dpd_host" value='[::1]'/> <propval type="astring" name="dpd_port" value='12224'/> <propval type="astring" name="rack_id" value='693b0cf3-c773-407e-bdfd-9ad08967cf46'/> <propval type="astring" name="sled_id" value='e282623f-c8b6-42e1-8711-fe2573bc5d47'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="listen_address" value='[::1]:12231'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e282623f-c8b6-42e1-8711-fe2573bc5d47'/> <propval type="astring" name="rack_uuid" value='693b0cf3-c773-407e-bdfd-9ad08967cf46'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e282623f-c8b6-42e1-8711-fe2573bc5d47'/> <propval type="astring" name="rack_uuid" value='693b0cf3-c773-407e-bdfd-9ad08967cf46'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132024-12-19T21:38:59.051ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142024-12-19T21:38:59.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 74.834456ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-12-19T21:38:59.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 57.890111ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-19T21:38:59.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 135.880446ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-19T21:38:59.761ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.44388533s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2182024-12-19T21:38:59.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 263.881163ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-19T21:39:00.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 896.346521ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-19T21:39:01.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.478652351s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-19T21:39:03.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 552.774306ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-19T21:39:03.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 922.822114ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-19T21:39:05.028ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/nexus.rs:527 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2242024-12-19T21:39:05.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2252024-12-19T21:39:05.058ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2262024-12-19T21:39:05.059ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2272024-12-19T21:39:05.059ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2282024-12-19T21:39:05.059ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292024-12-19T21:39:05.059ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2302024-12-19T21:39:05.059ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312024-12-19T21:39:05.060ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2322024-12-19T21:39:05.060ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2332024-12-19T21:39:05.060ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3988
2342024-12-19T21:39:05.060ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:45567
2352024-12-19T21:39:05.282ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2362024-12-19T21:39:05.282ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2372024-12-19T21:39:05.289ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4309 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2382024-12-19T21:39:05.289ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4325
2392024-12-19T21:39:05.289ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2402024-12-19T21:39:05.521ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.580294557s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2412024-12-19T21:39:05.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42264
2422024-12-19T21:39:05.548ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2432024-12-19T21:39:05.548ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2442024-12-19T21:39:05.548ZINFOSledAgent (ServiceManager): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:188
2452024-12-19T21:39:05.548ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:188
2462024-12-19T21:39:05.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42264 req_id = 80fd92f6-0fd8-4b79-9f8c-49407cef336a response_code = 200 uri = /inventory
2472024-12-19T21:39:05.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55306
2482024-12-19T21:39:05.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55306 req_id = dbe6eb04-bcd5-4e3d-aa21-3bb16117eebf response_code = 200 uri = /sled-role
2492024-12-19T21:39:05.611ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b7f509f4-1a54-4d41-a67e-a788862eac8b (physical_disk), pool_id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 7e68fd3a-8cbb-435b-a13d-d378296d31f0 (physical_disk), pool_id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6e361a8d-7510-4fd6-b443-b4423c178835 (physical_disk), pool_id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 6cc3e8a1-4e60-4ec7-b032-8207fca9e898 (physical_disk), pool_id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 2ba6ff96-7514-43c0-841b-5c1087aeab1d (physical_disk), pool_id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d6e72cf7-bf66-4f94-9298-435d0da032c0 (physical_disk), pool_id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2bd04a0e-c377-4c9e-a37f-28b0de0e314c (physical_disk), pool_id: ecb3b641-1217-432e-886e-545d59bd115f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 625e4843-52f0-4ef5-aab0-0366e5868828 (physical_disk), pool_id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 26c6d57f-5cf5-4e21-8880-70ec68db575b (physical_disk), pool_id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2502024-12-19T21:39:05.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42339
2512024-12-19T21:39:05.612ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2522024-12-19T21:39:05.612ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: b7f509f4-1a54-4d41-a67e-a788862eac8b (physical_disk), pool_id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 7e68fd3a-8cbb-435b-a13d-d378296d31f0 (physical_disk), pool_id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 6e361a8d-7510-4fd6-b443-b4423c178835 (physical_disk), pool_id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 6cc3e8a1-4e60-4ec7-b032-8207fca9e898 (physical_disk), pool_id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 2ba6ff96-7514-43c0-841b-5c1087aeab1d (physical_disk), pool_id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: d6e72cf7-bf66-4f94-9298-435d0da032c0 (physical_disk), pool_id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 2bd04a0e-c377-4c9e-a37f-28b0de0e314c (physical_disk), pool_id: ecb3b641-1217-432e-886e-545d59bd115f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 625e4843-52f0-4ef5-aab0-0366e5868828 (physical_disk), pool_id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 26c6d57f-5cf5-4e21-8880-70ec68db575b (physical_disk), pool_id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2532024-12-19T21:39:05.612ZINFOSledAgent (StorageManager): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542024-12-19T21:39:05.612ZINFOSledAgent (StorageManager): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552024-12-19T21:39:05.612ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2562024-12-19T21:39:05.612ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2572024-12-19T21:39:05.612ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2582024-12-19T21:39:05.612ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2592024-12-19T21:39:05.612ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2602024-12-19T21:39:05.784ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2612024-12-19T21:39:05.784ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool)
2622024-12-19T21:39:06.060ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2632024-12-19T21:39:06.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10288280158725169058 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2642024-12-19T21:39:06.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3617067623367857126 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2652024-12-19T21:39:06.999ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2662024-12-19T21:39:07.014ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }
2672024-12-19T21:39:07.022ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2682024-12-19T21:39:07.022ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2692024-12-19T21:39:07.023ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2702024-12-19T21:39:07.023ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2712024-12-19T21:39:07.023ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722024-12-19T21:39:07.023ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-19T21:39:07.023ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2742024-12-19T21:39:07.059ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752024-12-19T21:39:07.063ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
2762024-12-19T21:39:07.067ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone file = sled-storage/src/dataset.rs:303
2772024-12-19T21:39:07.242ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb file = sled-storage/src/dataset.rs:389
2782024-12-19T21:39:07.250ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792024-12-19T21:39:07.250ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802024-12-19T21:39:07.250ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812024-12-19T21:39:07.250ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822024-12-19T21:39:07.250ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832024-12-19T21:39:07.259ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842024-12-19T21:39:07.260ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool)
2852024-12-19T21:39:07.355ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }
2862024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2872024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2882024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2892024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2902024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-19T21:39:07.364ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2932024-12-19T21:39:07.400ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-12-19T21:39:07.409ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone file = sled-storage/src/dataset.rs:303
2952024-12-19T21:39:07.586ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_595b6dc4-b331-490d-aa08-f0377a395ba7 file = sled-storage/src/dataset.rs:389
2962024-12-19T21:39:07.594ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972024-12-19T21:39:07.594ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982024-12-19T21:39:07.594ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992024-12-19T21:39:07.594ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002024-12-19T21:39:07.594ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012024-12-19T21:39:07.604ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022024-12-19T21:39:07.604ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool)
3032024-12-19T21:39:07.698ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }
3042024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3052024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3062024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3072024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3082024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-19T21:39:07.706ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3112024-12-19T21:39:07.744ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122024-12-19T21:39:07.753ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone file = sled-storage/src/dataset.rs:303
3132024-12-19T21:39:07.927ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e file = sled-storage/src/dataset.rs:389
3142024-12-19T21:39:07.934ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152024-12-19T21:39:07.934ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162024-12-19T21:39:07.934ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172024-12-19T21:39:07.934ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182024-12-19T21:39:07.934ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192024-12-19T21:39:07.943ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202024-12-19T21:39:07.944ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool)
3212024-12-19T21:39:08.036ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }
3222024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3232024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3242024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3252024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3262024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-19T21:39:08.045ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3292024-12-19T21:39:08.065ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
3302024-12-19T21:39:08.081ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-12-19T21:39:08.089ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone file = sled-storage/src/dataset.rs:303
3322024-12-19T21:39:08.270ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5645011c-c670-4c29-977d-a05bbfd29ef2 file = sled-storage/src/dataset.rs:389
3332024-12-19T21:39:08.278ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342024-12-19T21:39:08.278ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352024-12-19T21:39:08.278ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362024-12-19T21:39:08.278ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372024-12-19T21:39:08.278ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382024-12-19T21:39:08.289ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392024-12-19T21:39:08.289ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool)
3402024-12-19T21:39:08.384ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }
3412024-12-19T21:39:08.392ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3422024-12-19T21:39:08.392ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3432024-12-19T21:39:08.393ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3442024-12-19T21:39:08.393ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3452024-12-19T21:39:08.393ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-12-19T21:39:08.393ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-19T21:39:08.393ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3482024-12-19T21:39:08.429ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492024-12-19T21:39:08.437ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone file = sled-storage/src/dataset.rs:303
3502024-12-19T21:39:08.608ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de file = sled-storage/src/dataset.rs:389
3512024-12-19T21:39:08.616ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522024-12-19T21:39:08.616ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532024-12-19T21:39:08.617ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542024-12-19T21:39:08.617ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552024-12-19T21:39:08.617ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562024-12-19T21:39:08.626ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572024-12-19T21:39:08.626ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool)
3582024-12-19T21:39:08.722ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }
3592024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3602024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3612024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3622024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3632024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-19T21:39:08.730ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3662024-12-19T21:39:08.766ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672024-12-19T21:39:08.774ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone file = sled-storage/src/dataset.rs:303
3682024-12-19T21:39:08.951ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3 file = sled-storage/src/dataset.rs:389
3692024-12-19T21:39:08.963ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702024-12-19T21:39:08.963ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712024-12-19T21:39:08.963ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722024-12-19T21:39:08.963ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732024-12-19T21:39:08.963ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742024-12-19T21:39:08.974ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752024-12-19T21:39:08.974ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ecb3b641-1217-432e-886e-545d59bd115f (zpool)
3762024-12-19T21:39:09.071ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }
3772024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3782024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3792024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3802024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3812024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-19T21:39:09.078ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3842024-12-19T21:39:09.081ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
3852024-12-19T21:39:09.111ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-12-19T21:39:09.118ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone file = sled-storage/src/dataset.rs:303
3872024-12-19T21:39:09.285ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ecb3b641-1217-432e-886e-545d59bd115f file = sled-storage/src/dataset.rs:389
3882024-12-19T21:39:09.293ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892024-12-19T21:39:09.293ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902024-12-19T21:39:09.293ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912024-12-19T21:39:09.293ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922024-12-19T21:39:09.293ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932024-12-19T21:39:09.303ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942024-12-19T21:39:09.303ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool)
3952024-12-19T21:39:09.403ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }
3962024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3972024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3982024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
3992024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4002024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-19T21:39:09.411ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4032024-12-19T21:39:09.449ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042024-12-19T21:39:09.458ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone file = sled-storage/src/dataset.rs:303
4052024-12-19T21:39:09.635ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f file = sled-storage/src/dataset.rs:389
4062024-12-19T21:39:09.643ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072024-12-19T21:39:09.643ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082024-12-19T21:39:09.643ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092024-12-19T21:39:09.643ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102024-12-19T21:39:09.643ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112024-12-19T21:39:09.654ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122024-12-19T21:39:09.654ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool)
4132024-12-19T21:39:09.748ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }
4142024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4152024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4162024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4172024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4182024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-19T21:39:09.756ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4212024-12-19T21:39:09.790ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222024-12-19T21:39:09.798ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone file = sled-storage/src/dataset.rs:303
4232024-12-19T21:39:09.969ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de file = sled-storage/src/dataset.rs:389
4242024-12-19T21:39:09.977ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252024-12-19T21:39:09.977ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262024-12-19T21:39:09.977ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272024-12-19T21:39:09.978ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11590bd1-5f0c-4942-ab1c-f5a5c84179e5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282024-12-19T21:39:09.978ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292024-12-19T21:39:09.978ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302024-12-19T21:39:09.978ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-12-19T21:39:09.978ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4322024-12-19T21:39:09.978ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4332024-12-19T21:39:09.978ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4342024-12-19T21:39:09.978ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4352024-12-19T21:39:09.978ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4362024-12-19T21:39:09.978ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4372024-12-19T21:39:09.978ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4382024-12-19T21:39:09.978ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392024-12-19T21:39:09.978ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4402024-12-19T21:39:09.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4366699 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42339 req_id = 0050a41a-698e-4d5d-8705-af3ba04fa590 response_code = 200 uri = /omicron-physical-disks
4412024-12-19T21:39:10.010ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00c5e572-d9b4-4de0-9ce4-b52cb2bbde2d (dataset): DatasetConfig { id: 00c5e572-d9b4-4de0-9ce4-b52cb2bbde2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 04a4c6a4-b622-46ca-a680-ecb0db0108b9 (dataset): DatasetConfig { id: 04a4c6a4-b622-46ca-a680-ecb0db0108b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_410afead-fda9-4475-970e-8ade982017e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f0bedb1-df6d-4af1-803d-23668eab3299 (dataset): DatasetConfig { id: 0f0bedb1-df6d-4af1-803d-23668eab3299 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12255c49-ccd9-4c50-9c52-3eaf15fa64eb (dataset): DatasetConfig { id: 12255c49-ccd9-4c50-9c52-3eaf15fa64eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13321d1c-8894-4eeb-aeb8-a007c9dbb97d (dataset): DatasetConfig { id: 13321d1c-8894-4eeb-aeb8-a007c9dbb97d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14f52bed-9371-47dd-a3bf-78f637ad036b (dataset): DatasetConfig { id: 14f52bed-9371-47dd-a3bf-78f637ad036b (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1649d46e-99e7-46b3-b0c5-5ecb519ce07b (dataset): DatasetConfig { id: 1649d46e-99e7-46b3-b0c5-5ecb519ce07b (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17dd409c-91cd-47f5-a494-8ae5d311bd2d (dataset): DatasetConfig { id: 17dd409c-91cd-47f5-a494-8ae5d311bd2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22ae6142-fe4b-4fcd-947d-6e11583d7171 (dataset): DatasetConfig { id: 22ae6142-fe4b-4fcd-947d-6e11583d7171 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 242f8e33-f305-43aa-a580-e4324097f90f (dataset): DatasetConfig { id: 242f8e33-f305-43aa-a580-e4324097f90f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 329a45f8-41a8-41a9-bf94-610609054b00 (dataset): DatasetConfig { id: 329a45f8-41a8-41a9-bf94-610609054b00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 355d53a8-e065-4c57-b33e-6018a595ca5c (dataset): DatasetConfig { id: 355d53a8-e065-4c57-b33e-6018a595ca5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3aade3f8-936a-403c-95fd-e20f1e18878f (dataset): DatasetConfig { id: 3aade3f8-936a-403c-95fd-e20f1e18878f (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3be8a32b-7a67-465b-8798-c6f83c918e6e (dataset): DatasetConfig { id: 3be8a32b-7a67-465b-8798-c6f83c918e6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bf9c975-9c14-44ce-a510-a58a767b0850 (dataset): DatasetConfig { id: 3bf9c975-9c14-44ce-a510-a58a767b0850 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e76c35b-67c4-4482-bea0-9b231f235c8a (dataset): DatasetConfig { id: 3e76c35b-67c4-4482-bea0-9b231f235c8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4348fa4a-d35e-4aa8-8249-901ef098374b (dataset): DatasetConfig { id: 4348fa4a-d35e-4aa8-8249-901ef098374b (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 471a82e3-1ff8-47db-805b-f8930393fb35 (dataset): DatasetConfig { id: 471a82e3-1ff8-47db-805b-f8930393fb35 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49019e93-976d-4fef-a1ba-e8f86ebc4448 (dataset): DatasetConfig { id: 49019e93-976d-4fef-a1ba-e8f86ebc4448 (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 528fb4e9-6450-450d-98e2-ce1e45a00053 (dataset): DatasetConfig { id: 528fb4e9-6450-450d-98e2-ce1e45a00053 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 577f04b0-837b-424a-8ef9-abb775b6379d (dataset): DatasetConfig { id: 577f04b0-837b-424a-8ef9-abb775b6379d (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59ca4a10-ebfa-47f4-ba2d-d4a5a19914ea (dataset): DatasetConfig { id: 59ca4a10-ebfa-47f4-ba2d-d4a5a19914ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59e96a88-b304-4bb1-bb8a-00a60abe43b1 (dataset): DatasetConfig { id: 59e96a88-b304-4bb1-bb8a-00a60abe43b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5d881a78-a8f9-499d-802d-1de6d77d5ce8 (dataset): DatasetConfig { id: 5d881a78-a8f9-499d-802d-1de6d77d5ce8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f58d88f-e2ba-40d6-a419-183804b4f3c8 (dataset): DatasetConfig { id: 5f58d88f-e2ba-40d6-a419-183804b4f3c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60fca2f9-7d3d-4c9b-85b0-cdab59e16614 (dataset): DatasetConfig { id: 60fca2f9-7d3d-4c9b-85b0-cdab59e16614 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6632caab-de50-4961-9ef4-fe668df353de (dataset): DatasetConfig { id: 6632caab-de50-4961-9ef4-fe668df353de (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c98019a-ecc3-45bc-9d20-650a7d99d7fd (dataset): DatasetConfig { id: 6c98019a-ecc3-45bc-9d20-650a7d99d7fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cf76c1a-db77-4521-ba7e-cd0f6e67e11e (dataset): DatasetConfig { id: 6cf76c1a-db77-4521-ba7e-cd0f6e67e11e (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eb214f3-5753-4df0-8a13-f495870a400f (dataset): DatasetConfig { id: 6eb214f3-5753-4df0-8a13-f495870a400f (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70d85a43-dbcd-4dcd-8c62-e9c62c933f3e (dataset): DatasetConfig { id: 70d85a43-dbcd-4dcd-8c62-e9c62c933f3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72f95852-34b0-49c3-be34-639dcc24ea84 (dataset): DatasetConfig { id: 72f95852-34b0-49c3-be34-639dcc24ea84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 788954a9-78ca-4513-ae5c-84707beeb7ce (dataset): DatasetConfig { id: 788954a9-78ca-4513-ae5c-84707beeb7ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a67dd97-29fa-448e-954d-bf6552f752c5 (dataset): DatasetConfig { id: 7a67dd97-29fa-448e-954d-bf6552f752c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81c78be8-a510-4072-929c-fae280af9eea (dataset): DatasetConfig { id: 81c78be8-a510-4072-929c-fae280af9eea (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 853cc286-0731-446d-af33-a71dfd0279ff (dataset): DatasetConfig { id: 853cc286-0731-446d-af33-a71dfd0279ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ede75bc-9fab-4ec3-b3ec-ac777f3e522b (dataset): DatasetConfig { id: 8ede75bc-9fab-4ec3-b3ec-ac777f3e522b (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 911a5ab5-8749-42ad-bb3b-5ada3846ad43 (dataset): DatasetConfig { id: 911a5ab5-8749-42ad-bb3b-5ada3846ad43 (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 923ea203-af99-4c67-829c-ed2341d4f206 (dataset): DatasetConfig { id: 923ea203-af99-4c67-829c-ed2341d4f206 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 942d06f3-bff5-4137-a58e-e213cd7222e0 (dataset): DatasetConfig { id: 942d06f3-bff5-4137-a58e-e213cd7222e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9487bb7d-1b0c-4180-9cc9-6bc3200652e9 (dataset): DatasetConfig { id: 9487bb7d-1b0c-4180-9cc9-6bc3200652e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96d3289c-4370-4dcc-885f-2778a30e401d (dataset): DatasetConfig { id: 96d3289c-4370-4dcc-885f-2778a30e401d (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a5778ff-c9b9-4c45-949d-c42e57a86e97 (dataset): DatasetConfig { id: 9a5778ff-c9b9-4c45-949d-c42e57a86e97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b93ed23-a1f2-46d8-9ba5-af872e9f19ac (dataset): DatasetConfig { id: 9b93ed23-a1f2-46d8-9ba5-af872e9f19ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9be80f0f-177d-4f8d-b4d5-020882f56e48 (dataset): DatasetConfig { id: 9be80f0f-177d-4f8d-b4d5-020882f56e48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ee9d2b2-064a-458a-b654-7ca6573d2080 (dataset): DatasetConfig { id: 9ee9d2b2-064a-458a-b654-7ca6573d2080 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a60d6aa7-5a20-4510-aea9-54411976d974 (dataset): DatasetConfig { id: a60d6aa7-5a20-4510-aea9-54411976d974 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af0255fd-2634-45a6-b921-44eb886a8de7 (dataset): DatasetConfig { id: af0255fd-2634-45a6-b921-44eb886a8de7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b54ffc54-5f2e-4bd2-b510-dbf74c0354a5 (dataset): DatasetConfig { id: b54ffc54-5f2e-4bd2-b510-dbf74c0354a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b722eac6-9882-47ef-8a58-9982a4c50d79 (dataset): DatasetConfig { id: b722eac6-9882-47ef-8a58-9982a4c50d79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9e0732a-d6bc-48fc-a8d4-25b04100121c (dataset): DatasetConfig { id: b9e0732a-d6bc-48fc-a8d4-25b04100121c (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf1fd760-11bc-4f5d-a8d7-58374ce956f5 (dataset): DatasetConfig { id: bf1fd760-11bc-4f5d-a8d7-58374ce956f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c39e2a4c-773b-4e97-b88b-321ec5b8078d (dataset): DatasetConfig { id: c39e2a4c-773b-4e97-b88b-321ec5b8078d (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b09afa-1c56-466b-8b57-0c799c4790ca (dataset): DatasetConfig { id: c3b09afa-1c56-466b-8b57-0c799c4790ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc9f4cb9-c067-4a36-9f0b-381cc12a49d3 (dataset): DatasetConfig { id: cc9f4cb9-c067-4a36-9f0b-381cc12a49d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf4dd9f7-801c-4a61-b11c-d1e6e81c9bf8 (dataset): DatasetConfig { id: cf4dd9f7-801c-4a61-b11c-d1e6e81c9bf8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0ff1b98-4e1e-414a-aca2-6c9d7dbc465d (dataset): DatasetConfig { id: d0ff1b98-4e1e-414a-aca2-6c9d7dbc465d (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4f8201d-029a-4f24-ba42-692915fcf643 (dataset): DatasetConfig { id: d4f8201d-029a-4f24-ba42-692915fcf643 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6dbedca-7b10-45d3-9208-56211488da76 (dataset): DatasetConfig { id: d6dbedca-7b10-45d3-9208-56211488da76 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e60d7553-1376-49a1-b7c5-3ec010bc33fc (dataset): DatasetConfig { id: e60d7553-1376-49a1-b7c5-3ec010bc33fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6ee2186-ff5b-4c92-aeee-562f0078aa1e (dataset): DatasetConfig { id: e6ee2186-ff5b-4c92-aeee-562f0078aa1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e93de6ae-ae58-4eb2-825f-83009c3e37a9 (dataset): DatasetConfig { id: e93de6ae-ae58-4eb2-825f-83009c3e37a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edf5e49e-d1db-48a5-8e16-5ba8d67c0d12 (dataset): DatasetConfig { id: edf5e49e-d1db-48a5-8e16-5ba8d67c0d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f061b876-aabc-4a94-843e-b856fc1f4b69 (dataset): DatasetConfig { id: f061b876-aabc-4a94-843e-b856fc1f4b69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f06a3937-b51a-4365-8df0-6143575bced3 (dataset): DatasetConfig { id: f06a3937-b51a-4365-8df0-6143575bced3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe3be520-ac55-4eb4-935e-49e46b22c546 (dataset): DatasetConfig { id: fe3be520-ac55-4eb4-935e-49e46b22c546 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422024-12-19T21:39:10.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34777
4432024-12-19T21:39:10.010ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4442024-12-19T21:39:10.014ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00c5e572-d9b4-4de0-9ce4-b52cb2bbde2d (dataset): DatasetConfig { id: 00c5e572-d9b4-4de0-9ce4-b52cb2bbde2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 04a4c6a4-b622-46ca-a680-ecb0db0108b9 (dataset): DatasetConfig { id: 04a4c6a4-b622-46ca-a680-ecb0db0108b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_410afead-fda9-4475-970e-8ade982017e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f0bedb1-df6d-4af1-803d-23668eab3299 (dataset): DatasetConfig { id: 0f0bedb1-df6d-4af1-803d-23668eab3299 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12255c49-ccd9-4c50-9c52-3eaf15fa64eb (dataset): DatasetConfig { id: 12255c49-ccd9-4c50-9c52-3eaf15fa64eb (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13321d1c-8894-4eeb-aeb8-a007c9dbb97d (dataset): DatasetConfig { id: 13321d1c-8894-4eeb-aeb8-a007c9dbb97d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14f52bed-9371-47dd-a3bf-78f637ad036b (dataset): DatasetConfig { id: 14f52bed-9371-47dd-a3bf-78f637ad036b (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1649d46e-99e7-46b3-b0c5-5ecb519ce07b (dataset): DatasetConfig { id: 1649d46e-99e7-46b3-b0c5-5ecb519ce07b (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17dd409c-91cd-47f5-a494-8ae5d311bd2d (dataset): DatasetConfig { id: 17dd409c-91cd-47f5-a494-8ae5d311bd2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 22ae6142-fe4b-4fcd-947d-6e11583d7171 (dataset): DatasetConfig { id: 22ae6142-fe4b-4fcd-947d-6e11583d7171 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 242f8e33-f305-43aa-a580-e4324097f90f (dataset): DatasetConfig { id: 242f8e33-f305-43aa-a580-e4324097f90f (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 329a45f8-41a8-41a9-bf94-610609054b00 (dataset): DatasetConfig { id: 329a45f8-41a8-41a9-bf94-610609054b00 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 355d53a8-e065-4c57-b33e-6018a595ca5c (dataset): DatasetConfig { id: 355d53a8-e065-4c57-b33e-6018a595ca5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3aade3f8-936a-403c-95fd-e20f1e18878f (dataset): DatasetConfig { id: 3aade3f8-936a-403c-95fd-e20f1e18878f (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3be8a32b-7a67-465b-8798-c6f83c918e6e (dataset): DatasetConfig { id: 3be8a32b-7a67-465b-8798-c6f83c918e6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3bf9c975-9c14-44ce-a510-a58a767b0850 (dataset): DatasetConfig { id: 3bf9c975-9c14-44ce-a510-a58a767b0850 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e76c35b-67c4-4482-bea0-9b231f235c8a (dataset): DatasetConfig { id: 3e76c35b-67c4-4482-bea0-9b231f235c8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4348fa4a-d35e-4aa8-8249-901ef098374b (dataset): DatasetConfig { id: 4348fa4a-d35e-4aa8-8249-901ef098374b (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 471a82e3-1ff8-47db-805b-f8930393fb35 (dataset): DatasetConfig { id: 471a82e3-1ff8-47db-805b-f8930393fb35 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49019e93-976d-4fef-a1ba-e8f86ebc4448 (dataset): DatasetConfig { id: 49019e93-976d-4fef-a1ba-e8f86ebc4448 (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 528fb4e9-6450-450d-98e2-ce1e45a00053 (dataset): DatasetConfig { id: 528fb4e9-6450-450d-98e2-ce1e45a00053 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 577f04b0-837b-424a-8ef9-abb775b6379d (dataset): DatasetConfig { id: 577f04b0-837b-424a-8ef9-abb775b6379d (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59ca4a10-ebfa-47f4-ba2d-d4a5a19914ea (dataset): DatasetConfig { id: 59ca4a10-ebfa-47f4-ba2d-d4a5a19914ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59e96a88-b304-4bb1-bb8a-00a60abe43b1 (dataset): DatasetConfig { id: 59e96a88-b304-4bb1-bb8a-00a60abe43b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5d881a78-a8f9-499d-802d-1de6d77d5ce8 (dataset): DatasetConfig { id: 5d881a78-a8f9-499d-802d-1de6d77d5ce8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f58d88f-e2ba-40d6-a419-183804b4f3c8 (dataset): DatasetConfig { id: 5f58d88f-e2ba-40d6-a419-183804b4f3c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 60fca2f9-7d3d-4c9b-85b0-cdab59e16614 (dataset): DatasetConfig { id: 60fca2f9-7d3d-4c9b-85b0-cdab59e16614 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6632caab-de50-4961-9ef4-fe668df353de (dataset): DatasetConfig { id: 6632caab-de50-4961-9ef4-fe668df353de (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6c98019a-ecc3-45bc-9d20-650a7d99d7fd (dataset): DatasetConfig { id: 6c98019a-ecc3-45bc-9d20-650a7d99d7fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cf76c1a-db77-4521-ba7e-cd0f6e67e11e (dataset): DatasetConfig { id: 6cf76c1a-db77-4521-ba7e-cd0f6e67e11e (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6eb214f3-5753-4df0-8a13-f495870a400f (dataset): DatasetConfig { id: 6eb214f3-5753-4df0-8a13-f495870a400f (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70d85a43-dbcd-4dcd-8c62-e9c62c933f3e (dataset): DatasetConfig { id: 70d85a43-dbcd-4dcd-8c62-e9c62c933f3e (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72f95852-34b0-49c3-be34-639dcc24ea84 (dataset): DatasetConfig { id: 72f95852-34b0-49c3-be34-639dcc24ea84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 788954a9-78ca-4513-ae5c-84707beeb7ce (dataset): DatasetConfig { id: 788954a9-78ca-4513-ae5c-84707beeb7ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a67dd97-29fa-448e-954d-bf6552f752c5 (dataset): DatasetConfig { id: 7a67dd97-29fa-448e-954d-bf6552f752c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81c78be8-a510-4072-929c-fae280af9eea (dataset): DatasetConfig { id: 81c78be8-a510-4072-929c-fae280af9eea (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 853cc286-0731-446d-af33-a71dfd0279ff (dataset): DatasetConfig { id: 853cc286-0731-446d-af33-a71dfd0279ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ede75bc-9fab-4ec3-b3ec-ac777f3e522b (dataset): DatasetConfig { id: 8ede75bc-9fab-4ec3-b3ec-ac777f3e522b (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 911a5ab5-8749-42ad-bb3b-5ada3846ad43 (dataset): DatasetConfig { id: 911a5ab5-8749-42ad-bb3b-5ada3846ad43 (dataset), name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 923ea203-af99-4c67-829c-ed2341d4f206 (dataset): DatasetConfig { id: 923ea203-af99-4c67-829c-ed2341d4f206 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 942d06f3-bff5-4137-a58e-e213cd7222e0 (dataset): DatasetConfig { id: 942d06f3-bff5-4137-a58e-e213cd7222e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9487bb7d-1b0c-4180-9cc9-6bc3200652e9 (dataset): DatasetConfig { id: 9487bb7d-1b0c-4180-9cc9-6bc3200652e9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96d3289c-4370-4dcc-885f-2778a30e401d (dataset): DatasetConfig { id: 96d3289c-4370-4dcc-885f-2778a30e401d (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a5778ff-c9b9-4c45-949d-c42e57a86e97 (dataset): DatasetConfig { id: 9a5778ff-c9b9-4c45-949d-c42e57a86e97 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9b93ed23-a1f2-46d8-9ba5-af872e9f19ac (dataset): DatasetConfig { id: 9b93ed23-a1f2-46d8-9ba5-af872e9f19ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9be80f0f-177d-4f8d-b4d5-020882f56e48 (dataset): DatasetConfig { id: 9be80f0f-177d-4f8d-b4d5-020882f56e48 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9ee9d2b2-064a-458a-b654-7ca6573d2080 (dataset): DatasetConfig { id: 9ee9d2b2-064a-458a-b654-7ca6573d2080 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a60d6aa7-5a20-4510-aea9-54411976d974 (dataset): DatasetConfig { id: a60d6aa7-5a20-4510-aea9-54411976d974 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, af0255fd-2634-45a6-b921-44eb886a8de7 (dataset): DatasetConfig { id: af0255fd-2634-45a6-b921-44eb886a8de7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b54ffc54-5f2e-4bd2-b510-dbf74c0354a5 (dataset): DatasetConfig { id: b54ffc54-5f2e-4bd2-b510-dbf74c0354a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b722eac6-9882-47ef-8a58-9982a4c50d79 (dataset): DatasetConfig { id: b722eac6-9882-47ef-8a58-9982a4c50d79 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9e0732a-d6bc-48fc-a8d4-25b04100121c (dataset): DatasetConfig { id: b9e0732a-d6bc-48fc-a8d4-25b04100121c (dataset), name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf1fd760-11bc-4f5d-a8d7-58374ce956f5 (dataset): DatasetConfig { id: bf1fd760-11bc-4f5d-a8d7-58374ce956f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c39e2a4c-773b-4e97-b88b-321ec5b8078d (dataset): DatasetConfig { id: c39e2a4c-773b-4e97-b88b-321ec5b8078d (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3b09afa-1c56-466b-8b57-0c799c4790ca (dataset): DatasetConfig { id: c3b09afa-1c56-466b-8b57-0c799c4790ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc9f4cb9-c067-4a36-9f0b-381cc12a49d3 (dataset): DatasetConfig { id: cc9f4cb9-c067-4a36-9f0b-381cc12a49d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cf4dd9f7-801c-4a61-b11c-d1e6e81c9bf8 (dataset): DatasetConfig { id: cf4dd9f7-801c-4a61-b11c-d1e6e81c9bf8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0ff1b98-4e1e-414a-aca2-6c9d7dbc465d (dataset): DatasetConfig { id: d0ff1b98-4e1e-414a-aca2-6c9d7dbc465d (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d4f8201d-029a-4f24-ba42-692915fcf643 (dataset): DatasetConfig { id: d4f8201d-029a-4f24-ba42-692915fcf643 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6dbedca-7b10-45d3-9208-56211488da76 (dataset): DatasetConfig { id: d6dbedca-7b10-45d3-9208-56211488da76 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, e60d7553-1376-49a1-b7c5-3ec010bc33fc (dataset): DatasetConfig { id: e60d7553-1376-49a1-b7c5-3ec010bc33fc (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6ee2186-ff5b-4c92-aeee-562f0078aa1e (dataset): DatasetConfig { id: e6ee2186-ff5b-4c92-aeee-562f0078aa1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e93de6ae-ae58-4eb2-825f-83009c3e37a9 (dataset): DatasetConfig { id: e93de6ae-ae58-4eb2-825f-83009c3e37a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edf5e49e-d1db-48a5-8e16-5ba8d67c0d12 (dataset): DatasetConfig { id: edf5e49e-d1db-48a5-8e16-5ba8d67c0d12 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f061b876-aabc-4a94-843e-b856fc1f4b69 (dataset): DatasetConfig { id: f061b876-aabc-4a94-843e-b856fc1f4b69 (dataset), name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f06a3937-b51a-4365-8df0-6143575bced3 (dataset): DatasetConfig { id: f06a3937-b51a-4365-8df0-6143575bced3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe3be520-ac55-4eb4-935e-49e46b22c546 (dataset): DatasetConfig { id: fe3be520-ac55-4eb4-935e-49e46b22c546 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4452024-12-19T21:39:10.014ZINFOSledAgent (StorageManager): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462024-12-19T21:39:10.014ZINFOSledAgent (StorageManager): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-19T21:39:10.014ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4482024-12-19T21:39:10.014ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4492024-12-19T21:39:10.014ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/debug"), full_name: "oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/debug" } file = sled-storage/src/manager.rs:1331
4502024-12-19T21:39:10.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4512024-12-19T21:39:10.082ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_nexus_410afead-fda9-4475-970e-8ade982017e3"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_nexus_410afead-fda9-4475-970e-8ade982017e3" } file = sled-storage/src/manager.rs:1331
4522024-12-19T21:39:10.085ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4532024-12-19T21:39:10.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4542024-12-19T21:39:10.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crucible" } file = sled-storage/src/manager.rs:1331
4552024-12-19T21:39:10.270ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4562024-12-19T21:39:10.270ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51" } file = sled-storage/src/manager.rs:1331
4572024-12-19T21:39:10.370ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4582024-12-19T21:39:10.370ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba" } file = sled-storage/src/manager.rs:1331
4592024-12-19T21:39:10.468ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4602024-12-19T21:39:10.468ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4612024-12-19T21:39:10.558ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622024-12-19T21:39:10.558ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone/oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce"), full_name: "oxp_ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone/oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce" } file = sled-storage/src/manager.rs:1331
4632024-12-19T21:39:10.656ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-12-19T21:39:10.656ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crucible" } file = sled-storage/src/manager.rs:1331
4652024-12-19T21:39:10.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-12-19T21:39:10.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone/oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone/oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a" } file = sled-storage/src/manager.rs:1331
4672024-12-19T21:39:10.840ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-12-19T21:39:10.840ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/debug"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/debug" } file = sled-storage/src/manager.rs:1331
4692024-12-19T21:39:10.906ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-12-19T21:39:10.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e" } file = sled-storage/src/manager.rs:1331
4712024-12-19T21:39:11.007ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-12-19T21:39:11.007ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone"), full_name: "oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone" } file = sled-storage/src/manager.rs:1331
4732024-12-19T21:39:11.075ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-12-19T21:39:11.075ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309" } file = sled-storage/src/manager.rs:1331
4752024-12-19T21:39:11.088ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4762024-12-19T21:39:11.174ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-12-19T21:39:11.174ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a" } file = sled-storage/src/manager.rs:1331
4782024-12-19T21:39:11.272ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-12-19T21:39:11.272ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone"), full_name: "oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone" } file = sled-storage/src/manager.rs:1331
4802024-12-19T21:39:11.342ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-12-19T21:39:11.342ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crucible" } file = sled-storage/src/manager.rs:1331
4822024-12-19T21:39:11.429ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-12-19T21:39:11.429ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone/oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99"), full_name: "oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone/oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99" } file = sled-storage/src/manager.rs:1331
4842024-12-19T21:39:11.526ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-12-19T21:39:11.526ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone/oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c"), full_name: "oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone/oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c" } file = sled-storage/src/manager.rs:1331
4862024-12-19T21:39:11.627ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-12-19T21:39:11.627ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone/oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a"), full_name: "oxp_ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone/oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a" } file = sled-storage/src/manager.rs:1331
4882024-12-19T21:39:11.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-12-19T21:39:11.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone/oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone/oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5" } file = sled-storage/src/manager.rs:1331
4902024-12-19T21:39:11.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-12-19T21:39:11.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone"), full_name: "oxp_ecb3b641-1217-432e-886e-545d59bd115f/crypt/zone" } file = sled-storage/src/manager.rs:1331
4922024-12-19T21:39:11.889ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-12-19T21:39:11.889ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone/oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971" } file = sled-storage/src/manager.rs:1331
4942024-12-19T21:39:11.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-12-19T21:39:11.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/debug"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/debug" } file = sled-storage/src/manager.rs:1331
4962024-12-19T21:39:12.057ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-12-19T21:39:12.057ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone/oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone/oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5" } file = sled-storage/src/manager.rs:1331
4982024-12-19T21:39:12.090ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
4992024-12-19T21:39:12.104ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 17.77121302s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
5002024-12-19T21:39:12.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-12-19T21:39:12.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a" } file = sled-storage/src/manager.rs:1331
5022024-12-19T21:39:12.254ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-19T21:39:12.254ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/zone" } file = sled-storage/src/manager.rs:1331
5042024-12-19T21:39:12.321ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-19T21:39:12.321ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5062024-12-19T21:39:12.413ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-19T21:39:12.413ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone" } file = sled-storage/src/manager.rs:1331
5082024-12-19T21:39:12.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-19T21:39:12.482ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone" } file = sled-storage/src/manager.rs:1331
5102024-12-19T21:39:12.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-12-19T21:39:12.549ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5122024-12-19T21:39:12.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-12-19T21:39:12.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13" } file = sled-storage/src/manager.rs:1331
5142024-12-19T21:39:12.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-12-19T21:39:12.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/debug"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/debug" } file = sled-storage/src/manager.rs:1331
5162024-12-19T21:39:12.806ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-12-19T21:39:12.806ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc" } file = sled-storage/src/manager.rs:1331
5182024-12-19T21:39:12.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-12-19T21:39:12.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/debug"), full_name: "oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/debug" } file = sled-storage/src/manager.rs:1331
5202024-12-19T21:39:12.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-12-19T21:39:12.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone/oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777"), full_name: "oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone/oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777" } file = sled-storage/src/manager.rs:1331
5222024-12-19T21:39:13.075ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-19T21:39:13.075ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone/oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf"), full_name: "oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/zone/oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf" } file = sled-storage/src/manager.rs:1331
5242024-12-19T21:39:13.093ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
5252024-12-19T21:39:13.168ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-12-19T21:39:13.168ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ecb3b641-1217-432e-886e-545d59bd115f/crucible" } file = sled-storage/src/manager.rs:1331
5272024-12-19T21:39:13.252ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-12-19T21:39:13.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ecb3b641-1217-432e-886e-545d59bd115f/crypt/debug"), full_name: "oxp_ecb3b641-1217-432e-886e-545d59bd115f/crypt/debug" } file = sled-storage/src/manager.rs:1331
5292024-12-19T21:39:13.317ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-12-19T21:39:13.317ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea" } file = sled-storage/src/manager.rs:1331
5312024-12-19T21:39:13.414ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-12-19T21:39:13.414ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/debug"), full_name: "oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/debug" } file = sled-storage/src/manager.rs:1331
5332024-12-19T21:39:13.481ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-12-19T21:39:13.481ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone"), full_name: "oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/zone" } file = sled-storage/src/manager.rs:1331
5352024-12-19T21:39:13.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-12-19T21:39:13.549ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5372024-12-19T21:39:13.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-12-19T21:39:13.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone"), full_name: "oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone" } file = sled-storage/src/manager.rs:1331
5392024-12-19T21:39:13.704ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-12-19T21:39:13.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crucible" } file = sled-storage/src/manager.rs:1331
5412024-12-19T21:39:13.792ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-12-19T21:39:13.792ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crucible" } file = sled-storage/src/manager.rs:1331
5432024-12-19T21:39:13.888ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-12-19T21:39:13.888ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5452024-12-19T21:39:13.979ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-12-19T21:39:13.979ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone/oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9"), full_name: "oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/zone/oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9" } file = sled-storage/src/manager.rs:1331
5472024-12-19T21:39:14.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-12-19T21:39:14.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/debug"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/debug" } file = sled-storage/src/manager.rs:1331
5492024-12-19T21:39:14.098ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
5502024-12-19T21:39:14.153ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-12-19T21:39:14.153ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5522024-12-19T21:39:14.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-12-19T21:39:14.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16" } file = sled-storage/src/manager.rs:1331
5542024-12-19T21:39:14.338ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-12-19T21:39:14.338ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crucible" } file = sled-storage/src/manager.rs:1331
5562024-12-19T21:39:14.424ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-12-19T21:39:14.424ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone/oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25"), full_name: "oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/zone/oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25" } file = sled-storage/src/manager.rs:1331
5582024-12-19T21:39:14.525ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-12-19T21:39:14.525ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b" } file = sled-storage/src/manager.rs:1331
5602024-12-19T21:39:14.625ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-19T21:39:14.625ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd" } file = sled-storage/src/manager.rs:1331
5622024-12-19T21:39:14.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-12-19T21:39:14.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone/oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1" } file = sled-storage/src/manager.rs:1331
5642024-12-19T21:39:14.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-12-19T21:39:14.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crucible" } file = sled-storage/src/manager.rs:1331
5662024-12-19T21:39:14.911ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5672024-12-19T21:39:14.911ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible" } file = sled-storage/src/manager.rs:1331
5682024-12-19T21:39:15.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692024-12-19T21:39:15.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5702024-12-19T21:39:15.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 605881854547968964 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
5712024-12-19T21:39:15.029ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7641755169457676733 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
5722024-12-19T21:39:15.099ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
5732024-12-19T21:39:15.103ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-12-19T21:39:15.103ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/debug"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/debug" } file = sled-storage/src/manager.rs:1331
5752024-12-19T21:39:15.170ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-12-19T21:39:15.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5772024-12-19T21:39:15.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-12-19T21:39:15.258ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5792024-12-19T21:39:15.346ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-12-19T21:39:15.346ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97"), full_name: "oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/zone/oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97" } file = sled-storage/src/manager.rs:1331
5812024-12-19T21:39:15.438ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-12-19T21:39:15.438ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5832024-12-19T21:39:15.480ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4333
5842024-12-19T21:39:15.480ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4343 gateway = fd00:1122:3344:101::1
5852024-12-19T21:39:15.487ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4357 gateway = fd00:1122:3344:101::1
5862024-12-19T21:39:15.487ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4422
5872024-12-19T21:39:15.539ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5882024-12-19T21:39:15.539ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e"), full_name: "oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/zone/oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e" } file = sled-storage/src/manager.rs:1331
5892024-12-19T21:39:15.648ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4463
5902024-12-19T21:39:15.648ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4490
5912024-12-19T21:39:15.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922024-12-19T21:39:15.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/zone" } file = sled-storage/src/manager.rs:1331
5932024-12-19T21:39:15.694ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4503
5942024-12-19T21:39:15.694ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4374
5952024-12-19T21:39:15.734ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5962024-12-19T21:39:15.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5972024-12-19T21:39:15.748ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4416
5982024-12-19T21:39:15.748ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4470 rack_subnet = fd00:1122:3344::
5992024-12-19T21:39:15.769ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4481
6002024-12-19T21:39:15.769ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4554
6012024-12-19T21:39:15.839ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6022024-12-19T21:39:15.839ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6032024-12-19T21:39:15.840ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
6042024-12-19T21:39:15.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5829578 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34777 req_id = a1d4d733-965c-44be-b363-9fdeebbd91d9 response_code = 200 uri = /datasets
6052024-12-19T21:39:15.841ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4586
6062024-12-19T21:39:15.841ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4592
6072024-12-19T21:39:15.890ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: f3cae610-b94b-4d69-be23-a035fb38b2c1 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6082024-12-19T21:39:15.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61504
6092024-12-19T21:39:15.891ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6102024-12-19T21:39:15.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }
6112024-12-19T21:39:15.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6122024-12-19T21:39:15.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6132024-12-19T21:39:15.936ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4633
6142024-12-19T21:39:15.937ZINFOSledAgent (ServiceManager): configuring tfport service file = sled-agent/src/services.rs:4506
6152024-12-19T21:39:15.958ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6162024-12-19T21:39:15.958ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6172024-12-19T21:39:15.993ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6182024-12-19T21:39:15.993ZINFOSledAgent (ServiceManager): No ledger in /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:188
6192024-12-19T21:39:15.993ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:188
6202024-12-19T21:39:15.993ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6212024-12-19T21:39:16.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6222024-12-19T21:39:16.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6232024-12-19T21:39:16.046ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6242024-12-19T21:39:16.049ZINFOSledAgent (ServiceManager): refreshed tfport service with new configuration file = sled-agent/src/services.rs:4539
6252024-12-19T21:39:16.049ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6262024-12-19T21:39:16.103ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
6272024-12-19T21:39:16.103ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1 file = illumos-utils/src/zone.rs:325
6282024-12-19T21:39:16.107ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea file = illumos-utils/src/zone.rs:325
6292024-12-19T21:39:16.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a file = illumos-utils/src/zone.rs:325
6302024-12-19T21:39:16.115ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6312024-12-19T21:39:16.116ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/nexus.rs:527 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
6322024-12-19T21:39:16.123ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1 file = illumos-utils/src/zone.rs:363
6332024-12-19T21:39:16.129ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea file = illumos-utils/src/zone.rs:363
6342024-12-19T21:39:16.134ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a file = illumos-utils/src/zone.rs:363
6352024-12-19T21:39:16.159ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6362024-12-19T21:39:16.159ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6372024-12-19T21:39:16.159ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6382024-12-19T21:39:16.159ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6392024-12-19T21:39:16.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
6402024-12-19T21:39:16.268ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6412024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6422024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6432024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6442024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6452024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6462024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6472024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6482024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6492024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6502024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6512024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6522024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6532024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6542024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6552024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6562024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6572024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6582024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6592024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6602024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6612024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6622024-12-19T21:39:16.268ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6632024-12-19T21:39:16.296ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10288280158725169058 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
6642024-12-19T21:39:16.296ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3617067623367857126 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
6652024-12-19T21:39:17.105ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e282623f-c8b6-42e1-8711-fe2573bc5d47) file = sled-agent/src/probe_manager.rs:231 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
6662024-12-19T21:39:17.737ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6672024-12-19T21:39:17.737ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6682024-12-19T21:39:18.214ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6692024-12-19T21:39:18.214ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6702024-12-19T21:39:18.218ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6712024-12-19T21:39:18.700ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6722024-12-19T21:39:18.700ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6732024-12-19T21:39:18.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 29.085059ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6742024-12-19T21:39:18.717ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6752024-12-19T21:39:18.717ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6762024-12-19T21:39:18.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 111.30436ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6772024-12-19T21:39:18.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 67.473418ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6782024-12-19T21:39:18.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 60.393704ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6792024-12-19T21:39:18.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 137.030391ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6802024-12-19T21:39:18.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 51.725ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6812024-12-19T21:39:18.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 81.228438ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6822024-12-19T21:39:19.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 227.088679ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6832024-12-19T21:39:19.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 412.685906ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6842024-12-19T21:39:19.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 176.185151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6852024-12-19T21:39:19.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 342.409855ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6862024-12-19T21:39:19.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 537.888297ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6872024-12-19T21:39:19.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 665.306627ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6882024-12-19T21:39:19.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 1.110950324s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6892024-12-19T21:39:19.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 595.497923ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6902024-12-19T21:39:20.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 720.812545ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6912024-12-19T21:39:20.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 1.098649428s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6922024-12-19T21:39:20.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 1.458299025s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6932024-12-19T21:39:20.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 874.777589ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6942024-12-19T21:39:21.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 518.487406ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6952024-12-19T21:39:21.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 905.642176ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6962024-12-19T21:39:22.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 1.057857486s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
6972024-12-19T21:39:22.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 1.383478786s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
6982024-12-19T21:39:22.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a") failed: Property not found. retry in 1.152035775s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
6992024-12-19T21:39:23.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea") failed: Property not found. retry in 1.2745806s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
7002024-12-19T21:39:23.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1") failed: Property not found. retry in 1.205716642s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
7012024-12-19T21:39:24.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_internal_dns_f3cae610-b94b-4d69-be23-a035fb38b2c1
7022024-12-19T21:39:24.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_internal_dns_bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea
7032024-12-19T21:39:24.842ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_internal_dns_60dc5fae-fad2-4cae-9c7e-fdda2aea363a
7042024-12-19T21:39:24.842ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7052024-12-19T21:39:24.842ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7062024-12-19T21:39:24.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8951723 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61504 req_id = c28cb793-00fa-45b6-9d44-0bc84aca193d response_code = 204 uri = /omicron-zones
7072024-12-19T21:39:24.844ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7082024-12-19T21:39:24.890ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7092024-12-19T21:39:24.934ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7102024-12-19T21:39:24.979ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7112024-12-19T21:39:24.980ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7122024-12-19T21:39:25.010ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7132024-12-19T21:39:25.011ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7142024-12-19T21:39:25.011ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7152024-12-19T21:39:25.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 605881854547968964 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7162024-12-19T21:39:25.030ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7641755169457676733 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7172024-12-19T21:39:25.041ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: f3cae610-b94b-4d69-be23-a035fb38b2c1 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e17d287d-219c-4012-870a-4f408f12ce99 (service), filesystem_pool: Some(ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 126ba733-5d82-491f-9d70-0e3fa3bee131, kind: Service { id: e17d287d-219c-4012-870a-4f408f12ce99 }, name: Name("ntp-e17d287d-219c-4012-870a-4f408f12ce99"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 81])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7182024-12-19T21:39:25.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41695
7192024-12-19T21:39:25.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7202024-12-19T21:39:25.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }
7212024-12-19T21:39:25.081ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7222024-12-19T21:39:25.081ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7232024-12-19T21:39:25.116ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7242024-12-19T21:39:25.116ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7252024-12-19T21:39:25.149ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7262024-12-19T21:39:25.149ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
7272024-12-19T21:39:25.149ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
7282024-12-19T21:39:25.149ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7292024-12-19T21:39:25.161ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7302024-12-19T21:39:25.193ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7312024-12-19T21:39:25.194ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7322024-12-19T21:39:25.194ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7332024-12-19T21:39:25.223ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 185, 81]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7342024-12-19T21:39:25.223ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = boundary_ntp
7352024-12-19T21:39:25.224ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7362024-12-19T21:39:25.224ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7372024-12-19T21:39:25.224ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7382024-12-19T21:39:25.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7392024-12-19T21:39:25.247ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99 file = illumos-utils/src/zone.rs:325
7402024-12-19T21:39:25.266ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99 file = illumos-utils/src/zone.rs:363
7412024-12-19T21:39:25.863ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7422024-12-19T21:39:25.863ZINFOSledAgent (ServiceManager): Booting oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7432024-12-19T21:39:25.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 74.425798ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7442024-12-19T21:39:26.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 131.951563ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7452024-12-19T21:39:26.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 195.21538ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7462024-12-19T21:39:26.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10288280158725169058 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7472024-12-19T21:39:26.298ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3617067623367857126 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7482024-12-19T21:39:26.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 529.447131ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7492024-12-19T21:39:26.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 401.726775ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7502024-12-19T21:39:27.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 1.400425098s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7512024-12-19T21:39:28.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 1.392646034s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7522024-12-19T21:39:30.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99") failed: Property not found. retry in 1.183314439s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7532024-12-19T21:39:31.384ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99
7542024-12-19T21:39:31.384ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7552024-12-19T21:39:31.384ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7562024-12-19T21:39:31.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6343689 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41695 req_id = 93fd1d9a-1aa9-4287-a99b-627bc58fb5bf response_code = 204 uri = /omicron-zones
7572024-12-19T21:39:31.388ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7582024-12-19T21:39:31.418ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7592024-12-19T21:39:31.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36506
7602024-12-19T21:39:31.427ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3941
7612024-12-19T21:39:31.427ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7911 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36506 req_id = 75006564-e6ff-49e9-8e61-d09361d3252a response_code = 500 uri = /timesync
7622024-12-19T21:39:31.429ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7632024-12-19T21:39:31.522ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7642024-12-19T21:39:31.522ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40827
7652024-12-19T21:39:35.530ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3941
7662024-12-19T21:39:35.530ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008084 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40827 req_id = b0139a8a-e152-4008-937a-f29f7862a7f5 response_code = 500 uri = /timesync
7672024-12-19T21:39:35.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 605881854547968964 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7682024-12-19T21:39:35.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7641755169457676733 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7692024-12-19T21:39:35.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1411580438379938599 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7702024-12-19T21:39:35.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2613469548819625268 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7712024-12-19T21:39:35.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15145040438056764181 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7722024-12-19T21:39:35.533ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7732024-12-19T21:39:35.732ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7742024-12-19T21:39:35.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61257
7752024-12-19T21:39:35.740ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3941
7762024-12-19T21:39:35.741ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61257 req_id = f837ef09-1a44-4893-985a-fd47b28e5fb7 response_code = 500 uri = /timesync
7772024-12-19T21:39:35.743ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7782024-12-19T21:39:35.866ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7792024-12-19T21:39:35.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59950
7802024-12-19T21:39:36.300ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10288280158725169058 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7812024-12-19T21:39:36.300ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3617067623367857126 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
7822024-12-19T21:39:39.792ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e17d287d-219c-4012-870a-4f408f12ce99': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3941
7832024-12-19T21:39:39.792ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4007871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59950 req_id = de7d5b08-c0ec-43b6-9a23-7b6a6113b6c3 response_code = 500 uri = /timesync
7842024-12-19T21:39:39.795ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7852024-12-19T21:39:39.982ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7862024-12-19T21:39:39.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44804
7872024-12-19T21:39:39.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7652 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44804 req_id = f87f17f1-da58-4cb2-86d6-11e1e55aad41 response_code = 200 uri = /timesync
7882024-12-19T21:39:39.993ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: -0.087738328 } file = sled-agent/src/rack_setup/service.rs:743
7892024-12-19T21:39:39.993ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7902024-12-19T21:39:40.053ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7912024-12-19T21:39:40.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54317
7922024-12-19T21:39:40.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54317 req_id = b954acfa-ee09-42b9-8351-2cad145421fb response_code = 200 uri = /timesync
7932024-12-19T21:39:40.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 9.9e-8 } file = sled-agent/src/rack_setup/service.rs:743
7942024-12-19T21:39:40.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7952024-12-19T21:39:40.232ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7962024-12-19T21:39:40.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55411
7972024-12-19T21:39:40.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7859 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55411 req_id = 0facb1dc-a1af-41af-9af1-e093bc37c66a response_code = 200 uri = /timesync
7982024-12-19T21:39:40.241ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 9.9e-8 } file = sled-agent/src/rack_setup/service.rs:743
7992024-12-19T21:39:40.241ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8002024-12-19T21:39:40.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8012024-12-19T21:39:40.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39582
8022024-12-19T21:39:40.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39582 req_id = a2fe6acf-d437-4d5a-af23-99d2c2253649 response_code = 200 uri = /timesync
8032024-12-19T21:39:40.665ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 9.9e-8 } file = sled-agent/src/rack_setup/service.rs:743
8042024-12-19T21:39:40.665ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8052024-12-19T21:39:41.113ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8062024-12-19T21:39:41.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34870
8072024-12-19T21:39:41.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34870 req_id = adc5bead-9049-45c5-bb91-ba6666a7a630 response_code = 200 uri = /timesync
8082024-12-19T21:39:41.122ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: -0.004694144 } file = sled-agent/src/rack_setup/service.rs:743
8092024-12-19T21:39:41.122ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8102024-12-19T21:39:41.210ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11676396557915356162 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8112024-12-19T21:39:41.210ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12092932624707563877 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8122024-12-19T21:39:41.570ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8132024-12-19T21:39:41.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48971
8142024-12-19T21:39:41.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48971 req_id = 608fe1b1-403b-4911-b212-57d2eed29dac response_code = 200 uri = /timesync
8152024-12-19T21:39:41.579ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: -0.004145737 } file = sled-agent/src/rack_setup/service.rs:743
8162024-12-19T21:39:41.579ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8172024-12-19T21:39:42.368ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8182024-12-19T21:39:42.368ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55228
8192024-12-19T21:39:42.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55228 req_id = 6a248c50-822f-460d-87cb-dd2b706cbd75 response_code = 200 uri = /timesync
8202024-12-19T21:39:42.378ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 0.000742315 } file = sled-agent/src/rack_setup/service.rs:743
8212024-12-19T21:39:42.378ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8222024-12-19T21:39:42.912ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8232024-12-19T21:39:42.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64154
8242024-12-19T21:39:42.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64154 req_id = f919e47d-9b40-4651-9ed9-accae1aa02d6 response_code = 200 uri = /timesync
8252024-12-19T21:39:42.923ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 0.000724336 } file = sled-agent/src/rack_setup/service.rs:743
8262024-12-19T21:39:42.923ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8272024-12-19T21:39:43.361ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8282024-12-19T21:39:43.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33970
8292024-12-19T21:39:43.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7920 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33970 req_id = bc6617ab-5b91-4920-8991-a199a803117c response_code = 200 uri = /timesync
8302024-12-19T21:39:43.371ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 0.002092363 } file = sled-agent/src/rack_setup/service.rs:743
8312024-12-19T21:39:43.371ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8322024-12-19T21:39:44.436ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332024-12-19T21:39:44.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64262
8342024-12-19T21:39:44.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8589 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64262 req_id = 25b85b07-6144-48bd-a8c2-3a50da5c5e9e response_code = 200 uri = /timesync
8352024-12-19T21:39:44.446ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734644377.2657082, correction: 0.003801638 } file = sled-agent/src/rack_setup/service.rs:743
8362024-12-19T21:39:44.446ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372024-12-19T21:39:44.734ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 221.733604ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8382024-12-19T21:39:45.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 605881854547968964 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8392024-12-19T21:39:45.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7641755169457676733 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8402024-12-19T21:39:45.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1411580438379938599 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8412024-12-19T21:39:45.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2613469548819625268 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8422024-12-19T21:39:45.357ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15145040438056764181 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
8432024-12-19T21:39:45.570ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50168
8442024-12-19T21:39:45.570ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50168 req_id = 496e0163-f753-4612-bd99-f36b73f6a7b6 response_code = 200 uri = /baseboard
8452024-12-19T21:39:45.871ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8462024-12-19T21:39:45.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50028
8472024-12-19T21:39:45.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23561 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50028 req_id = 7997a1b0-4f43-44da-9a00-ef664b34e8e5 response_code = 200 uri = /timesync
8482024-12-19T21:39:45.899ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 396044326, ip_addr: 23.155.40.38, stratum: 2, ref_time: 1734644385.1285574, correction: 0.003327487 } file = sled-agent/src/rack_setup/service.rs:743
8492024-12-19T21:39:45.899ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8502024-12-19T21:39:45.930ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: f3cae610-b94b-4d69-be23-a035fb38b2c1 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e17d287d-219c-4012-870a-4f408f12ce99 (service), filesystem_pool: Some(ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 126ba733-5d82-491f-9d70-0e3fa3bee131, kind: Service { id: e17d287d-219c-4012-870a-4f408f12ce99 }, name: Name("ntp-e17d287d-219c-4012-870a-4f408f12ce99"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 81])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: a0e8ce89-cfa3-4ec4-8e0c-31730546ce13 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } } } }, OmicronZoneConfig { id: 990b6533-8ff2-4f6a-a1a7-6d0c03b067dc (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 524e0a98-862b-4ade-a66b-081b6a685a97 (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } } } }, OmicronZoneConfig { id: c12f7057-d9a5-41d8-b14d-58873814949a (service), filesystem_pool: Some(ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2fefbb77-d769-40a8-b5b9-ddc9761e8777 (service), filesystem_pool: Some(ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8512024-12-19T21:39:45.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51549
8522024-12-19T21:39:45.930ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8532024-12-19T21:39:45.930ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }
8542024-12-19T21:39:45.965ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8552024-12-19T21:39:45.965ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8562024-12-19T21:39:45.998ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8572024-12-19T21:39:45.998ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8582024-12-19T21:39:46.031ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a0e8ce89-cfa3-4ec4-8e0c-31730546ce13, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8592024-12-19T21:39:46.031ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a0e8ce89-cfa3-4ec4-8e0c-31730546ce13, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Cockroach }, responder: ... }
8602024-12-19T21:39:46.065ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 990b6533-8ff2-4f6a-a1a7-6d0c03b067dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8612024-12-19T21:39:46.066ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 990b6533-8ff2-4f6a-a1a7-6d0c03b067dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8622024-12-19T21:39:46.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 524e0a98-862b-4ade-a66b-081b6a685a97, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8632024-12-19T21:39:46.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 524e0a98-862b-4ade-a66b-081b6a685a97, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Cockroach }, responder: ... }
8642024-12-19T21:39:46.130ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c12f7057-d9a5-41d8-b14d-58873814949a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8652024-12-19T21:39:46.130ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c12f7057-d9a5-41d8-b14d-58873814949a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8662024-12-19T21:39:46.162ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2fefbb77-d769-40a8-b5b9-ddc9761e8777, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8672024-12-19T21:39:46.162ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2fefbb77-d769-40a8-b5b9-ddc9761e8777, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Cockroach }, responder: ... }
8682024-12-19T21:39:46.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8692024-12-19T21:39:46.195ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
8702024-12-19T21:39:46.195ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
8712024-12-19T21:39:46.195ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8722024-12-19T21:39:46.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8732024-12-19T21:39:46.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8742024-12-19T21:39:46.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8752024-12-19T21:39:46.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8762024-12-19T21:39:46.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8772024-12-19T21:39:46.369ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97 file = illumos-utils/src/zone.rs:325
8782024-12-19T21:39:46.373ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 file = illumos-utils/src/zone.rs:325
8792024-12-19T21:39:46.377ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc file = illumos-utils/src/zone.rs:325
8802024-12-19T21:39:46.381ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13 file = illumos-utils/src/zone.rs:325
8812024-12-19T21:39:46.386ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a file = illumos-utils/src/zone.rs:325
8822024-12-19T21:39:46.390ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97 file = illumos-utils/src/zone.rs:363
8832024-12-19T21:39:46.395ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 file = illumos-utils/src/zone.rs:363
8842024-12-19T21:39:46.400ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc file = illumos-utils/src/zone.rs:363
8852024-12-19T21:39:46.404ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13 file = illumos-utils/src/zone.rs:363
8862024-12-19T21:39:46.408ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a file = illumos-utils/src/zone.rs:363
8872024-12-19T21:39:49.319ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='524e0a98-862b-4ade-a66b-081b6a685a97'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8882024-12-19T21:39:49.320ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
8892024-12-19T21:39:49.325ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c12f7057-d9a5-41d8-b14d-58873814949a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8902024-12-19T21:39:49.325ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
8912024-12-19T21:39:49.390ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='990b6533-8ff2-4f6a-a1a7-6d0c03b067dc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8922024-12-19T21:39:49.390ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
8932024-12-19T21:39:49.409ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2fefbb77-d769-40a8-b5b9-ddc9761e8777'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8942024-12-19T21:39:49.409ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a0e8ce89-cfa3-4ec4-8e0c-31730546ce13'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8952024-12-19T21:39:49.409ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
8962024-12-19T21:39:49.414ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
8972024-12-19T21:39:49.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 34.15149ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
8982024-12-19T21:39:49.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 25.030671ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
8992024-12-19T21:39:49.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 129.875116ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9002024-12-19T21:39:49.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 101.923285ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9012024-12-19T21:39:49.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 69.885664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9022024-12-19T21:39:49.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 89.744686ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9032024-12-19T21:39:49.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 214.845661ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9042024-12-19T21:39:50.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 67.098642ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9052024-12-19T21:39:50.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 195.894206ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9062024-12-19T21:39:50.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 54.470792ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9072024-12-19T21:39:50.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 119.734538ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9082024-12-19T21:39:50.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 508.885989ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9092024-12-19T21:39:51.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 59.953702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9102024-12-19T21:39:51.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 510.281714ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9112024-12-19T21:39:51.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 58.532742ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9122024-12-19T21:39:51.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 452.496245ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9132024-12-19T21:39:52.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 655.840611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9142024-12-19T21:39:52.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 171.736478ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9152024-12-19T21:39:52.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 841.01223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9162024-12-19T21:39:52.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 133.512897ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9172024-12-19T21:39:52.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 915.230675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9182024-12-19T21:39:52.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 429.013378ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9192024-12-19T21:39:52.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 396.554798ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9202024-12-19T21:39:52.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 712.201552ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9212024-12-19T21:39:52.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 1.19981197s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9222024-12-19T21:39:52.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 1.020481519s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9232024-12-19T21:39:53.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 996.017019ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9242024-12-19T21:39:53.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 1.284869864s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9252024-12-19T21:39:53.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 1.241127333s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9262024-12-19T21:39:53.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 817.051207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9272024-12-19T21:39:54.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 768.098507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9282024-12-19T21:39:54.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 713.254492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9292024-12-19T21:39:54.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 876.16177ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9302024-12-19T21:39:54.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 613.416717ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9312024-12-19T21:39:54.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 1.464481214s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9322024-12-19T21:39:54.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 1.158230902s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9332024-12-19T21:39:54.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 973.464983ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9342024-12-19T21:39:55.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 1.486817991s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9352024-12-19T21:39:55.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 1.449221892s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9362024-12-19T21:39:55.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 1.079216492s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9372024-12-19T21:39:55.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 813.55135ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9382024-12-19T21:39:56.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 1.462212617s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9392024-12-19T21:39:56.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 985.251819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9402024-12-19T21:39:56.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 1.092615272s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9412024-12-19T21:39:56.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 1.476610686s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9422024-12-19T21:39:56.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 509.819655ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9432024-12-19T21:39:57.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 723.360948ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9442024-12-19T21:39:57.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 945.327937ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9452024-12-19T21:39:57.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 715.798027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9462024-12-19T21:39:57.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 730.418445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9472024-12-19T21:39:58.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 1.437407095s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9482024-12-19T21:39:58.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 746.034147ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9492024-12-19T21:39:58.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 606.084827ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9502024-12-19T21:39:58.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 609.034053ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9512024-12-19T21:39:58.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 1.488395347s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9522024-12-19T21:39:59.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 1.229025459s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9532024-12-19T21:39:59.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 986.72669ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9542024-12-19T21:39:59.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 867.147911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9552024-12-19T21:39:59.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 1.050209402s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9562024-12-19T21:40:00.000ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 331.84735ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
9572024-12-19T21:40:00.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 944.42414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9582024-12-19T21:40:00.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 529.609962ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9592024-12-19T21:40:00.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 872.012062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9602024-12-19T21:40:00.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc") failed: Property not found. retry in 1.446461452s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9612024-12-19T21:40:00.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13") failed: Property not found. retry in 1.248078885s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9622024-12-19T21:40:00.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 730.19123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9632024-12-19T21:40:01.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97") failed: Property not found. retry in 1.01577219s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9642024-12-19T21:40:01.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777") failed: Property not found. retry in 613.57083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9652024-12-19T21:40:01.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a") failed: Property not found. retry in 703.582874ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9662024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_cockroachdb_524e0a98-862b-4ade-a66b-081b6a685a97
9672024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777
9682024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_cockroachdb_990b6533-8ff2-4f6a-a1a7-6d0c03b067dc
9692024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_cockroachdb_a0e8ce89-cfa3-4ec4-8e0c-31730546ce13
9702024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_cockroachdb_c12f7057-d9a5-41d8-b14d-58873814949a
9712024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9722024-12-19T21:40:02.171ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9732024-12-19T21:40:02.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16238378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51549 req_id = a1880a19-2a71-4019-949c-e6b140d7cbe2 response_code = 204 uri = /omicron-zones
9742024-12-19T21:40:02.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59185
9752024-12-19T21:40:02.238ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 32118 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = 26d28b8a-1508-4b82-bdd0-f03837404c27 response_code = 500 uri = /cockroachdb
9762024-12-19T21:40:02.238ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "26d28b8a-1508-4b82-bdd0-f03837404c27", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "26d28b8a-1508-4b82-bdd0-f03837404c27" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 63.289358ms
9772024-12-19T21:40:02.330ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27487 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = 6c84027e-ecbb-4560-9bf7-3edc8c2b3431 response_code = 500 uri = /cockroachdb
9782024-12-19T21:40:02.330ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6c84027e-ecbb-4560-9bf7-3edc8c2b3431", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6c84027e-ecbb-4560-9bf7-3edc8c2b3431" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 63.837334ms
9792024-12-19T21:40:02.423ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = a0faa905-ebcb-41b3-bfe7-328554c666f7 response_code = 500 uri = /cockroachdb
9802024-12-19T21:40:02.423ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a0faa905-ebcb-41b3-bfe7-328554c666f7", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a0faa905-ebcb-41b3-bfe7-328554c666f7" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 215.605681ms
9812024-12-19T21:40:02.669ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = ae1b234f-18c2-48c3-9109-0d79e25dcbf5 response_code = 500 uri = /cockroachdb
9822024-12-19T21:40:02.669ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ae1b234f-18c2-48c3-9109-0d79e25dcbf5", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ae1b234f-18c2-48c3-9109-0d79e25dcbf5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 112.817317ms
9832024-12-19T21:40:02.812ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29838 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = c2e9aa73-ccf7-441c-966f-dbe33d5b8d92 response_code = 500 uri = /cockroachdb
9842024-12-19T21:40:02.812ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c2e9aa73-ccf7-441c-966f-dbe33d5b8d92", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c2e9aa73-ccf7-441c-966f-dbe33d5b8d92" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 145.975821ms
9852024-12-19T21:40:02.989ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29280 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = 7fbd72fc-fce8-4a62-91ac-35eb89ff3000 response_code = 500 uri = /cockroachdb
9862024-12-19T21:40:02.989ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7fbd72fc-fce8-4a62-91ac-35eb89ff3000", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7fbd72fc-fce8-4a62-91ac-35eb89ff3000" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 210.953885ms
9872024-12-19T21:40:03.228ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2fefbb77-d769-40a8-b5b9-ddc9761e8777 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26832 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = 0e6b90e0-9339-48a5-9cd1-b3a979380769 response_code = 500 uri = /cockroachdb
9882024-12-19T21:40:03.228ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0e6b90e0-9339-48a5-9cd1-b3a979380769", "content-length": "124", "date": "Thu, 19 Dec 2024 21:40:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0e6b90e0-9339-48a5-9cd1-b3a979380769" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 364.673671ms
9892024-12-19T21:40:03.629ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3784
9902024-12-19T21:40:28.269ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3802
9912024-12-19T21:40:45.523ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3825
9922024-12-19T21:40:45.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41929510 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59185 req_id = 092506ec-bdca-42ad-a9f7-1f97d73a8600 response_code = 204 uri = /cockroachdb
9932024-12-19T21:40:45.532ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49544
9942024-12-19T21:40:45.551ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.150684501s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
9952024-12-19T21:40:45.589ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: f3cae610-b94b-4d69-be23-a035fb38b2c1 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e17d287d-219c-4012-870a-4f408f12ce99 (service), filesystem_pool: Some(ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 126ba733-5d82-491f-9d70-0e3fa3bee131, kind: Service { id: e17d287d-219c-4012-870a-4f408f12ce99 }, name: Name("ntp-e17d287d-219c-4012-870a-4f408f12ce99"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 81])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: a0e8ce89-cfa3-4ec4-8e0c-31730546ce13 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } } } }, OmicronZoneConfig { id: 990b6533-8ff2-4f6a-a1a7-6d0c03b067dc (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 524e0a98-862b-4ade-a66b-081b6a685a97 (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } } } }, OmicronZoneConfig { id: c12f7057-d9a5-41d8-b14d-58873814949a (service), filesystem_pool: Some(ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2fefbb77-d769-40a8-b5b9-ddc9761e8777 (service), filesystem_pool: Some(ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External } } } }, OmicronZoneConfig { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 0eed2897-0106-4329-b5b8-0577d56d145c (service), filesystem_pool: Some(ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ec016703-4181-4233-a8c9-0a669acf5cce (service), filesystem_pool: Some(ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 410afead-fda9-4475-970e-8ade982017e3 (service), filesystem_pool: Some(ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e56fc450-d682-4bee-9a24-fa82256079ba (service), filesystem_pool: Some(ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 782eaf2d-0669-4a19-859d-26cdf82c6f16 (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } } } }, OmicronZoneConfig { id: 08f5bcb3-8755-406d-b320-fffe9e4c168e (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 2da02991-eb23-4c2d-beb6-885b868782d5 (service), filesystem_pool: Some(ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 2e8c1dc4-5af3-449e-88de-71839e6b4971 (service), filesystem_pool: Some(ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: efef279a-cccf-4ffd-8973-e78831a5f3fd (service), filesystem_pool: Some(ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External } } } }, OmicronZoneConfig { id: f00ec4b2-88a0-4de4-aba3-586ffad5ff4b (service), filesystem_pool: Some(ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External } } } }, OmicronZoneConfig { id: a364d279-97cd-415b-83f1-0e4e37130b9a (service), filesystem_pool: Some(ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External } } } }, OmicronZoneConfig { id: 5c85a77b-566a-4d66-a351-ad40b33b91d5 (service), filesystem_pool: Some(ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6684a46e-7d5f-44d4-b402-4e7fdbf059e9 (service), filesystem_pool: Some(ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf (service), filesystem_pool: Some(ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7ea0025f-4065-440b-8138-e5c4df3ed23a (service), filesystem_pool: Some(ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External } } } }, OmicronZoneConfig { id: 3f250d8b-76a8-46d8-8b11-1e8e2c15bf51 (service), filesystem_pool: Some(ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External } } } }, OmicronZoneConfig { id: 1cae19e6-ddff-4920-8816-61b221308a25 (service), filesystem_pool: Some(ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9962024-12-19T21:40:45.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49501
9972024-12-19T21:40:45.593ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9982024-12-19T21:40:45.593ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f3cae610-b94b-4d69-be23-a035fb38b2c1, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: InternalDns }, responder: ... }
9992024-12-19T21:40:45.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10002024-12-19T21:40:45.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: bdceeb8b-a8f0-42c4-9d12-d51fd343f8ea, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10012024-12-19T21:40:45.748ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10022024-12-19T21:40:45.748ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 60dc5fae-fad2-4cae-9c7e-fdda2aea363a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: InternalDns }, responder: ... }
10032024-12-19T21:40:45.815ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a0e8ce89-cfa3-4ec4-8e0c-31730546ce13, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10042024-12-19T21:40:45.815ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a0e8ce89-cfa3-4ec4-8e0c-31730546ce13, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Cockroach }, responder: ... }
10052024-12-19T21:40:45.875ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 990b6533-8ff2-4f6a-a1a7-6d0c03b067dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10062024-12-19T21:40:45.875ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 990b6533-8ff2-4f6a-a1a7-6d0c03b067dc, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10072024-12-19T21:40:45.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 524e0a98-862b-4ade-a66b-081b6a685a97, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10082024-12-19T21:40:45.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 524e0a98-862b-4ade-a66b-081b6a685a97, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10092024-12-19T21:40:45.991ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c12f7057-d9a5-41d8-b14d-58873814949a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10102024-12-19T21:40:45.991ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c12f7057-d9a5-41d8-b14d-58873814949a, dataset_name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10112024-12-19T21:40:46.063ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2fefbb77-d769-40a8-b5b9-ddc9761e8777, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10122024-12-19T21:40:46.063ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2fefbb77-d769-40a8-b5b9-ddc9761e8777, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Cockroach }, responder: ... }
10132024-12-19T21:40:46.149ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10142024-12-19T21:40:46.149ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10152024-12-19T21:40:46.207ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10162024-12-19T21:40:46.207ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10172024-12-19T21:40:46.341ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 782eaf2d-0669-4a19-859d-26cdf82c6f16, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10182024-12-19T21:40:46.341ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 782eaf2d-0669-4a19-859d-26cdf82c6f16, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10192024-12-19T21:40:46.469ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: efef279a-cccf-4ffd-8973-e78831a5f3fd, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10202024-12-19T21:40:46.469ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: efef279a-cccf-4ffd-8973-e78831a5f3fd, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, kind: Crucible }, responder: ... }
10212024-12-19T21:40:46.515ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f00ec4b2-88a0-4de4-aba3-586ffad5ff4b, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10222024-12-19T21:40:46.515ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f00ec4b2-88a0-4de4-aba3-586ffad5ff4b, dataset_name: DatasetName { pool_name: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10232024-12-19T21:40:46.588ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a364d279-97cd-415b-83f1-0e4e37130b9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10242024-12-19T21:40:46.588ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a364d279-97cd-415b-83f1-0e4e37130b9a, dataset_name: DatasetName { pool_name: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, kind: Crucible }, responder: ... }
10252024-12-19T21:40:46.666ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5c85a77b-566a-4d66-a351-ad40b33b91d5, dataset_name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10262024-12-19T21:40:46.666ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5c85a77b-566a-4d66-a351-ad40b33b91d5, dataset_name: DatasetName { pool_name: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10272024-12-19T21:40:46.730ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6684a46e-7d5f-44d4-b402-4e7fdbf059e9, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10282024-12-19T21:40:46.730ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6684a46e-7d5f-44d4-b402-4e7fdbf059e9, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, kind: Crucible }, responder: ... }
10292024-12-19T21:40:46.802ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf, dataset_name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-12-19T21:40:46.802ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf, dataset_name: DatasetName { pool_name: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10312024-12-19T21:40:46.881ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7ea0025f-4065-440b-8138-e5c4df3ed23a, dataset_name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-12-19T21:40:46.881ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7ea0025f-4065-440b-8138-e5c4df3ed23a, dataset_name: DatasetName { pool_name: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, kind: Crucible }, responder: ... }
10332024-12-19T21:40:46.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3f250d8b-76a8-46d8-8b11-1e8e2c15bf51, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10342024-12-19T21:40:46.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3f250d8b-76a8-46d8-8b11-1e8e2c15bf51, dataset_name: DatasetName { pool_name: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, kind: Crucible }, responder: ... }
10352024-12-19T21:40:47.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1cae19e6-ddff-4920-8816-61b221308a25, dataset_name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-12-19T21:40:47.042ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1cae19e6-ddff-4920-8816-61b221308a25, dataset_name: DatasetName { pool_name: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, kind: Crucible }, responder: ... }
10372024-12-19T21:40:47.098ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10382024-12-19T21:40:47.098ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
10392024-12-19T21:40:47.099ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
10402024-12-19T21:40:47.099ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10412024-12-19T21:40:47.255ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10422024-12-19T21:40:47.256ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10432024-12-19T21:40:47.256ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10442024-12-19T21:40:47.269ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10452024-12-19T21:40:47.271ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10462024-12-19T21:40:47.334ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10472024-12-19T21:40:47.334ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10482024-12-19T21:40:47.337ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10492024-12-19T21:40:47.337ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10502024-12-19T21:40:47.337ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10512024-12-19T21:40:47.530ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10522024-12-19T21:40:47.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10532024-12-19T21:40:47.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10542024-12-19T21:40:47.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10552024-12-19T21:40:47.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10562024-12-19T21:40:47.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10572024-12-19T21:40:47.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10582024-12-19T21:40:47.531ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10592024-12-19T21:40:47.532ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10602024-12-19T21:40:47.532ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5 file = illumos-utils/src/zone.rs:325
10612024-12-19T21:40:47.538ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b file = illumos-utils/src/zone.rs:325
10622024-12-19T21:40:47.544ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd file = illumos-utils/src/zone.rs:325
10632024-12-19T21:40:47.550ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba file = illumos-utils/src/zone.rs:325
10642024-12-19T21:40:47.555ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a file = illumos-utils/src/zone.rs:325
10652024-12-19T21:40:47.560ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9 file = illumos-utils/src/zone.rs:325
10662024-12-19T21:40:47.566ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf file = illumos-utils/src/zone.rs:325
10672024-12-19T21:40:47.709ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5 file = illumos-utils/src/zone.rs:363
10682024-12-19T21:40:47.713ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b file = illumos-utils/src/zone.rs:363
10692024-12-19T21:40:47.756ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10702024-12-19T21:40:47.756ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd file = illumos-utils/src/zone.rs:363
10712024-12-19T21:40:47.762ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba file = illumos-utils/src/zone.rs:363
10722024-12-19T21:40:47.767ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a file = illumos-utils/src/zone.rs:363
10732024-12-19T21:40:47.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9 file = illumos-utils/src/zone.rs:363
10742024-12-19T21:40:47.779ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf file = illumos-utils/src/zone.rs:363
10752024-12-19T21:40:47.787ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a file = illumos-utils/src/zone.rs:325
10762024-12-19T21:40:47.794ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25 file = illumos-utils/src/zone.rs:325
10772024-12-19T21:40:47.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5 file = illumos-utils/src/zone.rs:325
10782024-12-19T21:40:47.808ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51 file = illumos-utils/src/zone.rs:325
10792024-12-19T21:40:47.813ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e file = illumos-utils/src/zone.rs:325
10802024-12-19T21:40:47.819ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16 file = illumos-utils/src/zone.rs:325
10812024-12-19T21:40:47.826ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971 file = illumos-utils/src/zone.rs:325
10822024-12-19T21:40:47.834ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a file = illumos-utils/src/zone.rs:363
10832024-12-19T21:40:47.842ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25 file = illumos-utils/src/zone.rs:363
10842024-12-19T21:40:47.849ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5 file = illumos-utils/src/zone.rs:363
10852024-12-19T21:40:47.855ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51 file = illumos-utils/src/zone.rs:363
10862024-12-19T21:40:47.861ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e file = illumos-utils/src/zone.rs:363
10872024-12-19T21:40:47.868ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16 file = illumos-utils/src/zone.rs:363
10882024-12-19T21:40:47.877ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971 file = illumos-utils/src/zone.rs:363
10892024-12-19T21:40:47.956ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10902024-12-19T21:40:48.056ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10912024-12-19T21:40:48.118ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10922024-12-19T21:40:48.120ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10932024-12-19T21:40:48.120ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10942024-12-19T21:40:48.178ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 227, 114]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10952024-12-19T21:40:48.178ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = external_dns
10962024-12-19T21:40:48.256ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10972024-12-19T21:40:48.259ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10982024-12-19T21:40:48.259ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10992024-12-19T21:40:48.366ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 224, 20]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11002024-12-19T21:40:48.366ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = external_dns
11012024-12-19T21:40:48.368ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11022024-12-19T21:40:48.368ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11032024-12-19T21:40:48.424ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 168, 57]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11042024-12-19T21:40:48.425ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
11052024-12-19T21:40:48.427ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11062024-12-19T21:40:48.427ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11072024-12-19T21:40:48.482ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 157, 67]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11082024-12-19T21:40:48.482ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
11092024-12-19T21:40:48.483ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11102024-12-19T21:40:48.483ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11112024-12-19T21:40:48.484ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11122024-12-19T21:40:48.484ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11132024-12-19T21:40:48.538ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 180, 254]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11142024-12-19T21:40:48.538ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1321 zone_type = nexus
11152024-12-19T21:40:48.539ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11162024-12-19T21:40:48.539ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11172024-12-19T21:40:48.541ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11182024-12-19T21:40:48.541ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11192024-12-19T21:40:48.547ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11202024-12-19T21:40:48.548ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11212024-12-19T21:40:48.548ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11222024-12-19T21:40:48.548ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11232024-12-19T21:40:48.603ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11242024-12-19T21:40:48.607ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11252024-12-19T21:40:48.610ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11262024-12-19T21:40:48.610ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11272024-12-19T21:40:48.610ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11282024-12-19T21:40:48.610ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11292024-12-19T21:40:48.610ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11302024-12-19T21:40:48.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11312024-12-19T21:40:48.709ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11322024-12-19T21:40:48.772ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11332024-12-19T21:40:48.774ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309 file = illumos-utils/src/zone.rs:325
11342024-12-19T21:40:48.785ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e file = illumos-utils/src/zone.rs:325
11352024-12-19T21:40:48.795ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_410afead-fda9-4475-970e-8ade982017e3 file = illumos-utils/src/zone.rs:325
11362024-12-19T21:40:48.849ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c file = illumos-utils/src/zone.rs:325
11372024-12-19T21:40:48.857ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309 file = illumos-utils/src/zone.rs:363
11382024-12-19T21:40:48.868ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e file = illumos-utils/src/zone.rs:363
11392024-12-19T21:40:48.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_410afead-fda9-4475-970e-8ade982017e3 file = illumos-utils/src/zone.rs:363
11402024-12-19T21:40:48.890ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce file = illumos-utils/src/zone.rs:325
11412024-12-19T21:40:48.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c file = illumos-utils/src/zone.rs:363
11422024-12-19T21:40:48.930ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce file = illumos-utils/src/zone.rs:363
11432024-12-19T21:40:53.806ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11442024-12-19T21:40:53.811ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11452024-12-19T21:40:53.811ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
11462024-12-19T21:40:53.821ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
11472024-12-19T21:40:53.955ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bf0d9b80-67dc-4bf8-8d42-f42431e81e59'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11482024-12-19T21:40:53.956ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ecb3b641-1217-432e-886e-545d59bd115f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4fccea55-cd46-491b-a813-faa67f8bce17'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11492024-12-19T21:40:53.956ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ab255c63-820f-494e-88ff-50f51376b6e7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11502024-12-19T21:40:53.956ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
11512024-12-19T21:40:53.964ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='217fd077-3d8a-40e2-ab3d-e595abe54658'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11522024-12-19T21:40:53.964ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2abdcfd8-f66e-41e3-bb39-aa3448ca8f5d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11532024-12-19T21:40:53.964ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
11542024-12-19T21:40:53.971ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
11552024-12-19T21:40:53.979ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5645011c-c670-4c29-977d-a05bbfd29ef2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='49c53343-d3de-468b-81b2-8913065c6849'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11562024-12-19T21:40:53.979ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_595b6dc4-b331-490d-aa08-f0377a395ba7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='321bf6f0-1591-4a7f-9a4d-b5fd71d85fa0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11572024-12-19T21:40:53.981ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11582024-12-19T21:40:53.981ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
11592024-12-19T21:40:53.988ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
11602024-12-19T21:40:53.995ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
11612024-12-19T21:40:54.001ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
11622024-12-19T21:40:54.007ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
11632024-12-19T21:40:54.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 39.437261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
11642024-12-19T21:40:54.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 67.488108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
11652024-12-19T21:40:54.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 39.549014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
11662024-12-19T21:40:54.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 46.618737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
11672024-12-19T21:40:54.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 29.501338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
11682024-12-19T21:40:54.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 25.522486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
11692024-12-19T21:40:54.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 48.490866ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
11702024-12-19T21:40:54.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 117.047947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
11712024-12-19T21:40:54.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 56.06837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
11722024-12-19T21:40:54.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 62.246015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
11732024-12-19T21:40:54.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 144.174106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
11742024-12-19T21:40:54.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 67.456439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
11752024-12-19T21:40:54.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 123.139453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
11762024-12-19T21:40:54.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 68.930736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
11772024-12-19T21:40:54.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 132.403228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
11782024-12-19T21:40:54.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 87.759483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
11792024-12-19T21:40:57.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 141.103753ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
11802024-12-19T21:41:01.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 135.867071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
11812024-12-19T21:41:01.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 74.725571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
11822024-12-19T21:41:01.844ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.976127647s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
11832024-12-19T21:41:01.907ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49195
11842024-12-19T21:41:01.918ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8050 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49195 req_id = 5de505e7-66fb-4a98-ae67-4247f28c9dfe response_code = 200 uri = /baseboard
11852024-12-19T21:41:01.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 210.538354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
11862024-12-19T21:41:01.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 99.034366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
11872024-12-19T21:41:02.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 239.657304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
11882024-12-19T21:41:02.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 128.610836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
11892024-12-19T21:41:02.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 263.938387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
11902024-12-19T21:41:02.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 139.401177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
11912024-12-19T21:41:02.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 161.337752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
11922024-12-19T21:41:02.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 144.079896ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
11932024-12-19T21:41:02.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 551.19305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
11942024-12-19T21:41:02.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 287.144363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
11952024-12-19T21:41:02.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 468.473629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
11962024-12-19T21:41:02.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 192.257257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
11972024-12-19T21:41:02.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 271.491672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
11982024-12-19T21:41:02.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 309.336206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
11992024-12-19T21:41:02.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 346.264372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
12002024-12-19T21:41:02.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 580.386092ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
12012024-12-19T21:41:02.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 338.93348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
12022024-12-19T21:41:02.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 347.980617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
12032024-12-19T21:41:02.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 470.936516ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
12042024-12-19T21:41:02.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 487.496188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
12052024-12-19T21:41:02.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 343.940059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
12062024-12-19T21:41:02.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 694.205968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
12072024-12-19T21:41:02.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 1.129428107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
12082024-12-19T21:41:02.640ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12092024-12-19T21:41:02.643ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12102024-12-19T21:41:02.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 974.863447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
12112024-12-19T21:41:02.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 561.719072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
12122024-12-19T21:41:02.670ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12132024-12-19T21:41:02.679ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12142024-12-19T21:41:02.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 887.407127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
12152024-12-19T21:41:02.716ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12162024-12-19T21:41:02.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 602.990238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
12172024-12-19T21:41:02.732ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
12182024-12-19T21:41:02.857ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b8f2bbb8-537a-40c2-9f16-9be7926866d2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12192024-12-19T21:41:02.950ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12202024-12-19T21:41:02.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 460.401661ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
12212024-12-19T21:41:02.981ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='047529d0-8aea-41f6-991b-4d1ccc515bc9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222024-12-19T21:41:02.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 1.124080003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
12232024-12-19T21:41:03.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 814.73339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
12242024-12-19T21:41:03.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 679.270589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
12252024-12-19T21:41:03.038ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12262024-12-19T21:41:03.047ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12272024-12-19T21:41:03.057ZINFOSledAgent (ServiceManager): Booting oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12282024-12-19T21:41:03.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 849.151705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
12292024-12-19T21:41:03.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 558.690162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
12302024-12-19T21:41:03.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 33.40967ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12312024-12-19T21:41:03.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 47.059825ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
12322024-12-19T21:41:03.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 1.030497069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
12332024-12-19T21:41:03.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 65.391562ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12342024-12-19T21:41:03.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 50.787731ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12352024-12-19T21:41:03.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 108.821764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
12362024-12-19T21:41:03.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.120206893s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
12372024-12-19T21:41:03.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 45.001913ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12382024-12-19T21:41:03.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 184.11059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12392024-12-19T21:41:03.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 106.955188ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12402024-12-19T21:41:03.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 52.812812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12412024-12-19T21:41:03.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 66.080492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12422024-12-19T21:41:03.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 64.744523ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12432024-12-19T21:41:03.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 274.206178ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
12442024-12-19T21:41:03.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 94.323786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12452024-12-19T21:41:03.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 636.592735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
12462024-12-19T21:41:03.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 157.846564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12472024-12-19T21:41:03.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 113.47376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12482024-12-19T21:41:03.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 120.606373ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12492024-12-19T21:41:03.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.266699256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
12502024-12-19T21:41:03.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 367.266202ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12512024-12-19T21:41:03.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 125.290209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12522024-12-19T21:41:03.748ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='e56fc450-d682-4bee-9a24-fa82256079ba'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12532024-12-19T21:41:03.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 1.298915536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
12542024-12-19T21:41:03.768ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
12552024-12-19T21:41:03.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 514.888837ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
12562024-12-19T21:41:03.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 176.326905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12572024-12-19T21:41:03.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 316.625656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12582024-12-19T21:41:03.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 456.218045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12592024-12-19T21:41:03.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 547.657105ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
12602024-12-19T21:41:03.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 215.067046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12612024-12-19T21:41:04.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 1.198761221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
12622024-12-19T21:41:04.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 597.047276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12632024-12-19T21:41:04.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 618.9419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
12642024-12-19T21:41:04.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 502.919088ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12652024-12-19T21:41:04.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 1.245611666s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
12662024-12-19T21:41:04.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 49.858315ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
12672024-12-19T21:41:04.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 867.419743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
12682024-12-19T21:41:04.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 774.799887ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12692024-12-19T21:41:04.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 550.530319ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12702024-12-19T21:41:04.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 141.153733ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
12712024-12-19T21:41:04.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 738.21978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
12722024-12-19T21:41:04.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 562.225181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12732024-12-19T21:41:04.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 913.932285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
12742024-12-19T21:41:05.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 1.49874439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
12752024-12-19T21:41:05.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 718.347727ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
12762024-12-19T21:41:05.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 1.017536013s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
12772024-12-19T21:41:05.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.003623768s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
12782024-12-19T21:41:05.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.202665416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
12792024-12-19T21:41:05.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 172.238052ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
12802024-12-19T21:41:05.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 1.333083469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
12812024-12-19T21:41:05.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.003410272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
12822024-12-19T21:41:05.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 937.542694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
12832024-12-19T21:41:05.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 537.307969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12842024-12-19T21:41:05.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 990.000864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
12852024-12-19T21:41:05.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 411.025939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12862024-12-19T21:41:05.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 1.07882348s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
12872024-12-19T21:41:05.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 797.011941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12882024-12-19T21:41:05.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 706.041306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
12892024-12-19T21:41:05.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 411.837941ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
12902024-12-19T21:41:05.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 570.625471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
12912024-12-19T21:41:05.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 1.314856732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
12922024-12-19T21:41:05.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.245161479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
12932024-12-19T21:41:05.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 885.110043ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
12942024-12-19T21:41:05.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.082840342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
12952024-12-19T21:41:05.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 1.174114748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
12962024-12-19T21:41:05.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 1.334192608s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
12972024-12-19T21:41:06.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 710.936393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
12982024-12-19T21:41:06.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 843.251703ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
12992024-12-19T21:41:06.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 1.442412607s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
13002024-12-19T21:41:06.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 949.93353ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
13012024-12-19T21:41:06.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 535.947303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13022024-12-19T21:41:06.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.071022683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
13032024-12-19T21:41:06.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 1.389776832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
13042024-12-19T21:41:06.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 639.97491ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
13052024-12-19T21:41:06.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 639.892338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
13062024-12-19T21:41:06.353ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_410afead-fda9-4475-970e-8ade982017e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13072024-12-19T21:41:06.354ZINFOSledAgent (ServiceManager): Booting oxz_nexus_410afead-fda9-4475-970e-8ade982017e3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13082024-12-19T21:41:06.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 744.876332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13092024-12-19T21:41:06.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 1.222704069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
13102024-12-19T21:41:06.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 40.767559ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13112024-12-19T21:41:06.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 1.175820677s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
13122024-12-19T21:41:06.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 142.228937ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13132024-12-19T21:41:06.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 746.197246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13142024-12-19T21:41:06.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 930.486413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
13152024-12-19T21:41:06.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 274.298366ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13162024-12-19T21:41:06.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.272248171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
13172024-12-19T21:41:06.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 793.422198ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
13182024-12-19T21:41:06.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 1.23135133s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
13192024-12-19T21:41:07.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.310888098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
13202024-12-19T21:41:07.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.161435337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
13212024-12-19T21:41:07.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 1.436369425s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
13222024-12-19T21:41:07.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 1.162007463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
13232024-12-19T21:41:07.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.429058887s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
13242024-12-19T21:41:07.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 504.460879ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13252024-12-19T21:41:07.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 771.85733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13262024-12-19T21:41:07.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.474830432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
13272024-12-19T21:41:07.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 850.122577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
13282024-12-19T21:41:07.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 1.206111703s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
13292024-12-19T21:41:07.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 1.472981693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13302024-12-19T21:41:07.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 868.353906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
13312024-12-19T21:41:07.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 764.937867ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13322024-12-19T21:41:07.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 1.2582542s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
13332024-12-19T21:41:07.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 1.256515436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
13342024-12-19T21:41:07.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 626.452471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
13352024-12-19T21:41:07.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 542.888282ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
13362024-12-19T21:41:08.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 731.362182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13372024-12-19T21:41:08.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 811.857047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
13382024-12-19T21:41:08.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 1.126289962s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
13392024-12-19T21:41:08.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.363233384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
13402024-12-19T21:41:08.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 1.163858964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
13412024-12-19T21:41:08.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 1.36046726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
13422024-12-19T21:41:08.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.000827512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
13432024-12-19T21:41:08.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 960.617302ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
13442024-12-19T21:41:08.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 835.006604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
13452024-12-19T21:41:08.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 779.846208ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
13462024-12-19T21:41:08.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 895.909161ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13472024-12-19T21:41:08.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.087010152s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
13482024-12-19T21:41:08.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 1.301065275s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
13492024-12-19T21:41:08.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 558.153898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13502024-12-19T21:41:08.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 581.553997ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
13512024-12-19T21:41:08.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 1.250447925s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
13522024-12-19T21:41:09.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.070789662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
13532024-12-19T21:41:09.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 1.35409552s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
13542024-12-19T21:41:09.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 1.386313256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
13552024-12-19T21:41:09.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 525.413657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13562024-12-19T21:41:09.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 1.069173812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
13572024-12-19T21:41:09.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.326256803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
13582024-12-19T21:41:09.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 1.090566096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
13592024-12-19T21:41:09.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 1.185358617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13602024-12-19T21:41:09.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 886.855674ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
13612024-12-19T21:41:09.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.249854263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
13622024-12-19T21:41:09.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 1.373130261s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
13632024-12-19T21:41:09.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 1.425885164s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
13642024-12-19T21:41:09.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 693.488013ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13652024-12-19T21:41:09.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.269017648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
13662024-12-19T21:41:09.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.151603577s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
13672024-12-19T21:41:09.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 1.265700926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
13682024-12-19T21:41:09.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 823.743571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13692024-12-19T21:41:09.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 1.003162686s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
13702024-12-19T21:41:10.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 832.486814ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
13712024-12-19T21:41:10.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 720.116711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
13722024-12-19T21:41:10.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 1.263860729s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13732024-12-19T21:41:10.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 1.259127239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
13742024-12-19T21:41:10.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 976.800345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
13752024-12-19T21:41:10.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 1.001464066s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
13762024-12-19T21:41:10.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 580.893894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
13772024-12-19T21:41:10.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 1.141324534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
13782024-12-19T21:41:10.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 982.276437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13792024-12-19T21:41:10.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 698.943983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13802024-12-19T21:41:10.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.404015847s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
13812024-12-19T21:41:10.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 689.34584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
13822024-12-19T21:41:10.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 755.059236ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
13832024-12-19T21:41:10.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 714.060398ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
13842024-12-19T21:41:10.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.012279083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
13852024-12-19T21:41:10.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 801.481637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
13862024-12-19T21:41:10.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 965.422744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
13872024-12-19T21:41:10.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 734.57035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
13882024-12-19T21:41:10.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 737.534932ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
13892024-12-19T21:41:10.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 504.980547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
13902024-12-19T21:41:11.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 1.079060469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
13912024-12-19T21:41:11.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 1.337127066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
13922024-12-19T21:41:11.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.04337244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
13932024-12-19T21:41:11.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 974.69727ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
13942024-12-19T21:41:11.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 508.884191ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
13952024-12-19T21:41:11.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 1.212843882s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
13962024-12-19T21:41:11.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 1.33194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
13972024-12-19T21:41:11.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 595.765004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
13982024-12-19T21:41:11.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 1.088642735s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
13992024-12-19T21:41:11.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 509.796725ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
14002024-12-19T21:41:11.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 543.626227ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
14012024-12-19T21:41:11.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 729.144743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
14022024-12-19T21:41:11.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 951.358275ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
14032024-12-19T21:41:11.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 1.360302247s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
14042024-12-19T21:41:11.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 733.650178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
14052024-12-19T21:41:11.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.143500376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
14062024-12-19T21:41:11.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 539.167576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
14072024-12-19T21:41:12.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 678.067264ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
14082024-12-19T21:41:12.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 531.048839ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
14092024-12-19T21:41:12.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 870.378042ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
14102024-12-19T21:41:12.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 604.787091ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
14112024-12-19T21:41:12.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 862.202299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
14122024-12-19T21:41:12.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 583.235206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
14132024-12-19T21:41:12.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 1.060604751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
14142024-12-19T21:41:12.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.164261186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
14152024-12-19T21:41:12.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 705.50475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
14162024-12-19T21:41:12.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.174190305s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
14172024-12-19T21:41:12.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 744.769396ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14182024-12-19T21:41:12.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 1.286811439s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
14192024-12-19T21:41:12.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 1.126474256s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
14202024-12-19T21:41:12.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 536.51635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
14212024-12-19T21:41:12.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 979.380801ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
14222024-12-19T21:41:12.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.476172746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
14232024-12-19T21:41:12.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.265740982s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
14242024-12-19T21:41:12.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 734.834372ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
14252024-12-19T21:41:12.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 784.957172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
14262024-12-19T21:41:12.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 1.496751687s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
14272024-12-19T21:41:13.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 1.374765312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
14282024-12-19T21:41:13.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 620.389324ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
14292024-12-19T21:41:13.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 832.109443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
14302024-12-19T21:41:13.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 542.976191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
14312024-12-19T21:41:13.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 1.311229379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
14322024-12-19T21:41:13.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a") failed: Property not found. retry in 1.34128326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
14332024-12-19T21:41:13.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 1.268957791s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14342024-12-19T21:41:13.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 580.466223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
14352024-12-19T21:41:13.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 803.104631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
14362024-12-19T21:41:13.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.19834591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
14372024-12-19T21:41:13.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5") failed: Property not found. retry in 1.321131363s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
14382024-12-19T21:41:13.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 661.960933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
14392024-12-19T21:41:13.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 964.64619ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
14402024-12-19T21:41:13.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 619.996625ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
14412024-12-19T21:41:13.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 819.144446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
14422024-12-19T21:41:13.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 540.510917ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
14432024-12-19T21:41:13.819ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14442024-12-19T21:41:13.819ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14452024-12-19T21:41:13.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 826.332562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
14462024-12-19T21:41:13.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 1.118657172s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
14472024-12-19T21:41:14.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 841.916486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
14482024-12-19T21:41:14.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 785.812549ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
14492024-12-19T21:41:14.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 61.238205ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14502024-12-19T21:41:14.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 135.007628ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14512024-12-19T21:41:14.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 1.0677117s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
14522024-12-19T21:41:14.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971") failed: Property not found. retry in 912.572063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
14532024-12-19T21:41:14.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 130.179401ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14542024-12-19T21:41:14.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 853.198003ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
14552024-12-19T21:41:14.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 720.135077ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
14562024-12-19T21:41:14.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 942.095321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
14572024-12-19T21:41:14.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 504.552908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
14582024-12-19T21:41:14.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5") failed: Property not found. retry in 920.74166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
14592024-12-19T21:41:14.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 504.735292ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14602024-12-19T21:41:14.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a") failed: Property not found. retry in 673.418078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
14612024-12-19T21:41:14.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 1.07070263s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
14622024-12-19T21:41:14.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 555.315521ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14632024-12-19T21:41:14.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 554.759774ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
14642024-12-19T21:41:14.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9") failed: Property not found. retry in 763.368916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
14652024-12-19T21:41:14.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 564.397561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
14662024-12-19T21:41:14.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e") failed: Property not found. retry in 1.42354681s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
14672024-12-19T21:41:14.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b") failed: Property not found. retry in 794.013673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
14682024-12-19T21:41:14.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e") failed: Property not found. retry in 1.073626912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
14692024-12-19T21:41:15.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 1.087895479s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14702024-12-19T21:41:15.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba") failed: Property not found. retry in 892.540164ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
14712024-12-19T21:41:15.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce") failed: Property not found. retry in 661.966504ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
14722024-12-19T21:41:15.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 657.125143ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14732024-12-19T21:41:15.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309") failed: Property not found. retry in 528.496293ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
14742024-12-19T21:41:15.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c") failed: Property not found. retry in 1.475638237s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
14752024-12-19T21:41:15.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25") failed: Property not found. retry in 997.80293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
14762024-12-19T21:41:15.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf") failed: Property not found. retry in 500.904886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
14772024-12-19T21:41:15.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51") failed: Property not found. retry in 1.352463075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
14782024-12-19T21:41:15.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd") failed: Property not found. retry in 868.802176ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
14792024-12-19T21:41:15.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 1.19238598s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14802024-12-19T21:41:16.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 939.071585ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14812024-12-19T21:41:17.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 1.175188377s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14822024-12-19T21:41:17.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 561.204164ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14832024-12-19T21:41:17.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 1.157526078s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14842024-12-19T21:41:18.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 856.550889ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14852024-12-19T21:41:18.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 627.851839ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14862024-12-19T21:41:19.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 678.40907ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14872024-12-19T21:41:19.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 1.443154687s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14882024-12-19T21:41:19.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 1.491329348s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14892024-12-19T21:41:20.189ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.845925669s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
14902024-12-19T21:41:20.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 1.132723976s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14912024-12-19T21:41:21.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_410afead-fda9-4475-970e-8ade982017e3") failed: Property not found. retry in 1.148947323s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
14922024-12-19T21:41:22.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 783.318788ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14932024-12-19T21:41:22.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 929.430595ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14942024-12-19T21:41:23.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 1.406605756s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14952024-12-19T21:41:25.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16") failed: Property not found. retry in 1.038117319s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
14962024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_pantry_2da02991-eb23-4c2d-beb6-885b868782d5
14972024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_f00ec4b2-88a0-4de4-aba3-586ffad5ff4b
14982024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_external_dns_6a5b6b13-8959-4dda-9c7a-e1e911d08309
14992024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_external_dns_33636c8a-3c34-4c6e-8484-5d00c7480c2e
15002024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_nexus_410afead-fda9-4475-970e-8ade982017e3
15012024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_efef279a-cccf-4ffd-8973-e78831a5f3fd
15022024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_oximeter_e56fc450-d682-4bee-9a24-fa82256079ba
15032024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_a364d279-97cd-415b-83f1-0e4e37130b9a
15042024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_6684a46e-7d5f-44d4-b402-4e7fdbf059e9
15052024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_7d9ebdd3-7ab9-4ed3-88fc-76d18b2a3fdf
15062024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_7ea0025f-4065-440b-8138-e5c4df3ed23a
15072024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_1cae19e6-ddff-4920-8816-61b221308a25
15082024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_5c85a77b-566a-4d66-a351-ad40b33b91d5
15092024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_3f250d8b-76a8-46d8-8b11-1e8e2c15bf51
15102024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_pantry_08f5bcb3-8755-406d-b320-fffe9e4c168e
15112024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_clickhouse_782eaf2d-0669-4a19-859d-26cdf82c6f16
15122024-12-19T21:41:26.319ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_crucible_pantry_2e8c1dc4-5af3-449e-88de-71839e6b4971
15132024-12-19T21:41:26.328ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_nexus_ec016703-4181-4233-a8c9-0a669acf5cce
15142024-12-19T21:41:26.328ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3351 zone = oxz_nexus_0eed2897-0106-4329-b5b8-0577d56d145c
15152024-12-19T21:41:26.338ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15162024-12-19T21:41:26.397ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15172024-12-19T21:41:26.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40855708 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49501 req_id = 25b03516-b4d3-4b2f-9143-c5069933aa5f response_code = 204 uri = /omicron-zones
15182024-12-19T21:41:26.505ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
15192024-12-19T21:41:26.565ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15202024-12-19T21:41:26.588ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
15212024-12-19T21:41:26.636ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
15222024-12-19T21:41:26.866ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 9.491204535s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"41b8b8e7-97c8-4858-9951-82ab6281a116\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Thu, 19 Dec 2024 21:41:26 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"41b8b8e7-97c8-4858-9951-82ab6281a116\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
15232024-12-19T21:41:28.189ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "42bca2ed-2d9b-44ba-9238-d3d38faaacd7", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "42bca2ed-2d9b-44ba-9238-d3d38faaacd7" } file = sled-agent/src/rack_setup/service.rs:1078
15242024-12-19T21:41:28.469ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9ad8de34-c548-4548-8d67-ed1b5e1d4d8d", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "9ad8de34-c548-4548-8d67-ed1b5e1d4d8d" } file = sled-agent/src/rack_setup/service.rs:1078
15252024-12-19T21:41:30.228ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "92ee862b-55f2-4ea3-94a2-550245e40961", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "92ee862b-55f2-4ea3-94a2-550245e40961" } file = sled-agent/src/rack_setup/service.rs:1078
15262024-12-19T21:41:30.558ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5d693861-e472-4f9c-bebf-377709342678", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "5d693861-e472-4f9c-bebf-377709342678" } file = sled-agent/src/rack_setup/service.rs:1078
15272024-12-19T21:41:30.891ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "eb62a98b-3683-4a15-91c9-8318ddf9e770", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "eb62a98b-3683-4a15-91c9-8318ddf9e770" } file = sled-agent/src/rack_setup/service.rs:1078
15282024-12-19T21:41:31.081ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "86eb9254-1eb9-4a03-b30e-b8234ce9613c", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "86eb9254-1eb9-4a03-b30e-b8234ce9613c" } file = sled-agent/src/rack_setup/service.rs:1078
15292024-12-19T21:41:31.365ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e00b90ea-c402-44f2-a333-9bfec0d10bbb", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "e00b90ea-c402-44f2-a333-9bfec0d10bbb" } file = sled-agent/src/rack_setup/service.rs:1078
15302024-12-19T21:41:31.770ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ae64e5ac-ae50-4756-a40a-5a904a523b7f", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "ae64e5ac-ae50-4756-a40a-5a904a523b7f" } file = sled-agent/src/rack_setup/service.rs:1078
15312024-12-19T21:41:31.971ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38668
15322024-12-19T21:41:31.974ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38668 req_id = 8b625d86-150b-412b-b043-2cd82fa1afb5 response_code = 200 uri = /baseboard
15332024-12-19T21:41:32.084ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4a3228c0-a665-4b19-9fbd-f226b775df50", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"693b0cf3-c773-407e-bdfd-9ad08967cf46\"", request_id: "4a3228c0-a665-4b19-9fbd-f226b775df50" } file = sled-agent/src/rack_setup/service.rs:1078
15342024-12-19T21:41:34.699ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "877a55e0-18d1-470e-b374-f44049ef4298", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "877a55e0-18d1-470e-b374-f44049ef4298" } file = sled-agent/src/rack_setup/service.rs:1078
15352024-12-19T21:41:36.146ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c8d2b7cb-f383-457a-9950-3ad7ec1e35f9", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "c8d2b7cb-f383-457a-9950-3ad7ec1e35f9" } file = sled-agent/src/rack_setup/service.rs:1078
15362024-12-19T21:41:37.854ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4205234f-d02d-4c85-b24e-d906cfe3a577", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "4205234f-d02d-4c85-b24e-d906cfe3a577" } file = sled-agent/src/rack_setup/service.rs:1078
15372024-12-19T21:41:38.847ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a14b09d7-56b4-410d-8be4-a3ce6cedc90b", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "a14b09d7-56b4-410d-8be4-a3ce6cedc90b" } file = sled-agent/src/rack_setup/service.rs:1078
15382024-12-19T21:41:40.351ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6cf1e035-23cb-4bcd-8d0a-67747b6c4070", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "6cf1e035-23cb-4bcd-8d0a-67747b6c4070" } file = sled-agent/src/rack_setup/service.rs:1078
15392024-12-19T21:41:41.365ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f140f360-7769-49b1-a15a-032aed9656d1", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "f140f360-7769-49b1-a15a-032aed9656d1" } file = sled-agent/src/rack_setup/service.rs:1078
15402024-12-19T21:41:42.669ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d32d229c-c371-4d4c-b831-967dcaf6fb4f", "content-length": "173", "date": "Thu, 19 Dec 2024 21:41:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e282623f-c8b6-42e1-8711-fe2573bc5d47\"", request_id: "d32d229c-c371-4d4c-b831-967dcaf6fb4f" } file = sled-agent/src/rack_setup/service.rs:1078
15412024-12-19T21:41:43.041ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
15422024-12-19T21:41:43.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56629
15432024-12-19T21:41:43.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15442024-12-19T21:41:43.138ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15452024-12-19T21:41:43.138ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
15462024-12-19T21:41:43.139ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
15472024-12-19T21:41:43.152ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15482024-12-19T21:41:43.152ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb
15492024-12-19T21:41:43.177ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15502024-12-19T21:41:43.177ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_595b6dc4-b331-490d-aa08-f0377a395ba7
15512024-12-19T21:41:43.202ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15522024-12-19T21:41:43.202ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e
15532024-12-19T21:41:43.226ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15542024-12-19T21:41:43.226ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5645011c-c670-4c29-977d-a05bbfd29ef2
15552024-12-19T21:41:43.249ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15562024-12-19T21:41:43.254ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de
15572024-12-19T21:41:43.279ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15582024-12-19T21:41:43.279ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3
15592024-12-19T21:41:43.304ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15602024-12-19T21:41:43.304ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ecb3b641-1217-432e-886e-545d59bd115f
15612024-12-19T21:41:43.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15622024-12-19T21:41:43.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f
15632024-12-19T21:41:43.348ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15642024-12-19T21:41:43.348ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de
15652024-12-19T21:41:43.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234036 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56629 req_id = 05ee47af-6783-4107-ae52-3939687b019c response_code = 200 uri = /inventory
15662024-12-19T21:41:45.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45745
15672024-12-19T21:41:45.385ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15682024-12-19T21:41:45.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15692024-12-19T21:41:45.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15702024-12-19T21:41:45.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15712024-12-19T21:41:45.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15722024-12-19T21:41:45.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15732024-12-19T21:41:45.386ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15742024-12-19T21:41:45.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20665 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45745 req_id = 2606de69-1529-460d-9fcc-805e8dbcf57b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15752024-12-19T21:41:45.388ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
15762024-12-19T21:41:45.392ZINFOSledAgent (RSS): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15772024-12-19T21:41:45.392ZINFOSledAgent (RSS): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15782024-12-19T21:41:45.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54732
15792024-12-19T21:41:45.816ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15802024-12-19T21:41:45.816ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15812024-12-19T21:41:45.816ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
15822024-12-19T21:41:45.817ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
15832024-12-19T21:41:45.828ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15842024-12-19T21:41:45.828ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb
15852024-12-19T21:41:45.854ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15862024-12-19T21:41:45.854ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_595b6dc4-b331-490d-aa08-f0377a395ba7
15872024-12-19T21:41:45.877ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15882024-12-19T21:41:45.878ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e
15892024-12-19T21:41:45.902ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15902024-12-19T21:41:45.902ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5645011c-c670-4c29-977d-a05bbfd29ef2
15912024-12-19T21:41:45.923ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15922024-12-19T21:41:45.923ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de
15932024-12-19T21:41:45.942ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15942024-12-19T21:41:45.942ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3
15952024-12-19T21:41:45.964ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15962024-12-19T21:41:45.964ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ecb3b641-1217-432e-886e-545d59bd115f
15972024-12-19T21:41:45.985ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15982024-12-19T21:41:45.985ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f
15992024-12-19T21:41:46.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16002024-12-19T21:41:46.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de
16012024-12-19T21:41:46.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210635 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54732 req_id = e885e555-bffe-475e-ba4a-5921fdd3044f response_code = 200 uri = /inventory
16022024-12-19T21:41:46.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54963
16032024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16042024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16052024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16062024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16072024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16082024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16092024-12-19T21:41:46.206ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16102024-12-19T21:41:46.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54963 req_id = 8e24180f-41f7-401d-a9e2-d66726cb413a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16112024-12-19T21:41:47.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52832
16122024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16132024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16142024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16152024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16162024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16172024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16182024-12-19T21:41:47.015ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16192024-12-19T21:41:47.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52832 req_id = 603807ce-5485-4df2-9ac4-3f9b15df46ca response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16202024-12-19T21:41:47.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63085
16212024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16222024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16232024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16242024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16252024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16262024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16272024-12-19T21:41:47.209ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16282024-12-19T21:41:47.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63085 req_id = d9d88269-f993-4394-9fb8-986b1328475e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16292024-12-19T21:41:52.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56947
16302024-12-19T21:41:52.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56947 req_id = 8f049e86-3f38-45b9-8be8-8292db94dcd1 response_code = 200 uri = /vpc-routes
16312024-12-19T21:41:52.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
16322024-12-19T21:41:52.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56947 req_id = 20069201-3c14-49c8-ac70-201a228f4995 response_code = 204 uri = /eip-gateways
16332024-12-19T21:41:52.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5466 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56947 req_id = d914c830-9758-447d-b1db-83c5bf971815 response_code = 204 uri = /vpc-routes
16342024-12-19T21:42:01.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41299
16352024-12-19T21:42:01.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41299 req_id = e81572ab-847d-4a71-923e-a7f39576ac5e response_code = 200 uri = /vpc-routes
16362024-12-19T21:42:01.458ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
16372024-12-19T21:42:01.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41299 req_id = 58c2ba9c-7cbd-4021-810b-5062ca637a7e response_code = 204 uri = /eip-gateways
16382024-12-19T21:42:01.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34987
16392024-12-19T21:42:01.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1503 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34987 req_id = d273157f-2564-41eb-9369-566e44619cf0 response_code = 200 uri = /v2p
16402024-12-19T21:42:01.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41299 req_id = 39d78097-7e6f-4d9a-8b2d-f3977660466e response_code = 204 uri = /vpc-routes
16412024-12-19T21:42:01.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59421
16422024-12-19T21:42:01.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
16432024-12-19T21:42:01.692ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
16442024-12-19T21:42:01.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59421 req_id = a0881bbd-41e4-4011-87bc-c69df7934219 response_code = 204 uri = /switch-ports
16452024-12-19T21:42:01.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59421 req_id = 66dce118-bab0-489d-92d9-233a45b75dc1 response_code = 200 uri = /network-bootstore-config
16462024-12-19T21:42:01.823ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16472024-12-19T21:42:01.823ZINFOSledAgent (bootstore): Writing ledger to /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16482024-12-19T21:42:01.825ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16492024-12-19T21:42:01.826ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16502024-12-19T21:42:01.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59421 req_id = bd7173b5-8d11-45af-b929-10a4d7d7060d response_code = 204 uri = /network-bootstore-config
16512024-12-19T21:42:02.014ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58541
16522024-12-19T21:42:02.014ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58541 req_id = d6d22d03-91a9-4027-9e02-47ee1c97ada2 response_code = 200 uri = /baseboard
16532024-12-19T21:42:02.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64479
16542024-12-19T21:42:02.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64479 req_id = cce9f3f0-3ddf-44c2-8afe-522ee56100bb response_code = 200 uri = /vpc-routes
16552024-12-19T21:42:02.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
16562024-12-19T21:42:02.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64479 req_id = 16edfef5-8623-4bc7-93fe-2ccb9ba35f76 response_code = 204 uri = /eip-gateways
16572024-12-19T21:42:02.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64479 req_id = 557d7beb-128a-4a80-a6a4-8c9ed3d1cf89 response_code = 204 uri = /vpc-routes
16582024-12-19T21:42:02.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33589
16592024-12-19T21:42:02.888ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
16602024-12-19T21:42:02.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
16612024-12-19T21:42:02.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33589 req_id = bcec3a73-c9fa-4f49-9f97-7d23f09a08ed response_code = 204 uri = /switch-ports
16622024-12-19T21:42:02.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64667
16632024-12-19T21:42:02.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55274
16642024-12-19T21:42:02.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43788
16652024-12-19T21:42:02.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43788 req_id = 833ee61f-06c8-40fd-8a57-2c8f41cc628e response_code = 200 uri = /v2p
16662024-12-19T21:42:02.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55274 req_id = 90d8b57c-fc80-48e4-9ea1-976005d075a2 response_code = 200 uri = /vpc-routes
16672024-12-19T21:42:02.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33589 req_id = b9d84281-a85f-4017-a820-81f2af67f8c1 response_code = 200 uri = /network-bootstore-config
16682024-12-19T21:42:02.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64667 req_id = a3c510b4-f965-46dd-82ab-bcf3afa15165 response_code = 200 uri = /v2p
16692024-12-19T21:42:03.028ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
16702024-12-19T21:42:03.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55274 req_id = 31a536b4-687a-414c-8d5e-6ace063e0c94 response_code = 204 uri = /eip-gateways
16712024-12-19T21:42:03.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55274 req_id = 9a1f3cb3-9039-4164-a3af-a3e35c094c63 response_code = 204 uri = /vpc-routes
16722024-12-19T21:42:03.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46181
16732024-12-19T21:42:03.187ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
16742024-12-19T21:42:03.224ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
16752024-12-19T21:42:03.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46181 req_id = 46ff7837-d3a7-4fd1-8399-5d8c92762240 response_code = 204 uri = /switch-ports
16762024-12-19T21:42:03.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46181 req_id = 1a5c7e7a-d4d5-4c5a-b756-507aea39a5be response_code = 200 uri = /network-bootstore-config
16772024-12-19T21:42:16.134ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:48203 remote_addr = [fd00:1122:3344:101::d]:42001 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
16782024-12-19T21:42:16.164ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28250 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 2c57646e-c625-4d8a-b28d-a733e75d2b88 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
16792024-12-19T21:42:31.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38994
16802024-12-19T21:42:31.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38994 req_id = 21e4b0e4-a60f-44cc-b3a7-fa08f7e051fa response_code = 200 uri = /vpc-routes
16812024-12-19T21:42:31.659ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
16822024-12-19T21:42:31.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38994 req_id = f5b3f774-1d2a-48ac-9e4e-98a729de7500 response_code = 204 uri = /eip-gateways
16832024-12-19T21:42:31.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38994 req_id = 2d49118d-bf8a-4116-b4ab-9527728febaf response_code = 204 uri = /vpc-routes
16842024-12-19T21:42:31.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46999
16852024-12-19T21:42:31.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46999 req_id = 91b01c75-60ac-471a-8b61-151a2630746d response_code = 200 uri = /v2p
16862024-12-19T21:42:31.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56485
16872024-12-19T21:42:31.806ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
16882024-12-19T21:42:31.845ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
16892024-12-19T21:42:31.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95400 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56485 req_id = dd5a103f-d875-4102-98e4-74f820a90f9f response_code = 204 uri = /switch-ports
16902024-12-19T21:42:31.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56485 req_id = c1f72cfb-1374-483a-b1a2-cb31ebbaeb96 response_code = 200 uri = /network-bootstore-config
16912024-12-19T21:42:32.046ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58855
16922024-12-19T21:42:32.046ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58855 req_id = bb895fea-3b74-48e4-a614-8ad6af4e98ec response_code = 200 uri = /baseboard
16932024-12-19T21:42:32.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59287
16942024-12-19T21:42:32.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59287 req_id = 7b479d2b-5290-4343-901c-e2e20aeaac5c response_code = 200 uri = /vpc-routes
16952024-12-19T21:42:32.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48018
16962024-12-19T21:42:32.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48018 req_id = 87acbe21-4017-4a4a-aea8-f78a14e4b824 response_code = 200 uri = /vpc-routes
16972024-12-19T21:42:32.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64251
16982024-12-19T21:42:32.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64251 req_id = f395d588-9e61-4a29-9154-612dcc441130 response_code = 200 uri = /v2p
16992024-12-19T21:42:32.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17002024-12-19T21:42:32.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59287 req_id = 91d07d3c-5a54-4de1-9928-8cf1c87f269c response_code = 204 uri = /eip-gateways
17012024-12-19T21:42:32.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59287 req_id = 34c5bf14-575e-4fd3-a86e-3d9fd7613f74 response_code = 204 uri = /vpc-routes
17022024-12-19T21:42:32.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17032024-12-19T21:42:32.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48018 req_id = 901bcdad-3eee-4ed7-a1c7-8a145d0bd73a response_code = 204 uri = /eip-gateways
17042024-12-19T21:42:32.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48018 req_id = 95f85954-1e15-4bf6-b103-aed0705ae984 response_code = 204 uri = /vpc-routes
17052024-12-19T21:42:33.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35086
17062024-12-19T21:42:33.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35086 req_id = e36454bd-5143-469e-8fc2-2791ad3b5d2d response_code = 200 uri = /v2p
17072024-12-19T21:42:33.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43665
17082024-12-19T21:42:33.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17092024-12-19T21:42:33.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17102024-12-19T21:42:33.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43665 req_id = 7bf6c1df-c5ab-4701-919e-ebb27d0b957c response_code = 204 uri = /switch-ports
17112024-12-19T21:42:33.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43665 req_id = 6c7b537b-2436-4451-853d-379b5f6db0cb response_code = 200 uri = /network-bootstore-config
17122024-12-19T21:42:33.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35857
17132024-12-19T21:42:33.349ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17142024-12-19T21:42:33.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17152024-12-19T21:42:33.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91973 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35857 req_id = 2bc446fb-c745-40f6-bfcb-e2954ec6ed79 response_code = 204 uri = /switch-ports
17162024-12-19T21:42:33.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35857 req_id = 5b892967-4a23-4ed7-bf83-f8a69996a7bb response_code = 200 uri = /network-bootstore-config
17172024-12-19T21:42:46.141ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6954 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 5f5996d9-3caf-4ea2-8250-2ac85ff545b3 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
17182024-12-19T21:43:01.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37882
17192024-12-19T21:43:01.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37882 req_id = c2a25138-6442-43fe-970f-add5912a911c response_code = 200 uri = /vpc-routes
17202024-12-19T21:43:01.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34030
17212024-12-19T21:43:01.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34030 req_id = c526c537-80c8-49dd-a3f0-a0706180447b response_code = 200 uri = /v2p
17222024-12-19T21:43:01.539ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17232024-12-19T21:43:01.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37882 req_id = b5cb4017-6a79-467b-8482-b896f5b65707 response_code = 204 uri = /eip-gateways
17242024-12-19T21:43:01.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37882 req_id = 2c242ea7-1198-4252-8a2e-c64a8a0e1d66 response_code = 204 uri = /vpc-routes
17252024-12-19T21:43:01.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50409
17262024-12-19T21:43:01.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17272024-12-19T21:43:01.631ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17282024-12-19T21:43:01.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93778 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50409 req_id = 3889756e-d319-440e-b2b4-bef072723399 response_code = 204 uri = /switch-ports
17292024-12-19T21:43:01.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50409 req_id = 18f64189-0ff9-4e3c-969d-3e480ba0625e response_code = 200 uri = /network-bootstore-config
17302024-12-19T21:43:02.079ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42854
17312024-12-19T21:43:02.079ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42854 req_id = 47ff23bf-92e2-42e7-9906-69bb1eb64246 response_code = 200 uri = /baseboard
17322024-12-19T21:43:02.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41690
17332024-12-19T21:43:02.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41690 req_id = 3f67791c-a8d0-464f-a324-26d47d50f646 response_code = 200 uri = /v2p
17342024-12-19T21:43:02.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50808
17352024-12-19T21:43:02.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50808 req_id = f27412fa-7390-463c-82bb-4bea63905af3 response_code = 200 uri = /vpc-routes
17362024-12-19T21:43:02.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50688
17372024-12-19T21:43:02.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50688 req_id = f731e8da-9191-43d3-8d1f-c5c2f68115f5 response_code = 200 uri = /vpc-routes
17382024-12-19T21:43:02.931ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17392024-12-19T21:43:02.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50808 req_id = a86fb941-edd6-410d-a3ad-38f3b277951d response_code = 204 uri = /eip-gateways
17402024-12-19T21:43:02.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50808 req_id = 7ead84fa-a4ff-42a0-ae15-3de8a779440d response_code = 204 uri = /vpc-routes
17412024-12-19T21:43:02.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47306
17422024-12-19T21:43:02.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17432024-12-19T21:43:03.024ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17442024-12-19T21:43:03.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47306 req_id = e02b6864-89c1-48fa-8606-65d9ad4025dd response_code = 204 uri = /switch-ports
17452024-12-19T21:43:03.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47507
17462024-12-19T21:43:03.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17472024-12-19T21:43:03.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50688 req_id = 173f223b-b610-467a-8cef-85f23d4f0dab response_code = 204 uri = /eip-gateways
17482024-12-19T21:43:03.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47306 req_id = 8cbb6673-7a14-4d58-a867-7b3c91dbb895 response_code = 200 uri = /network-bootstore-config
17492024-12-19T21:43:03.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47507 req_id = f26fbe0b-c4d2-4c38-95fe-6fa27f2a6007 response_code = 200 uri = /v2p
17502024-12-19T21:43:03.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50688 req_id = 20cf1a64-20fc-4f68-9d61-ac982829fa61 response_code = 204 uri = /vpc-routes
17512024-12-19T21:43:03.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44881
17522024-12-19T21:43:03.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17532024-12-19T21:43:03.176ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17542024-12-19T21:43:03.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44881 req_id = ad525299-cbff-4dc3-b533-4387693e7581 response_code = 204 uri = /switch-ports
17552024-12-19T21:43:03.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44881 req_id = 80316e06-a8a0-46cb-bfe0-b7c0ae3d168c response_code = 200 uri = /network-bootstore-config
17562024-12-19T21:43:16.140ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6299 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 1bc63e39-5dce-40b3-b5f8-3d3989d170ba response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
17572024-12-19T21:43:31.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53031
17582024-12-19T21:43:31.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53031 req_id = 618ba9f9-8a28-4423-a757-0dd57f82c8a0 response_code = 200 uri = /vpc-routes
17592024-12-19T21:43:31.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34344
17602024-12-19T21:43:31.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34344 req_id = 162e9f0b-7da9-46fc-9005-f987c7ae8496 response_code = 200 uri = /v2p
17612024-12-19T21:43:31.656ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17622024-12-19T21:43:31.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53031 req_id = 51daa701-b8b6-4324-b94e-2b97588644b7 response_code = 204 uri = /eip-gateways
17632024-12-19T21:43:31.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53031 req_id = dbc39842-36ef-4fe0-8272-2d100014d85b response_code = 204 uri = /vpc-routes
17642024-12-19T21:43:31.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54718
17652024-12-19T21:43:31.760ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17662024-12-19T21:43:31.801ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17672024-12-19T21:43:31.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54718 req_id = 7aa427bf-5c6b-4977-ab42-b86e52e16938 response_code = 204 uri = /switch-ports
17682024-12-19T21:43:31.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54718 req_id = 4f869e52-4258-4169-87fd-f7dd9e963ccd response_code = 200 uri = /network-bootstore-config
17692024-12-19T21:43:32.112ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49978
17702024-12-19T21:43:32.112ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49978 req_id = 85919ed6-e6b8-4d04-843f-b3bfd3c164be response_code = 200 uri = /baseboard
17712024-12-19T21:43:32.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61404
17722024-12-19T21:43:32.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61404 req_id = d302be81-b9c3-44ae-bc45-0bbf7aefcfb4 response_code = 200 uri = /v2p
17732024-12-19T21:43:32.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64778
17742024-12-19T21:43:32.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64778 req_id = 5367b5f3-38d0-42dc-ab63-bfbd428a97fe response_code = 200 uri = /vpc-routes
17752024-12-19T21:43:32.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17762024-12-19T21:43:32.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64778 req_id = bdc50431-998a-49d1-9199-5f1ab60490d8 response_code = 204 uri = /eip-gateways
17772024-12-19T21:43:32.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64778 req_id = c93be4cf-fb4b-435c-b618-6e9093168804 response_code = 204 uri = /vpc-routes
17782024-12-19T21:43:32.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45806
17792024-12-19T21:43:32.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17802024-12-19T21:43:33.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17812024-12-19T21:43:33.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94740 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45806 req_id = 8ecc6bdc-0918-43a3-abc1-6b0e0ce5dc3c response_code = 204 uri = /switch-ports
17822024-12-19T21:43:33.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54356
17832024-12-19T21:43:33.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45806 req_id = ef7ec25d-1111-42cf-aab0-704185c0cd90 response_code = 200 uri = /network-bootstore-config
17842024-12-19T21:43:33.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54356 req_id = f06170f8-5a64-4167-962b-229589a15e52 response_code = 200 uri = /vpc-routes
17852024-12-19T21:43:33.133ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17862024-12-19T21:43:33.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54356 req_id = 29350dfb-33b3-496e-8847-33a38a88fd37 response_code = 204 uri = /eip-gateways
17872024-12-19T21:43:33.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54910
17882024-12-19T21:43:33.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54910 req_id = 47276bf6-0987-4903-b7eb-1056304b6b26 response_code = 200 uri = /v2p
17892024-12-19T21:43:33.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54356 req_id = 69697353-cb9f-4784-ad97-5be5cac2184d response_code = 204 uri = /vpc-routes
17902024-12-19T21:43:33.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63622
17912024-12-19T21:43:33.326ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
17922024-12-19T21:43:33.363ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
17932024-12-19T21:43:33.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63622 req_id = 858f0f20-890b-4db5-961d-1202664f1ba5 response_code = 204 uri = /switch-ports
17942024-12-19T21:43:33.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63622 req_id = d1117586-6e07-47a1-992e-1e0d3ca0c9bd response_code = 200 uri = /network-bootstore-config
17952024-12-19T21:43:46.142ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7846 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 31d22f46-28ac-491d-84a2-db151608add9 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
17962024-12-19T21:44:01.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35054
17972024-12-19T21:44:01.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35054 req_id = c1ca5659-a102-4a32-b01d-f6f281bb2141 response_code = 200 uri = /vpc-routes
17982024-12-19T21:44:01.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
17992024-12-19T21:44:01.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35054 req_id = f1aaecd6-50a8-4f3f-9112-74b51d121151 response_code = 204 uri = /eip-gateways
18002024-12-19T21:44:01.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35054 req_id = e2b39e80-4359-45bd-9890-67520b94094f response_code = 204 uri = /vpc-routes
18012024-12-19T21:44:01.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64616
18022024-12-19T21:44:01.529ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18032024-12-19T21:44:01.565ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18042024-12-19T21:44:01.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64616 req_id = f2884fb7-60a0-4ebb-8737-441dea5ddf9d response_code = 204 uri = /switch-ports
18052024-12-19T21:44:01.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41498
18062024-12-19T21:44:01.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41498 req_id = 76f6609f-5632-4b07-abf7-66ef79a2062c response_code = 200 uri = /v2p
18072024-12-19T21:44:01.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64616 req_id = 401b3235-f909-4833-968a-c80dd85cad4f response_code = 200 uri = /network-bootstore-config
18082024-12-19T21:44:02.145ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52622
18092024-12-19T21:44:02.145ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52622 req_id = d362a73a-f133-4bd9-a2eb-3551a50c9209 response_code = 200 uri = /baseboard
18102024-12-19T21:44:02.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49896
18112024-12-19T21:44:02.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49896 req_id = a1c9475f-5ad8-45e1-aabf-49a5173514b5 response_code = 200 uri = /vpc-routes
18122024-12-19T21:44:02.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18132024-12-19T21:44:02.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49896 req_id = e0bb98c1-9d7f-4401-892a-3c07f09f971c response_code = 204 uri = /eip-gateways
18142024-12-19T21:44:02.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49896 req_id = a4480ee0-4d67-4af6-865e-9acc90ae3381 response_code = 204 uri = /vpc-routes
18152024-12-19T21:44:02.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49063
18162024-12-19T21:44:02.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49063 req_id = 717e0a52-5619-4674-ab86-eab04efd4913 response_code = 200 uri = /v2p
18172024-12-19T21:44:02.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62702
18182024-12-19T21:44:02.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18192024-12-19T21:44:02.829ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18202024-12-19T21:44:02.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111007 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62702 req_id = 2a111307-10d8-4097-b074-8630e3853bc5 response_code = 204 uri = /switch-ports
18212024-12-19T21:44:02.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62702 req_id = 5b0a9733-7d57-4047-affa-d6839730a2bc response_code = 200 uri = /network-bootstore-config
18222024-12-19T21:44:02.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35439
18232024-12-19T21:44:02.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35439 req_id = 607f510d-dd6c-42f9-a304-5207b78e7196 response_code = 200 uri = /vpc-routes
18242024-12-19T21:44:02.961ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18252024-12-19T21:44:02.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35439 req_id = 0e67478b-8154-4aeb-b66c-0a5f301248d8 response_code = 204 uri = /eip-gateways
18262024-12-19T21:44:02.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44099
18272024-12-19T21:44:02.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44099 req_id = ecdaca67-3da4-4ee7-a0b0-e64e67df9b9f response_code = 200 uri = /v2p
18282024-12-19T21:44:02.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35439 req_id = 7526ba74-c51b-4731-beac-9e0ce9dc69bc response_code = 204 uri = /vpc-routes
18292024-12-19T21:44:03.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34117
18302024-12-19T21:44:03.049ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18312024-12-19T21:44:03.085ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18322024-12-19T21:44:03.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93895 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34117 req_id = 4d9ef94a-7f37-4652-a30b-7c9e046698b3 response_code = 204 uri = /switch-ports
18332024-12-19T21:44:03.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34117 req_id = 448f3158-f724-4e63-9808-d346fa8dd74d response_code = 200 uri = /network-bootstore-config
18342024-12-19T21:44:09.810ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18352024-12-19T21:44:16.141ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6415 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 508acabf-8db8-471c-9cef-081a83a66d29 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
18362024-12-19T21:44:31.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44650
18372024-12-19T21:44:31.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44650 req_id = 482529c8-d065-4586-8b6f-a1e67f3e4a9a response_code = 200 uri = /vpc-routes
18382024-12-19T21:44:31.750ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18392024-12-19T21:44:31.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44650 req_id = 06424b3c-6306-4f23-999f-434380b941e4 response_code = 204 uri = /eip-gateways
18402024-12-19T21:44:31.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44650 req_id = 96439e23-da30-4752-9318-3e1983fbb6e2 response_code = 204 uri = /vpc-routes
18412024-12-19T21:44:31.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34784
18422024-12-19T21:44:31.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18432024-12-19T21:44:31.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18442024-12-19T21:44:31.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34784 req_id = 2ef30030-1afe-46ea-98a3-dd09d918dd5d response_code = 204 uri = /switch-ports
18452024-12-19T21:44:31.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34784 req_id = c8ca7a54-ed52-48c5-812f-093a868c8a5c response_code = 200 uri = /network-bootstore-config
18462024-12-19T21:44:31.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57036
18472024-12-19T21:44:31.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57036 req_id = ee50ab7a-9f3f-45e4-aa5e-8e16a8caf0e0 response_code = 200 uri = /v2p
18482024-12-19T21:44:32.199ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42366
18492024-12-19T21:44:32.199ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42366 req_id = ec2ed82e-78b7-4814-9e2d-dea4fe807053 response_code = 200 uri = /baseboard
18502024-12-19T21:44:32.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37824
18512024-12-19T21:44:32.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37824 req_id = f91b6b8b-3614-4920-9e98-e360bae22a4c response_code = 200 uri = /vpc-routes
18522024-12-19T21:44:32.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18532024-12-19T21:44:32.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37824 req_id = 21e5ca15-e954-4d1e-a14a-3aa328e83946 response_code = 204 uri = /eip-gateways
18542024-12-19T21:44:32.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37824 req_id = ee9ab30f-0ee6-4eb7-9730-5cf7d663272f response_code = 204 uri = /vpc-routes
18552024-12-19T21:44:33.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49295
18562024-12-19T21:44:33.003ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18572024-12-19T21:44:33.041ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18582024-12-19T21:44:33.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49295 req_id = 85e522d3-d59a-4952-960e-d87e344ab2de response_code = 204 uri = /switch-ports
18592024-12-19T21:44:33.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51670
18602024-12-19T21:44:33.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47108
18612024-12-19T21:44:33.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47108 req_id = cc46bdf6-aa3a-4639-9ff8-50229edfbaa0 response_code = 200 uri = /vpc-routes
18622024-12-19T21:44:33.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49295 req_id = 577bbfa1-ebc4-4e5c-93a3-6caf2bca0a3a response_code = 200 uri = /network-bootstore-config
18632024-12-19T21:44:33.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51670 req_id = d40c02ad-59ae-4c55-9577-02a1acdb401b response_code = 200 uri = /v2p
18642024-12-19T21:44:33.156ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18652024-12-19T21:44:33.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47108 req_id = d7c07c69-b80d-41c4-88e6-e528d03be65a response_code = 204 uri = /eip-gateways
18662024-12-19T21:44:33.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47108 req_id = dc6bc710-5880-48d4-bb9e-3b891c302c1b response_code = 204 uri = /vpc-routes
18672024-12-19T21:44:33.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61692
18682024-12-19T21:44:33.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61692 req_id = 9599ff20-3b96-4dfe-8242-4b8d0aec0034 response_code = 200 uri = /v2p
18692024-12-19T21:44:33.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52802
18702024-12-19T21:44:33.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18712024-12-19T21:44:33.341ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18722024-12-19T21:44:33.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52802 req_id = 7575f58a-ae75-4ab4-bb10-5c88ecd96040 response_code = 204 uri = /switch-ports
18732024-12-19T21:44:33.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52802 req_id = d4edd2d4-ab5b-4d8c-a882-b7cd49a6169f response_code = 200 uri = /network-bootstore-config
18742024-12-19T21:44:46.141ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6800 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 7dd5e4a4-bf6d-4eba-8bae-88e5e3a305d9 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
18752024-12-19T21:45:01.464ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62451
18762024-12-19T21:45:01.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62451 req_id = 63eaff27-5a8c-49dc-b2eb-64d188cc0b34 response_code = 200 uri = /vpc-routes
18772024-12-19T21:45:01.519ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18782024-12-19T21:45:01.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62451 req_id = a6280804-53df-4290-8d1e-4c568a1759ba response_code = 204 uri = /eip-gateways
18792024-12-19T21:45:01.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62451 req_id = e29376d5-d6d0-4a16-ad4e-a68e70fcd421 response_code = 204 uri = /vpc-routes
18802024-12-19T21:45:01.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61664
18812024-12-19T21:45:01.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18822024-12-19T21:45:01.606ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18832024-12-19T21:45:01.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61664 req_id = 543f0b4d-0eee-42d1-952d-9076719b310f response_code = 204 uri = /switch-ports
18842024-12-19T21:45:01.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42276
18852024-12-19T21:45:01.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42276 req_id = 25263f0c-85af-44fb-bc6a-1caea6a8aae0 response_code = 200 uri = /v2p
18862024-12-19T21:45:01.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61664 req_id = 7a28549b-6c24-442e-a2b5-178ebf6b0ee0 response_code = 200 uri = /network-bootstore-config
18872024-12-19T21:45:02.232ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37647
18882024-12-19T21:45:02.232ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37647 req_id = 3f3afcb5-b27c-4042-bc7d-1cf3df86d37f response_code = 200 uri = /baseboard
18892024-12-19T21:45:02.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57770
18902024-12-19T21:45:02.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57770 req_id = ab188f25-f6b0-426a-b5e4-94612a2cbb14 response_code = 200 uri = /vpc-routes
18912024-12-19T21:45:02.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
18922024-12-19T21:45:02.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57770 req_id = 91bdb572-1864-4e0b-b7db-3aefc73856a4 response_code = 204 uri = /eip-gateways
18932024-12-19T21:45:02.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57770 req_id = 33d467b3-bb3d-42b7-b0dc-8fdb4ae434f8 response_code = 204 uri = /vpc-routes
18942024-12-19T21:45:02.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64751
18952024-12-19T21:45:02.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
18962024-12-19T21:45:02.993ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
18972024-12-19T21:45:03.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106441 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64751 req_id = ac011e5f-92ec-4cb4-986b-cd1a72a03369 response_code = 204 uri = /switch-ports
18982024-12-19T21:45:03.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34850
18992024-12-19T21:45:03.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34850 req_id = f3f9d5fa-77c2-49f2-82c4-af6242aea0e4 response_code = 200 uri = /vpc-routes
19002024-12-19T21:45:03.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64751 req_id = 13e2d234-bcca-491f-b828-eb8add117c66 response_code = 200 uri = /network-bootstore-config
19012024-12-19T21:45:03.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55628
19022024-12-19T21:45:03.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55628 req_id = 8124f90c-e92f-4176-a032-bbc8d65b1d2f response_code = 200 uri = /v2p
19032024-12-19T21:45:03.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54719
19042024-12-19T21:45:03.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54719 req_id = 2b45731b-adc6-408d-878b-2e7b833d0687 response_code = 200 uri = /v2p
19052024-12-19T21:45:03.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50143
19062024-12-19T21:45:03.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19072024-12-19T21:45:03.228ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19082024-12-19T21:45:03.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89677 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50143 req_id = c0ad8bad-96b3-4717-bbaa-0fcb41b04f34 response_code = 204 uri = /switch-ports
19092024-12-19T21:45:03.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19102024-12-19T21:45:03.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34850 req_id = d6c79585-5010-4748-be07-20404017c167 response_code = 204 uri = /eip-gateways
19112024-12-19T21:45:03.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50143 req_id = 5ee72579-df95-4da0-8247-18559b9e2710 response_code = 200 uri = /network-bootstore-config
19122024-12-19T21:45:03.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34850 req_id = 267ca175-d775-44aa-a425-4a995ee4450f response_code = 204 uri = /vpc-routes
19132024-12-19T21:45:16.142ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7218 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 7a7e401e-c960-4bb0-bada-1f206ef2efc1 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
19142024-12-19T21:45:31.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33242
19152024-12-19T21:45:31.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33242 req_id = 115e5f7f-234c-4c2b-9d5b-bf7e1b09751e response_code = 200 uri = /v2p
19162024-12-19T21:45:31.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51582
19172024-12-19T21:45:31.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51582 req_id = 0d911751-fe2f-417e-a3a5-15790e1a3827 response_code = 200 uri = /vpc-routes
19182024-12-19T21:45:31.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19192024-12-19T21:45:31.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51582 req_id = c07165a5-8742-4022-8d07-27c565010a18 response_code = 204 uri = /eip-gateways
19202024-12-19T21:45:31.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51582 req_id = 05c58be7-2a54-4cee-90ec-470fa03560ec response_code = 204 uri = /vpc-routes
19212024-12-19T21:45:31.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45601
19222024-12-19T21:45:31.740ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19232024-12-19T21:45:31.776ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19242024-12-19T21:45:31.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45601 req_id = 9a4481bf-ea2a-478a-af98-de83d1e0f80a response_code = 204 uri = /switch-ports
19252024-12-19T21:45:31.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45601 req_id = 19c5d977-ad36-4c07-8930-3255a38aad36 response_code = 200 uri = /network-bootstore-config
19262024-12-19T21:45:32.268ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53541
19272024-12-19T21:45:32.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53541 req_id = 71ecacfc-48a1-4ce6-be73-2ebf4de9241c response_code = 200 uri = /baseboard
19282024-12-19T21:45:32.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33151
19292024-12-19T21:45:32.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33151 req_id = 9c24ccdb-61b2-40a2-b04d-31682dc7d406 response_code = 200 uri = /vpc-routes
19302024-12-19T21:45:32.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19312024-12-19T21:45:32.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33151 req_id = dd383ccd-92a0-4331-8c74-186472909e86 response_code = 204 uri = /eip-gateways
19322024-12-19T21:45:32.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33151 req_id = 989333ee-d571-4181-8f07-af088a7a5562 response_code = 204 uri = /vpc-routes
19332024-12-19T21:45:32.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35959
19342024-12-19T21:45:32.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35959 req_id = d2760ae8-31e9-48f2-bc96-d047788f0544 response_code = 200 uri = /v2p
19352024-12-19T21:45:33.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41768
19362024-12-19T21:45:33.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41768 req_id = d5a3ff07-61b2-4e94-9ca9-7ca201c0af50 response_code = 200 uri = /vpc-routes
19372024-12-19T21:45:33.049ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19382024-12-19T21:45:33.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41768 req_id = 9c5bea94-fcaa-4877-8c24-d60a733cd56b response_code = 204 uri = /eip-gateways
19392024-12-19T21:45:33.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41768 req_id = 8f4b96e9-b5ad-4eae-8f92-ef5697b59a77 response_code = 204 uri = /vpc-routes
19402024-12-19T21:45:33.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36107
19412024-12-19T21:45:33.076ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19422024-12-19T21:45:33.108ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19432024-12-19T21:45:33.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78380 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36107 req_id = 817d092f-f820-4f50-bbf9-6ba1cf43fcd9 response_code = 204 uri = /switch-ports
19442024-12-19T21:45:33.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36134
19452024-12-19T21:45:33.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36107 req_id = 0a340526-658c-4733-bdba-0e6c9d36bd41 response_code = 200 uri = /network-bootstore-config
19462024-12-19T21:45:33.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36134 req_id = 6a27da3e-3095-4f92-bab0-4d1ab46ef5ca response_code = 200 uri = /v2p
19472024-12-19T21:45:33.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51683
19482024-12-19T21:45:33.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19492024-12-19T21:45:33.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19502024-12-19T21:45:33.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51683 req_id = f8866add-5a3f-47be-a261-578de71fa521 response_code = 204 uri = /switch-ports
19512024-12-19T21:45:33.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51683 req_id = 4a42989c-da97-4afb-a458-a68c08206464 response_code = 200 uri = /network-bootstore-config
19522024-12-19T21:45:46.142ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6562 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 96cb11d6-56bd-4bdf-afbf-4b7a5598b43d response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
19532024-12-19T21:46:01.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56063
19542024-12-19T21:46:01.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56063 req_id = bf091e09-deb6-448f-8e7f-a2b7368fd0d2 response_code = 200 uri = /vpc-routes
19552024-12-19T21:46:01.477ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19562024-12-19T21:46:01.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56063 req_id = a8858ef1-3aaf-42ee-9fc7-8a11a3229fd8 response_code = 204 uri = /eip-gateways
19572024-12-19T21:46:01.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56063 req_id = 77397b68-c88e-4bfb-b2d6-feb0cec9018f response_code = 204 uri = /vpc-routes
19582024-12-19T21:46:01.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37466
19592024-12-19T21:46:01.535ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19602024-12-19T21:46:01.571ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19612024-12-19T21:46:01.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37466 req_id = a1c2cfbf-e1d7-4f8f-85fc-1aa20d76720d response_code = 204 uri = /switch-ports
19622024-12-19T21:46:01.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57479
19632024-12-19T21:46:01.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57479 req_id = f9da2509-fb26-482f-8591-242f996c837a response_code = 200 uri = /v2p
19642024-12-19T21:46:01.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37466 req_id = db20319c-4424-419f-8097-3a77dc8e444b response_code = 200 uri = /network-bootstore-config
19652024-12-19T21:46:02.302ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38554
19662024-12-19T21:46:02.302ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38554 req_id = 4905a868-23ac-419e-8c5a-6ba00f52fb32 response_code = 200 uri = /baseboard
19672024-12-19T21:46:02.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59887
19682024-12-19T21:46:02.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59887 req_id = 18db3411-ddfd-4d15-88ed-3bb2b1d32e02 response_code = 200 uri = /vpc-routes
19692024-12-19T21:46:02.705ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19702024-12-19T21:46:02.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59887 req_id = 7e051f43-7cf9-4e9f-a0f5-f61d8be8f2ac response_code = 204 uri = /eip-gateways
19712024-12-19T21:46:02.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59887 req_id = f7811fb0-45ef-4bd1-a5c1-46742c98ce1a response_code = 204 uri = /vpc-routes
19722024-12-19T21:46:02.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40420
19732024-12-19T21:46:02.797ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19742024-12-19T21:46:02.846ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19752024-12-19T21:46:02.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40420 req_id = 50da0131-2cad-4e2e-af0f-8502ad53fb30 response_code = 204 uri = /switch-ports
19762024-12-19T21:46:02.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53207
19772024-12-19T21:46:02.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40420 req_id = 65eb1a93-fb23-4517-b24a-1f8f9e844a1f response_code = 200 uri = /network-bootstore-config
19782024-12-19T21:46:02.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53207 req_id = 4241685b-527c-4d2f-abfb-b09db1210c40 response_code = 200 uri = /v2p
19792024-12-19T21:46:02.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39816
19802024-12-19T21:46:02.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39816 req_id = 56f58d07-270e-4123-b2d0-43053d177a41 response_code = 200 uri = /vpc-routes
19812024-12-19T21:46:03.040ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19822024-12-19T21:46:03.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39816 req_id = 96f6c15b-d424-4ddb-a087-bbf05d91a7eb response_code = 204 uri = /eip-gateways
19832024-12-19T21:46:03.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43911
19842024-12-19T21:46:03.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43911 req_id = 41340144-4269-4fdf-a2b5-bc2e144f9d83 response_code = 200 uri = /v2p
19852024-12-19T21:46:03.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39816 req_id = 35fa6272-a9f1-462e-b6c0-f2bdcb125246 response_code = 204 uri = /vpc-routes
19862024-12-19T21:46:03.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56911
19872024-12-19T21:46:03.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
19882024-12-19T21:46:03.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
19892024-12-19T21:46:03.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56911 req_id = e235898c-89a9-4239-ab21-b278aa1d4d87 response_code = 204 uri = /switch-ports
19902024-12-19T21:46:03.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56911 req_id = 6158c8c1-9690-4c37-b81a-b7e7d00bc403 response_code = 200 uri = /network-bootstore-config
19912024-12-19T21:46:16.142ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6302 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = a02a2059-ee52-48a2-a5a3-811adde64739 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
19922024-12-19T21:46:31.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35405
19932024-12-19T21:46:31.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35405 req_id = a1c15539-8380-4ada-b7ff-34d15b79d383 response_code = 200 uri = /vpc-routes
19942024-12-19T21:46:31.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59309
19952024-12-19T21:46:31.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59309 req_id = e591a24c-a1d3-436a-b56d-680183778af4 response_code = 200 uri = /v2p
19962024-12-19T21:46:31.818ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
19972024-12-19T21:46:31.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35405 req_id = 3a93980f-ca4d-4454-9b29-d82c7df09e07 response_code = 204 uri = /eip-gateways
19982024-12-19T21:46:31.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35405 req_id = 5642b4bd-e814-4740-a351-0096c78dd0d6 response_code = 204 uri = /vpc-routes
19992024-12-19T21:46:31.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51919
20002024-12-19T21:46:31.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
20012024-12-19T21:46:31.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
20022024-12-19T21:46:32.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137753 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51919 req_id = 831bee22-7af4-4ec0-9223-5354b0753272 response_code = 204 uri = /switch-ports
20032024-12-19T21:46:32.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51919 req_id = 81266375-a88c-4583-8ba8-4ab16630d0a8 response_code = 200 uri = /network-bootstore-config
20042024-12-19T21:46:32.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46934
20052024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20062024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20072024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20082024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20092024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20102024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20112024-12-19T21:46:32.192ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20122024-12-19T21:46:32.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46934 req_id = 24d273fc-5c61-40b6-a1bc-5a8631330d7f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20132024-12-19T21:46:32.334ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38918
20142024-12-19T21:46:32.334ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38918 req_id = ceb21c7c-3c50-4721-b359-c6d5b24b89ea response_code = 200 uri = /baseboard
20152024-12-19T21:46:32.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41916
20162024-12-19T21:46:32.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41916 req_id = f428647c-8665-4d62-8cd6-65e8e45d0044 response_code = 200 uri = /vpc-routes
20172024-12-19T21:46:32.900ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
20182024-12-19T21:46:32.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41916 req_id = 771d6e46-f8a4-4d4c-825b-dfb42d11d681 response_code = 204 uri = /eip-gateways
20192024-12-19T21:46:32.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41916 req_id = 7fa1e01b-12af-486d-adce-1ed7735a32dc response_code = 204 uri = /vpc-routes
20202024-12-19T21:46:33.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40790
20212024-12-19T21:46:33.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40790 req_id = 5a61d654-7112-4f4a-bbbb-fe3bd7d84050 response_code = 200 uri = /vpc-routes
20222024-12-19T21:46:33.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
20232024-12-19T21:46:33.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40790 req_id = c5b49008-c091-420c-a7a7-dc14d76108d6 response_code = 204 uri = /eip-gateways
20242024-12-19T21:46:33.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 422 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40790 req_id = b174b652-62e0-4653-85c6-d9ae9f802d5f response_code = 204 uri = /vpc-routes
20252024-12-19T21:46:33.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41653
20262024-12-19T21:46:33.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41653 req_id = 593a6847-20fa-4f92-b821-56c92d314d34 response_code = 200 uri = /v2p
20272024-12-19T21:46:33.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45917
20282024-12-19T21:46:33.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
20292024-12-19T21:46:33.217ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
20302024-12-19T21:46:33.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45917 req_id = 1582fca5-604a-4ba7-9815-d74dab583a7e response_code = 204 uri = /switch-ports
20312024-12-19T21:46:33.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62098
20322024-12-19T21:46:33.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45917 req_id = b8a5718b-3fe5-498e-80d7-7d03571882c1 response_code = 200 uri = /network-bootstore-config
20332024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20342024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20352024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20362024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20372024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20382024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20392024-12-19T21:46:33.273ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20402024-12-19T21:46:33.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62098 req_id = c25e9253-0c8a-438f-8cac-52a88d07723e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20412024-12-19T21:46:33.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56221
20422024-12-19T21:46:33.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56221 req_id = 18a515f8-8056-4c9e-baf4-cb9d206544c5 response_code = 200 uri = /v2p
20432024-12-19T21:46:33.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56466
20442024-12-19T21:46:33.377ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
20452024-12-19T21:46:33.417ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
20462024-12-19T21:46:33.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56466 req_id = d19f8bae-c2dc-4989-b78e-357369611eab response_code = 204 uri = /switch-ports
20472024-12-19T21:46:33.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56466 req_id = 00ca9a1d-c350-446b-940b-e4c7a67e64d5 response_code = 200 uri = /network-bootstore-config
20482024-12-19T21:46:33.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48424
20492024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20502024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20512024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20522024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20532024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20542024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20552024-12-19T21:46:33.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20562024-12-19T21:46:33.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 411 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48424 req_id = 157ecc70-f34b-4cc3-860c-566e97e6ff37 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20572024-12-19T21:46:46.142ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5668 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = dfa59b21-3048-421d-a0d3-af47179a2e6b response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
20582024-12-19T21:47:01.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43509
20592024-12-19T21:47:01.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43509 req_id = 80a689c2-c915-4651-860d-b63ee6948009 response_code = 200 uri = /vpc-routes
20602024-12-19T21:47:01.474ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
20612024-12-19T21:47:01.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43509 req_id = 58d903e4-3721-43d6-9484-362252606cd6 response_code = 204 uri = /eip-gateways
20622024-12-19T21:47:01.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43509 req_id = 558db55a-3572-40ed-9a48-c036c97d55fa response_code = 204 uri = /vpc-routes
20632024-12-19T21:47:01.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45219
20642024-12-19T21:47:01.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45219 req_id = 3ddffeb3-097a-4f03-8a6e-6b5d6ba25fe9 response_code = 200 uri = /v2p
20652024-12-19T21:47:01.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47170
20662024-12-19T21:47:01.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
20672024-12-19T21:47:01.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
20682024-12-19T21:47:01.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93511 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47170 req_id = 38396ada-b7a3-4a80-b0a7-711155d0d659 response_code = 204 uri = /switch-ports
20692024-12-19T21:47:01.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47170 req_id = 49b3a816-56b2-483b-9fd2-ef384368249e response_code = 200 uri = /network-bootstore-config
20702024-12-19T21:47:02.367ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41189
20712024-12-19T21:47:02.368ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41189 req_id = a4e521c5-7ea6-48ec-8d11-5c155e54adb8 response_code = 200 uri = /baseboard
20722024-12-19T21:47:02.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48341
20732024-12-19T21:47:02.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48341 req_id = d3a7aaf6-bce2-4902-9a86-99147133fc77 response_code = 200 uri = /v2p
20742024-12-19T21:47:02.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45064
20752024-12-19T21:47:02.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45064 req_id = c053992b-f9fa-4863-bca6-1028cfa5c6d1 response_code = 200 uri = /vpc-routes
20762024-12-19T21:47:02.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
20772024-12-19T21:47:02.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45064 req_id = 6e3ef459-1cca-4c07-97e6-622dffe2aeda response_code = 204 uri = /eip-gateways
20782024-12-19T21:47:02.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45064 req_id = 02b55ac7-44bc-43cf-b3c6-01da5ea24721 response_code = 204 uri = /vpc-routes
20792024-12-19T21:47:02.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60494
20802024-12-19T21:47:02.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
20812024-12-19T21:47:02.914ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
20822024-12-19T21:47:02.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60494 req_id = be7717a1-0d89-49f0-93f6-bc60ffa90abd response_code = 204 uri = /switch-ports
20832024-12-19T21:47:02.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44556
20842024-12-19T21:47:02.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60494 req_id = 77c204b3-58d3-405d-9985-dfa8dbf8d4f0 response_code = 200 uri = /network-bootstore-config
20852024-12-19T21:47:02.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44556 req_id = f20d46f2-a091-428e-95f7-b2ef66057718 response_code = 200 uri = /vpc-routes
20862024-12-19T21:47:03.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
20872024-12-19T21:47:03.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44556 req_id = 4da6efe5-ebea-438d-9b83-0268c3ef0ee8 response_code = 204 uri = /eip-gateways
20882024-12-19T21:47:03.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44556 req_id = 54b81234-29d0-41fd-b8e0-6d703e2138a6 response_code = 204 uri = /vpc-routes
20892024-12-19T21:47:03.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63939
20902024-12-19T21:47:03.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63939 req_id = 3cdde813-7659-435c-9302-7ff78e2ee9ae response_code = 200 uri = /v2p
20912024-12-19T21:47:03.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33499
20922024-12-19T21:47:03.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
20932024-12-19T21:47:03.226ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
20942024-12-19T21:47:03.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33499 req_id = f9258939-2f6f-49b3-9b63-817f8327d457 response_code = 204 uri = /switch-ports
20952024-12-19T21:47:03.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33499 req_id = bed1ad58-bf30-43d1-97b5-7a40b0c2ce55 response_code = 200 uri = /network-bootstore-config
20962024-12-19T21:47:16.143ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6514 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = ec5e77ef-9f07-496e-822b-76d88c08930b response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
20972024-12-19T21:47:31.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62214
20982024-12-19T21:47:31.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62214 req_id = 35166011-fd93-4701-b162-91708ff34178 response_code = 200 uri = /vpc-routes
20992024-12-19T21:47:31.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33234
21002024-12-19T21:47:31.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33234 req_id = 041f1215-fae0-4e0d-97f9-803f345ec613 response_code = 200 uri = /v2p
21012024-12-19T21:47:31.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21022024-12-19T21:47:31.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62214 req_id = d5795d04-6b1d-4ccc-b174-2779c46b7d4f response_code = 204 uri = /eip-gateways
21032024-12-19T21:47:31.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62214 req_id = 5036127f-dd1f-4f20-9b8a-25df955580c4 response_code = 204 uri = /vpc-routes
21042024-12-19T21:47:31.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45677
21052024-12-19T21:47:31.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21062024-12-19T21:47:31.848ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21072024-12-19T21:47:31.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45677 req_id = 9c6389c4-af38-4529-a7dd-4b6c03cb0d87 response_code = 204 uri = /switch-ports
21082024-12-19T21:47:31.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45677 req_id = e9fbd6d6-acab-4899-91a9-baa0c8562281 response_code = 200 uri = /network-bootstore-config
21092024-12-19T21:47:32.402ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45298
21102024-12-19T21:47:32.402ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45298 req_id = 09b85863-f8e2-4ce0-add3-454a201701c2 response_code = 200 uri = /baseboard
21112024-12-19T21:47:32.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64469
21122024-12-19T21:47:32.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64469 req_id = 54a4b6e9-454a-4400-b5fc-cdca9f826b1b response_code = 200 uri = /vpc-routes
21132024-12-19T21:47:32.756ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21142024-12-19T21:47:32.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64469 req_id = 32d60e92-bc69-40ba-9237-64ce9b8e84d4 response_code = 204 uri = /eip-gateways
21152024-12-19T21:47:32.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64469 req_id = c675e16d-d0fd-4610-96df-7c31a1ee3c4d response_code = 204 uri = /vpc-routes
21162024-12-19T21:47:33.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39010
21172024-12-19T21:47:33.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39010 req_id = a5dc9bf6-04ef-432f-8f3f-ee4147e6369a response_code = 200 uri = /v2p
21182024-12-19T21:47:33.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37910
21192024-12-19T21:47:33.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37910 req_id = 402422f5-5896-4483-ab18-84d4d554b92e response_code = 200 uri = /vpc-routes
21202024-12-19T21:47:33.080ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21212024-12-19T21:47:33.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37910 req_id = 495159bf-7f59-4471-a109-d7d33385e508 response_code = 204 uri = /eip-gateways
21222024-12-19T21:47:33.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37910 req_id = b06d2943-5336-4d0d-8921-4308e7069891 response_code = 204 uri = /vpc-routes
21232024-12-19T21:47:33.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58396
21242024-12-19T21:47:33.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58396 req_id = 2fd6d850-7374-4a74-a8fe-f6e4e56061b0 response_code = 200 uri = /v2p
21252024-12-19T21:47:33.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41633
21262024-12-19T21:47:33.222ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21272024-12-19T21:47:33.261ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21282024-12-19T21:47:33.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96759 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41633 req_id = 74683260-479f-4de4-a1e9-55f0c9e340e7 response_code = 204 uri = /switch-ports
21292024-12-19T21:47:33.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41633 req_id = 10d407ef-926f-4db9-bb54-46b0c328318f response_code = 200 uri = /network-bootstore-config
21302024-12-19T21:47:33.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40852
21312024-12-19T21:47:33.392ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21322024-12-19T21:47:33.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21332024-12-19T21:47:33.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40852 req_id = 6b41c0f3-8cec-4aeb-b1cc-6279efdbb991 response_code = 204 uri = /switch-ports
21342024-12-19T21:47:33.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40852 req_id = b364bab7-8a27-4aa8-af6a-6e44af10bdb6 response_code = 200 uri = /network-bootstore-config
21352024-12-19T21:47:46.143ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6693 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 0d4e981f-9fb2-4010-89b4-19cfd78519b3 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
21362024-12-19T21:48:01.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45434
21372024-12-19T21:48:01.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45434 req_id = 3304474d-ed48-42f0-a1be-18ae5c901733 response_code = 200 uri = /vpc-routes
21382024-12-19T21:48:01.443ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21392024-12-19T21:48:01.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45434 req_id = 84fe967d-e347-45aa-8929-0aaf4076b000 response_code = 204 uri = /eip-gateways
21402024-12-19T21:48:01.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45434 req_id = 1b8b5334-c85d-436f-8931-a8a007a72202 response_code = 204 uri = /vpc-routes
21412024-12-19T21:48:01.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45916
21422024-12-19T21:48:01.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21432024-12-19T21:48:01.528ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21442024-12-19T21:48:01.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45916 req_id = 5c411ead-392e-4d6a-bbe7-6fdb9381eaac response_code = 204 uri = /switch-ports
21452024-12-19T21:48:01.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62665
21462024-12-19T21:48:01.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62665 req_id = 254996d5-28a5-4a87-bd28-49a3101e3232 response_code = 200 uri = /v2p
21472024-12-19T21:48:01.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45916 req_id = fe01dea7-52cf-4bd7-a7ef-eb4e5996f1c5 response_code = 200 uri = /network-bootstore-config
21482024-12-19T21:48:02.434ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39938
21492024-12-19T21:48:02.435ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39938 req_id = 679ec79e-8ebe-4fd5-a820-3dd498d14abb response_code = 200 uri = /baseboard
21502024-12-19T21:48:02.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63670
21512024-12-19T21:48:02.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63670 req_id = d83f0d93-119e-4c76-8596-5134bef81d6a response_code = 200 uri = /vpc-routes
21522024-12-19T21:48:02.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21532024-12-19T21:48:02.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63670 req_id = e88eb88f-20e2-4238-9d4d-87726d34a4be response_code = 204 uri = /eip-gateways
21542024-12-19T21:48:02.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63670 req_id = 449422ae-f12c-429d-ba69-8c08883658a7 response_code = 204 uri = /vpc-routes
21552024-12-19T21:48:02.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55583
21562024-12-19T21:48:02.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21572024-12-19T21:48:02.830ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21582024-12-19T21:48:02.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55583 req_id = 708bcf2f-7c35-4071-98c7-acc723e99ba2 response_code = 204 uri = /switch-ports
21592024-12-19T21:48:02.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55326
21602024-12-19T21:48:02.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55583 req_id = 7ad419dd-f0ea-4fe4-a5c8-e76017871d92 response_code = 200 uri = /network-bootstore-config
21612024-12-19T21:48:02.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55326 req_id = e72145a8-2c39-4a8d-b550-21dd8e7cd774 response_code = 200 uri = /v2p
21622024-12-19T21:48:03.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42621
21632024-12-19T21:48:03.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42621 req_id = 0a9bc01a-9a14-4a4c-8799-8f2ea3ab2929 response_code = 200 uri = /vpc-routes
21642024-12-19T21:48:03.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21652024-12-19T21:48:03.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42621 req_id = d06f540a-053a-476f-9841-028b85f7b3a1 response_code = 204 uri = /eip-gateways
21662024-12-19T21:48:03.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42621 req_id = 605577a1-1a0c-4862-9ebd-ddc90d7250fc response_code = 204 uri = /vpc-routes
21672024-12-19T21:48:03.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48398
21682024-12-19T21:48:03.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48398 req_id = b6084baa-4436-4ca9-9e85-03912f70b0c0 response_code = 200 uri = /v2p
21692024-12-19T21:48:03.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42387
21702024-12-19T21:48:03.199ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21712024-12-19T21:48:03.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21722024-12-19T21:48:03.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91105 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42387 req_id = abc02c51-2cea-4969-96e6-9041b9daabc7 response_code = 204 uri = /switch-ports
21732024-12-19T21:48:03.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42387 req_id = b27f1750-5fba-4db3-bb93-0d57f2801397 response_code = 200 uri = /network-bootstore-config
21742024-12-19T21:48:16.144ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6783 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = c271ee64-3351-4083-98d3-6e175da696c4 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
21752024-12-19T21:48:31.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52348
21762024-12-19T21:48:31.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52348 req_id = 5b32f95f-1d99-407d-a3a5-a2e18ed21a56 response_code = 200 uri = /vpc-routes
21772024-12-19T21:48:31.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21782024-12-19T21:48:31.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52348 req_id = 8a029d73-647e-4722-81c9-aaef354d774f response_code = 204 uri = /eip-gateways
21792024-12-19T21:48:31.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52348 req_id = cbcb4c8c-27ef-42de-9b2c-3005c0e37918 response_code = 204 uri = /vpc-routes
21802024-12-19T21:48:31.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60168
21812024-12-19T21:48:31.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60168 req_id = e4bbbf60-70fe-42d6-ada4-6b81d97066d0 response_code = 200 uri = /v2p
21822024-12-19T21:48:31.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45951
21832024-12-19T21:48:31.772ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21842024-12-19T21:48:31.810ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21852024-12-19T21:48:31.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45951 req_id = 135733e6-ae4c-4b1c-b76b-4c32740f658c response_code = 204 uri = /switch-ports
21862024-12-19T21:48:31.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45951 req_id = 710c61bf-3523-4f5b-bb8a-51c2f911513e response_code = 200 uri = /network-bootstore-config
21872024-12-19T21:48:32.467ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62564
21882024-12-19T21:48:32.467ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62564 req_id = 02f034d2-a691-4857-bda5-791149e4e14d response_code = 200 uri = /baseboard
21892024-12-19T21:48:32.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58403
21902024-12-19T21:48:32.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58403 req_id = 70a46dbd-0559-446d-a37a-8232ad3fdf9f response_code = 200 uri = /vpc-routes
21912024-12-19T21:48:32.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
21922024-12-19T21:48:32.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58403 req_id = e1f4f56a-65b9-44ad-8457-095af519239d response_code = 204 uri = /eip-gateways
21932024-12-19T21:48:32.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58403 req_id = 3acfd011-2677-4e2c-ac34-74d6244bc0ad response_code = 204 uri = /vpc-routes
21942024-12-19T21:48:33.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56339
21952024-12-19T21:48:33.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
21962024-12-19T21:48:33.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
21972024-12-19T21:48:33.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56339 req_id = c959f357-a26d-4036-9e20-bd86e27e66d6 response_code = 204 uri = /switch-ports
21982024-12-19T21:48:33.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45086
21992024-12-19T21:48:33.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42907
22002024-12-19T21:48:33.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42907 req_id = 596bdef8-efbe-409d-add1-ebcc64a6c743 response_code = 200 uri = /vpc-routes
22012024-12-19T21:48:33.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45086 req_id = 21d0808c-feea-4c27-bbc8-093a1c34801f response_code = 200 uri = /v2p
22022024-12-19T21:48:33.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56339 req_id = c14d7315-41da-4fb0-a89d-7a7f0cfc728d response_code = 200 uri = /network-bootstore-config
22032024-12-19T21:48:33.118ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22042024-12-19T21:48:33.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42907 req_id = 1b68c659-2fad-4b19-85e0-e6f8973f764c response_code = 204 uri = /eip-gateways
22052024-12-19T21:48:33.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45121
22062024-12-19T21:48:33.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45121 req_id = f1ca3890-c389-4130-ab0c-d851e8c7fa0b response_code = 200 uri = /v2p
22072024-12-19T21:48:33.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42907 req_id = e44ee645-5244-471d-82c1-42343fee2999 response_code = 204 uri = /vpc-routes
22082024-12-19T21:48:33.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49938
22092024-12-19T21:48:33.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22102024-12-19T21:48:33.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22112024-12-19T21:48:33.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92453 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49938 req_id = 29717bbd-fabd-4b75-b9cb-7b68a249dbcc response_code = 204 uri = /switch-ports
22122024-12-19T21:48:33.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49938 req_id = 59ad35c9-060b-4929-aaf2-3a8de09f3dce response_code = 200 uri = /network-bootstore-config
22132024-12-19T21:48:46.145ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6992 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 514cd8ec-bf8d-4d6a-9121-6c3a6f4d1669 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
22142024-12-19T21:48:54.839ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22152024-12-19T21:48:54.839ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22162024-12-19T21:48:54.871ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2248, tv_nsec: 34277359 } time_to_next_cleanup = 599.99999659s
22172024-12-19T21:49:01.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55271
22182024-12-19T21:49:01.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55271 req_id = b39904ba-5745-4d2f-8c97-33930eccd58c response_code = 200 uri = /vpc-routes
22192024-12-19T21:49:01.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22202024-12-19T21:49:01.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55271 req_id = 830b3024-1463-4e4c-ae62-d4de1760ff83 response_code = 204 uri = /eip-gateways
22212024-12-19T21:49:01.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55271 req_id = 7c35410d-84c2-4960-bd76-0164440f26ba response_code = 204 uri = /vpc-routes
22222024-12-19T21:49:01.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43616
22232024-12-19T21:49:01.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43616 req_id = 44d51ad8-05aa-449b-af7a-a84ad6cca1be response_code = 200 uri = /v2p
22242024-12-19T21:49:01.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55515
22252024-12-19T21:49:01.613ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22262024-12-19T21:49:01.651ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22272024-12-19T21:49:01.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97245 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55515 req_id = 867dc4fb-7a0e-4730-b977-f12689112d22 response_code = 204 uri = /switch-ports
22282024-12-19T21:49:01.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55515 req_id = 9db0a5ac-cffe-4efe-b1ea-592c4575bedd response_code = 200 uri = /network-bootstore-config
22292024-12-19T21:49:02.500ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38290
22302024-12-19T21:49:02.500ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38290 req_id = d563494d-5966-4f3d-8c98-7eb5e0f3421b response_code = 200 uri = /baseboard
22312024-12-19T21:49:02.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53667
22322024-12-19T21:49:02.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53667 req_id = 0a9843a8-e1a5-433b-a1c3-72499ea76ed6 response_code = 200 uri = /vpc-routes
22332024-12-19T21:49:02.724ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22342024-12-19T21:49:02.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53667 req_id = bd47c253-bd27-4075-b8d5-1610db17cc00 response_code = 204 uri = /eip-gateways
22352024-12-19T21:49:02.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53667 req_id = f744508d-f1e7-4b5c-b12b-5623fd36e429 response_code = 204 uri = /vpc-routes
22362024-12-19T21:49:02.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41100
22372024-12-19T21:49:02.818ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22382024-12-19T21:49:02.861ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22392024-12-19T21:49:02.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41100 req_id = 01ad10cf-f9be-44b1-a133-6093d318582e response_code = 204 uri = /switch-ports
22402024-12-19T21:49:02.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41734
22412024-12-19T21:49:02.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41734 req_id = 6bb3fa1a-74e9-4e81-9c65-6283c233c86e response_code = 200 uri = /v2p
22422024-12-19T21:49:02.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41100 req_id = 9519c137-a1d9-4879-a5a3-d9ac949312a5 response_code = 200 uri = /network-bootstore-config
22432024-12-19T21:49:02.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46684
22442024-12-19T21:49:02.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46684 req_id = 207a76f0-5d77-4df6-bc26-320a0723e656 response_code = 200 uri = /vpc-routes
22452024-12-19T21:49:02.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22462024-12-19T21:49:02.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46684 req_id = d3c54b76-5303-43a6-90f5-b1563dec9d4d response_code = 204 uri = /eip-gateways
22472024-12-19T21:49:03.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46684 req_id = d647e633-f596-4c78-b9da-d145e90a31b1 response_code = 204 uri = /vpc-routes
22482024-12-19T21:49:03.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44014
22492024-12-19T21:49:03.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44014 req_id = 9b200493-b641-437c-a52b-cf11cd1f51f6 response_code = 200 uri = /v2p
22502024-12-19T21:49:03.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46264
22512024-12-19T21:49:03.073ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22522024-12-19T21:49:03.114ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22532024-12-19T21:49:03.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46264 req_id = 6fdd2d6b-c78d-4b38-b02e-26d90e6ab5ac response_code = 204 uri = /switch-ports
22542024-12-19T21:49:03.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46264 req_id = 35d8bec5-8eb7-430a-b9dd-507741671b81 response_code = 200 uri = /network-bootstore-config
22552024-12-19T21:49:09.815ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22562024-12-19T21:49:16.145ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5993 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 1cdc294c-52e1-471e-81ff-8c3937e299fb response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
22572024-12-19T21:49:31.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53674
22582024-12-19T21:49:31.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53674 req_id = dc6519b4-2ebc-4505-aa1a-3f097fbb914e response_code = 200 uri = /v2p
22592024-12-19T21:49:31.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42944
22602024-12-19T21:49:31.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42944 req_id = eae27599-0b4c-441d-b03d-b23d1d11d15e response_code = 200 uri = /vpc-routes
22612024-12-19T21:49:31.633ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22622024-12-19T21:49:31.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42944 req_id = be0a5360-5282-4ffd-b70e-c98f3881e257 response_code = 204 uri = /eip-gateways
22632024-12-19T21:49:31.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42944 req_id = ad80093b-6517-4969-a582-b96308fe4080 response_code = 204 uri = /vpc-routes
22642024-12-19T21:49:31.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35370
22652024-12-19T21:49:31.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22662024-12-19T21:49:31.783ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22672024-12-19T21:49:31.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88206 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35370 req_id = dbeabc57-6988-4cf4-9b6c-ce8753c4709e response_code = 204 uri = /switch-ports
22682024-12-19T21:49:31.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35370 req_id = c82b5c51-98d5-4dc2-afb1-02769b948461 response_code = 200 uri = /network-bootstore-config
22692024-12-19T21:49:32.549ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51671
22702024-12-19T21:49:32.549ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51671 req_id = b8ebb714-ee7d-443e-976b-5b90c115df20 response_code = 200 uri = /baseboard
22712024-12-19T21:49:32.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50160
22722024-12-19T21:49:32.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50160 req_id = 84a26b96-8ffd-4010-83a5-3407401d64f8 response_code = 200 uri = /vpc-routes
22732024-12-19T21:49:32.834ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22742024-12-19T21:49:32.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50160 req_id = 57e05db1-1462-4a2a-b0a5-7ae14f35770a response_code = 204 uri = /eip-gateways
22752024-12-19T21:49:32.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50160 req_id = 11d43e9a-8c58-403f-9426-086b90eb4548 response_code = 204 uri = /vpc-routes
22762024-12-19T21:49:32.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47013
22772024-12-19T21:49:32.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47013 req_id = 81d6c9ec-d683-4019-a9d3-3a10d11c44c1 response_code = 200 uri = /v2p
22782024-12-19T21:49:33.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36110
22792024-12-19T21:49:33.013ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22802024-12-19T21:49:33.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22812024-12-19T21:49:33.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101980 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36110 req_id = d8115fe4-283e-4915-8c16-70410ac887ac response_code = 204 uri = /switch-ports
22822024-12-19T21:49:33.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36110 req_id = 39caa3df-609d-4fd4-bfaf-0a26e20afb13 response_code = 200 uri = /network-bootstore-config
22832024-12-19T21:49:33.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57467
22842024-12-19T21:49:33.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57467 req_id = 89236807-b91d-4e8a-9ce8-bf4b15fd9c3d response_code = 200 uri = /vpc-routes
22852024-12-19T21:49:33.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63062
22862024-12-19T21:49:33.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63062 req_id = 6cc8e5c9-d4af-4212-9613-4252a1b9d006 response_code = 200 uri = /v2p
22872024-12-19T21:49:33.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22882024-12-19T21:49:33.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57467 req_id = 78b4acb8-732e-49c1-aeb0-562414e9d45d response_code = 204 uri = /eip-gateways
22892024-12-19T21:49:33.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57467 req_id = 6620e03f-3e49-4321-b9f0-aba22b62e014 response_code = 204 uri = /vpc-routes
22902024-12-19T21:49:33.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43865
22912024-12-19T21:49:33.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
22922024-12-19T21:49:33.234ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
22932024-12-19T21:49:33.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43865 req_id = d690d4fe-6f18-4db2-bd49-c4f8bc3acb9a response_code = 204 uri = /switch-ports
22942024-12-19T21:49:33.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43865 req_id = b22d5db7-91a3-43a7-a324-ca71a1ead286 response_code = 200 uri = /network-bootstore-config
22952024-12-19T21:49:46.147ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7255 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = a789c66b-b3e0-406c-9f7f-c4619e7da727 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
22962024-12-19T21:50:01.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38676
22972024-12-19T21:50:01.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38676 req_id = 55c1ec7e-1a1a-480a-bd3c-7019b860f329 response_code = 200 uri = /vpc-routes
22982024-12-19T21:50:01.387ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
22992024-12-19T21:50:01.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38676 req_id = 92fb52cb-5829-440f-9428-d7c8eac08943 response_code = 204 uri = /eip-gateways
23002024-12-19T21:50:01.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35573
23012024-12-19T21:50:01.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35573 req_id = 678eff86-54cd-407c-be8c-37be51d81925 response_code = 200 uri = /v2p
23022024-12-19T21:50:01.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38676 req_id = d2d36a11-a658-45c4-93ab-8247d19bbd4a response_code = 204 uri = /vpc-routes
23032024-12-19T21:50:01.555ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40423
23042024-12-19T21:50:01.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23052024-12-19T21:50:01.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23062024-12-19T21:50:01.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40423 req_id = 796fc89b-c5dc-4ca3-90f1-b4763eaa87a8 response_code = 204 uri = /switch-ports
23072024-12-19T21:50:01.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40423 req_id = 39d44874-b8e1-499b-92cd-22b3cbe07d6d response_code = 200 uri = /network-bootstore-config
23082024-12-19T21:50:02.587ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60923
23092024-12-19T21:50:02.587ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60923 req_id = dcd43c4e-edf0-4de1-907a-ea28ccb39fda response_code = 200 uri = /baseboard
23102024-12-19T21:50:02.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33476
23112024-12-19T21:50:02.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33476 req_id = 5e8b17da-b84c-4eb9-8939-d15e4d45d7eb response_code = 200 uri = /vpc-routes
23122024-12-19T21:50:02.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35953
23132024-12-19T21:50:02.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35953 req_id = f063bea6-cca4-48ee-a322-66e328bb6ddc response_code = 200 uri = /v2p
23142024-12-19T21:50:02.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23152024-12-19T21:50:02.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33476 req_id = 8fbfd081-f04c-4abf-a4a6-f4fdcba345aa response_code = 204 uri = /eip-gateways
23162024-12-19T21:50:02.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33476 req_id = a75c4fa4-3377-4c4d-827d-bccb38609fb4 response_code = 204 uri = /vpc-routes
23172024-12-19T21:50:02.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34449
23182024-12-19T21:50:02.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23192024-12-19T21:50:02.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23202024-12-19T21:50:02.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96930 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34449 req_id = 21c76d79-8d12-44eb-b1f6-490ff15da4c0 response_code = 204 uri = /switch-ports
23212024-12-19T21:50:02.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51457
23222024-12-19T21:50:02.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51457 req_id = 7b6a6b4f-9627-4d78-bae4-476b7e7f1153 response_code = 200 uri = /vpc-routes
23232024-12-19T21:50:02.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34449 req_id = 42ba7a45-8075-402a-85a9-13fc5b023f70 response_code = 200 uri = /network-bootstore-config
23242024-12-19T21:50:03.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58344
23252024-12-19T21:50:03.002ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23262024-12-19T21:50:03.038ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23272024-12-19T21:50:03.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58344 req_id = c7d7f46c-13f5-4492-9c3e-fc70025a25df response_code = 204 uri = /switch-ports
23282024-12-19T21:50:03.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52870
23292024-12-19T21:50:03.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58344 req_id = 66e303a8-785a-4a2b-b97d-44f9c8eb8863 response_code = 200 uri = /network-bootstore-config
23302024-12-19T21:50:03.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23312024-12-19T21:50:03.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51457 req_id = d9b041bb-cb51-4432-9483-486c1716affd response_code = 204 uri = /eip-gateways
23322024-12-19T21:50:03.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52870 req_id = 2562a0b5-5c94-4807-87df-b07189726adb response_code = 200 uri = /v2p
23332024-12-19T21:50:03.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51457 req_id = b179fad2-1044-4fdd-b6e7-7618e554a064 response_code = 204 uri = /vpc-routes
23342024-12-19T21:50:16.146ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6466 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = cd0a9f90-2e6d-4ad1-b2b0-6608470ae20f response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
23352024-12-19T21:50:31.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41430
23362024-12-19T21:50:31.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41430 req_id = 9003eb5a-36d2-4200-b802-ba4c726b6d1b response_code = 200 uri = /vpc-routes
23372024-12-19T21:50:31.630ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23382024-12-19T21:50:31.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41430 req_id = c5fe5d8e-839a-4cd9-9e71-b95e057f72e1 response_code = 204 uri = /eip-gateways
23392024-12-19T21:50:31.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41430 req_id = 3fcc96e5-ae6b-46ee-b3ff-10f8fb3c267f response_code = 204 uri = /vpc-routes
23402024-12-19T21:50:31.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43100
23412024-12-19T21:50:31.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23422024-12-19T21:50:31.740ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23432024-12-19T21:50:31.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94527 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43100 req_id = bd25255e-3467-41c5-a61f-4e4fdc3b0410 response_code = 204 uri = /switch-ports
23442024-12-19T21:50:31.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54671
23452024-12-19T21:50:31.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54671 req_id = 0aeeb1f2-c539-4627-828a-81999b3c3534 response_code = 200 uri = /v2p
23462024-12-19T21:50:31.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43100 req_id = c2d2c57a-afef-47c2-ad29-2a701bb1d916 response_code = 200 uri = /network-bootstore-config
23472024-12-19T21:50:32.621ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52300
23482024-12-19T21:50:32.621ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52300 req_id = 4d0861f7-2c12-43b0-b5c2-d7b759e965a1 response_code = 200 uri = /baseboard
23492024-12-19T21:50:32.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60484
23502024-12-19T21:50:32.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60484 req_id = f574691d-5c8e-4a0b-a511-f435cc1c86d7 response_code = 200 uri = /vpc-routes
23512024-12-19T21:50:32.880ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23522024-12-19T21:50:32.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60484 req_id = 3dc3e9e5-2af9-42d8-a60b-967e746551a7 response_code = 204 uri = /eip-gateways
23532024-12-19T21:50:32.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60484 req_id = 461b8d3b-06ec-4722-b4cc-e1cf5a1c8c58 response_code = 204 uri = /vpc-routes
23542024-12-19T21:50:33.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33061
23552024-12-19T21:50:33.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33061 req_id = d76c779a-8b9a-4782-b619-ce05a56f4748 response_code = 200 uri = /vpc-routes
23562024-12-19T21:50:33.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63349
23572024-12-19T21:50:33.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63349 req_id = 2636de4d-c467-475b-ad77-3647178fe3ec response_code = 200 uri = /v2p
23582024-12-19T21:50:33.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53670
23592024-12-19T21:50:33.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53670 req_id = 82e37a1b-bb8c-4119-8d70-8551a1540f0c response_code = 200 uri = /v2p
23602024-12-19T21:50:33.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23612024-12-19T21:50:33.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33061 req_id = 3292edd6-9ebd-45f4-b90b-80ac080554b1 response_code = 204 uri = /eip-gateways
23622024-12-19T21:50:33.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33061 req_id = 1bfb7379-e02c-4c77-91d1-dccd1fb00f5b response_code = 204 uri = /vpc-routes
23632024-12-19T21:50:33.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35413
23642024-12-19T21:50:33.136ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23652024-12-19T21:50:33.176ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23662024-12-19T21:50:33.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35413 req_id = 1ca77272-b38f-4395-9a8f-1075812cc7b2 response_code = 204 uri = /switch-ports
23672024-12-19T21:50:33.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50770
23682024-12-19T21:50:33.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23692024-12-19T21:50:33.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35413 req_id = b487dac3-223e-49ed-bfd0-50d2d4a35463 response_code = 200 uri = /network-bootstore-config
23702024-12-19T21:50:33.270ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23712024-12-19T21:50:33.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91754 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50770 req_id = fdb3074e-cd13-4fe8-93a2-9cd2834a1988 response_code = 204 uri = /switch-ports
23722024-12-19T21:50:33.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50770 req_id = b0358198-9340-41c1-9cbc-334da6282fee response_code = 200 uri = /network-bootstore-config
23732024-12-19T21:50:46.146ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6207 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 3c0d62ca-4550-4389-a35c-983d93d0cb12 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
23742024-12-19T21:51:01.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57674
23752024-12-19T21:51:01.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57674 req_id = 6441d263-19dc-4fa1-8823-d7083f276aa4 response_code = 200 uri = /vpc-routes
23762024-12-19T21:51:01.532ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23772024-12-19T21:51:01.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57674 req_id = 32175b5f-f1f3-405a-b728-742b7bb28f51 response_code = 204 uri = /eip-gateways
23782024-12-19T21:51:01.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57674 req_id = 5040302a-5137-4246-9b72-cd18cab4fbb8 response_code = 204 uri = /vpc-routes
23792024-12-19T21:51:01.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64895
23802024-12-19T21:51:01.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64895 req_id = 67d6f73b-8295-495a-a3a6-aeb7a2bacf46 response_code = 200 uri = /v2p
23812024-12-19T21:51:01.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55721
23822024-12-19T21:51:01.589ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23832024-12-19T21:51:01.632ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23842024-12-19T21:51:01.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55721 req_id = dacdaf57-b2fe-4d8e-ae35-e91d65b9ba77 response_code = 204 uri = /switch-ports
23852024-12-19T21:51:01.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55721 req_id = d6079bd0-cb40-44c6-963b-aa9f08871df7 response_code = 200 uri = /network-bootstore-config
23862024-12-19T21:51:02.654ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36556
23872024-12-19T21:51:02.654ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36556 req_id = 7ed05b8b-334e-40bc-bbc8-63d9ddd39277 response_code = 200 uri = /baseboard
23882024-12-19T21:51:02.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48472
23892024-12-19T21:51:02.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48472 req_id = 90be077b-b5d0-4476-983a-50e6c48dbc72 response_code = 200 uri = /vpc-routes
23902024-12-19T21:51:02.744ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
23912024-12-19T21:51:02.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48472 req_id = 6d76e8da-faa9-44cd-a7c3-c50865a46946 response_code = 204 uri = /eip-gateways
23922024-12-19T21:51:02.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48472 req_id = 40ba5dad-2d97-421e-a8e9-db956234997f response_code = 204 uri = /vpc-routes
23932024-12-19T21:51:02.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58149
23942024-12-19T21:51:02.800ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
23952024-12-19T21:51:02.844ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
23962024-12-19T21:51:02.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58149 req_id = 2607ee7e-1060-430f-92c0-1754a54a88ac response_code = 204 uri = /switch-ports
23972024-12-19T21:51:02.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64809
23982024-12-19T21:51:02.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58149 req_id = 16073d04-8663-480a-964f-db01e5028dda response_code = 200 uri = /network-bootstore-config
23992024-12-19T21:51:02.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64809 req_id = 07619870-f181-45c3-8850-00cbb4bf0be3 response_code = 200 uri = /v2p
24002024-12-19T21:51:03.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56915
24012024-12-19T21:51:03.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56915 req_id = 59019f07-be7c-4d3d-bffe-f539553f1b12 response_code = 200 uri = /v2p
24022024-12-19T21:51:03.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64225
24032024-12-19T21:51:03.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64225 req_id = 5f834529-f0d0-452c-820f-567af3887ec6 response_code = 200 uri = /vpc-routes
24042024-12-19T21:51:03.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
24052024-12-19T21:51:03.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64225 req_id = 0bc49d4f-dbd8-4694-9648-463c20b642ff response_code = 204 uri = /eip-gateways
24062024-12-19T21:51:03.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64225 req_id = 0a6a2bd7-303b-43d1-aa3e-4855827878e7 response_code = 204 uri = /vpc-routes
24072024-12-19T21:51:03.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41666
24082024-12-19T21:51:03.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
24092024-12-19T21:51:03.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
24102024-12-19T21:51:03.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94268 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41666 req_id = ff371589-a044-462f-86fc-2efd721200b3 response_code = 204 uri = /switch-ports
24112024-12-19T21:51:03.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41666 req_id = 8e459b22-7ac5-43c4-8529-ba929dca99aa response_code = 200 uri = /network-bootstore-config
24122024-12-19T21:51:16.146ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5817 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 4d88bfa0-5ffd-4156-8ce3-026875317ac4 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
24132024-12-19T21:51:31.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42931
24142024-12-19T21:51:31.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42931 req_id = 878006b0-79ea-4abf-a0af-4ad91d6e3b45 response_code = 200 uri = /vpc-routes
24152024-12-19T21:51:31.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36837
24162024-12-19T21:51:31.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36837 req_id = ffacaa65-77f9-485a-b4f7-1aaccff9d582 response_code = 200 uri = /v2p
24172024-12-19T21:51:31.732ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
24182024-12-19T21:51:31.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42931 req_id = ea501dd2-d628-45fc-a72e-479665d5cee0 response_code = 204 uri = /eip-gateways
24192024-12-19T21:51:31.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34643
24202024-12-19T21:51:31.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24212024-12-19T21:51:31.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24222024-12-19T21:51:31.825ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
24232024-12-19T21:51:31.826ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
24242024-12-19T21:51:31.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42931 req_id = c07b2a0d-ee60-4c44-9e00-791c44767888 response_code = 204 uri = /vpc-routes
24252024-12-19T21:51:31.838ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24262024-12-19T21:51:31.838ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb
24272024-12-19T21:51:31.864ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24282024-12-19T21:51:31.864ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_595b6dc4-b331-490d-aa08-f0377a395ba7
24292024-12-19T21:51:31.887ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24302024-12-19T21:51:31.887ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e
24312024-12-19T21:51:31.909ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24322024-12-19T21:51:31.909ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5645011c-c670-4c29-977d-a05bbfd29ef2
24332024-12-19T21:51:31.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43310
24342024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24352024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24362024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24372024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24382024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24392024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24402024-12-19T21:51:31.919ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24412024-12-19T21:51:31.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43310 req_id = 3598b4eb-9c5e-45a4-aae9-6fd1ebdfef44 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24422024-12-19T21:51:31.931ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24432024-12-19T21:51:31.931ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de
24442024-12-19T21:51:31.954ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24452024-12-19T21:51:31.954ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3
24462024-12-19T21:51:31.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37108
24472024-12-19T21:51:31.974ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
24482024-12-19T21:51:31.978ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24492024-12-19T21:51:31.978ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ecb3b641-1217-432e-886e-545d59bd115f
24502024-12-19T21:51:32.004ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24512024-12-19T21:51:32.004ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f
24522024-12-19T21:51:32.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
24532024-12-19T21:51:32.028ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24542024-12-19T21:51:32.028ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de
24552024-12-19T21:51:32.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34643 req_id = e8ba79be-8617-4725-a5a2-a7fbb73d1bce response_code = 200 uri = /inventory
24562024-12-19T21:51:32.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37108 req_id = dda7690f-d053-48d3-b8e5-af1404b8c88b response_code = 204 uri = /switch-ports
24572024-12-19T21:51:32.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37108 req_id = 667c7e03-d754-45b3-8928-4b310bc10359 response_code = 200 uri = /network-bootstore-config
24582024-12-19T21:51:32.690ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59937
24592024-12-19T21:51:32.690ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59937 req_id = 3bda2eeb-687e-4ba6-8a5a-67118f3c605c response_code = 200 uri = /baseboard
24602024-12-19T21:51:32.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41146
24612024-12-19T21:51:32.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 2ad7b93a-873a-4913-9d44-3ce3fa8a84c1 response_code = 200 uri = /vpc-routes
24622024-12-19T21:51:32.887ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
24632024-12-19T21:51:32.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41146 req_id = af1d730a-d465-4ec6-b314-c841aef4a945 response_code = 204 uri = /eip-gateways
24642024-12-19T21:51:33.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35351
24652024-12-19T21:51:33.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35351 req_id = 1061a67d-4c9f-4808-8fb9-3ec9b2cb8841 response_code = 200 uri = /v2p
24662024-12-19T21:51:33.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41146 req_id = 79dd1b40-7164-4f6d-b876-ddada7857cfe response_code = 204 uri = /vpc-routes
24672024-12-19T21:51:33.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34472
24682024-12-19T21:51:33.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24692024-12-19T21:51:33.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24702024-12-19T21:51:33.133ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
24712024-12-19T21:51:33.133ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
24722024-12-19T21:51:33.145ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24732024-12-19T21:51:33.145ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb
24742024-12-19T21:51:33.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64168
24752024-12-19T21:51:33.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
24762024-12-19T21:51:33.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24772024-12-19T21:51:33.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_595b6dc4-b331-490d-aa08-f0377a395ba7
24782024-12-19T21:51:33.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
24792024-12-19T21:51:33.195ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24802024-12-19T21:51:33.195ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e
24812024-12-19T21:51:33.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24822024-12-19T21:51:33.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5645011c-c670-4c29-977d-a05bbfd29ef2
24832024-12-19T21:51:33.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34965
24842024-12-19T21:51:33.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34965 req_id = 2da73333-ecb0-4fb1-9448-1c2b940904f4 response_code = 200 uri = /vpc-routes
24852024-12-19T21:51:33.244ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24862024-12-19T21:51:33.244ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de
24872024-12-19T21:51:33.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103378 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64168 req_id = 414b5bb1-db4a-422b-bdf7-170a3d51d1d8 response_code = 204 uri = /switch-ports
24882024-12-19T21:51:33.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64168 req_id = 0104d6f2-f24d-4bb0-91e5-71a3e1dfd28a response_code = 200 uri = /network-bootstore-config
24892024-12-19T21:51:33.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39300
24902024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24912024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24922024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24932024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24942024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24952024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24962024-12-19T21:51:33.256ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24972024-12-19T21:51:33.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39300 req_id = 748f2df2-1711-4507-92cb-8ce431a7aa41 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24982024-12-19T21:51:33.272ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24992024-12-19T21:51:33.272ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3
25002024-12-19T21:51:33.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
25012024-12-19T21:51:33.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34965 req_id = ac410645-75a3-4324-9ab4-04964b69bd38 response_code = 204 uri = /eip-gateways
25022024-12-19T21:51:33.298ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25032024-12-19T21:51:33.298ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ecb3b641-1217-432e-886e-545d59bd115f
25042024-12-19T21:51:33.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1013 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34965 req_id = 8f29ac15-1255-4db3-8cc8-604e53ba0eb2 response_code = 204 uri = /vpc-routes
25052024-12-19T21:51:33.328ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25062024-12-19T21:51:33.328ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f
25072024-12-19T21:51:33.354ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25082024-12-19T21:51:33.354ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de
25092024-12-19T21:51:33.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234563 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34472 req_id = b47f9129-fbe1-4ac4-940a-f695ef551810 response_code = 200 uri = /inventory
25102024-12-19T21:51:33.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51881
25112024-12-19T21:51:33.450ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25122024-12-19T21:51:33.451ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25132024-12-19T21:51:33.451ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/config/omicron-zones.json file = common/src/ledger.rs:177
25142024-12-19T21:51:33.451ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/config/omicron-zones.json file = common/src/ledger.rs:177
25152024-12-19T21:51:33.463ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ee5ee8-be28-48eb-9f52-740c68ec2afb (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25162024-12-19T21:51:33.463ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_50ee5ee8-be28-48eb-9f52-740c68ec2afb
25172024-12-19T21:51:33.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48929
25182024-12-19T21:51:33.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48929 req_id = 9e69eafb-f6c6-45c4-ab37-e0fc5edb4a43 response_code = 200 uri = /v2p
25192024-12-19T21:51:33.490ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 595b6dc4-b331-490d-aa08-f0377a395ba7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25202024-12-19T21:51:33.490ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_595b6dc4-b331-490d-aa08-f0377a395ba7
25212024-12-19T21:51:33.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48070
25222024-12-19T21:51:33.502ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
25232024-12-19T21:51:33.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 677b0ae4-1f6d-497a-99d2-f8e48312f55e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25242024-12-19T21:51:33.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_677b0ae4-1f6d-497a-99d2-f8e48312f55e
25252024-12-19T21:51:33.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
25262024-12-19T21:51:33.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5645011c-c670-4c29-977d-a05bbfd29ef2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25272024-12-19T21:51:33.546ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_5645011c-c670-4c29-977d-a05bbfd29ef2
25282024-12-19T21:51:33.571ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fe82e84-6cd1-4c00-8033-68c6ea1e14de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25292024-12-19T21:51:33.572ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fe82e84-6cd1-4c00-8033-68c6ea1e14de
25302024-12-19T21:51:33.598ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92b40c7e-f135-40c8-a6af-87cc98f4ede3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25312024-12-19T21:51:33.598ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92b40c7e-f135-40c8-a6af-87cc98f4ede3
25322024-12-19T21:51:33.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106362 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48070 req_id = 3629f43d-54c2-4ea7-b9c3-19590f1b5af3 response_code = 204 uri = /switch-ports
25332024-12-19T21:51:33.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48070 req_id = a171b1e7-a373-423e-9161-b2d4fbae267a response_code = 200 uri = /network-bootstore-config
25342024-12-19T21:51:33.624ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ecb3b641-1217-432e-886e-545d59bd115f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25352024-12-19T21:51:33.624ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_ecb3b641-1217-432e-886e-545d59bd115f
25362024-12-19T21:51:33.647ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9fa7ff32-4dc0-440e-825a-982f046e9c3f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25372024-12-19T21:51:33.647ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9fa7ff32-4dc0-440e-825a-982f046e9c3f
25382024-12-19T21:51:33.669ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 38420449-1e6d-401e-aebc-3fbcbbcdf7de (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25392024-12-19T21:51:33.669ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_38420449-1e6d-401e-aebc-3fbcbbcdf7de
25402024-12-19T21:51:33.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51881 req_id = b047bd8b-315c-4204-ad4d-4d90e992c2b7 response_code = 200 uri = /inventory
25412024-12-19T21:51:33.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40360
25422024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 12bcffac-8204-4aaa-b21e-5155958bc66d, kind: Service { id: 33636c8a-3c34-4c6e-8484-5d00c7480c2e }, name: Name("external-dns-33636c8a-3c34-4c6e-8484-5d00c7480c2e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 224, 20])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c6172cb-47cc-46f9-8bda-dc450dd9b828, kind: Service { id: 6a5b6b13-8959-4dda-9c7a-e1e911d08309 }, name: Name("external-dns-6a5b6b13-8959-4dda-9c7a-e1e911d08309"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 227, 114])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1fa87bae-c99b-45a1-928f-8618068bbf71, kind: Service { id: 0eed2897-0106-4329-b5b8-0577d56d145c }, name: Name("nexus-0eed2897-0106-4329-b5b8-0577d56d145c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4bbba2fc-4718-4298-ae81-75245ef64737, kind: Service { id: 410afead-fda9-4475-970e-8ade982017e3 }, name: Name("nexus-410afead-fda9-4475-970e-8ade982017e3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 57])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: feb841aa-a47a-445b-9fae-f75fcf54ab95, kind: Service { id: ec016703-4181-4233-a8c9-0a669acf5cce }, name: Name("nexus-ec016703-4181-4233-a8c9-0a669acf5cce"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 157, 67])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25432024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25442024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25452024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25462024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25482024-12-19T21:51:33.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25492024-12-19T21:51:33.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40360 req_id = 0cfb0596-d7dd-4630-9bfd-e8f0f182d99f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25502024-12-19T21:51:46.147ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7028 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = ed3e066b-d7ad-47b2-8254-23c05a59c786 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
25512024-12-19T21:52:01.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60367
25522024-12-19T21:52:01.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60367 req_id = d3d65181-4897-4a47-a166-7ef559885650 response_code = 200 uri = /vpc-routes
25532024-12-19T21:52:01.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55753
25542024-12-19T21:52:01.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55753 req_id = deac4c1c-8785-452c-8b6f-45e6e49a3628 response_code = 200 uri = /v2p
25552024-12-19T21:52:01.455ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
25562024-12-19T21:52:01.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60367 req_id = bf45841a-76f7-46d4-95bb-9b41fb56199c response_code = 204 uri = /eip-gateways
25572024-12-19T21:52:01.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60367 req_id = b4cecdfd-3eb2-48ce-a6b7-c7224cd33b7a response_code = 204 uri = /vpc-routes
25582024-12-19T21:52:01.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37950
25592024-12-19T21:52:01.540ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
25602024-12-19T21:52:01.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
25612024-12-19T21:52:01.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37950 req_id = 0b70ff38-c96f-490e-a6d8-035bd3b25444 response_code = 204 uri = /switch-ports
25622024-12-19T21:52:01.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37950 req_id = 4c4a7d05-80f0-434e-9f76-54c6d3d54807 response_code = 200 uri = /network-bootstore-config
25632024-12-19T21:52:02.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59226
25642024-12-19T21:52:02.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59226 req_id = c7148494-31c3-45a6-b567-f15dc4c52663 response_code = 200 uri = /vpc-routes
25652024-12-19T21:52:02.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
25662024-12-19T21:52:02.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59226 req_id = 476c1e31-7138-4c7e-98ca-1a62046df518 response_code = 204 uri = /eip-gateways
25672024-12-19T21:52:02.725ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53081
25682024-12-19T21:52:02.725ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53081 req_id = 7a7597d9-ceed-4c2f-9d8b-9d59de6c3074 response_code = 200 uri = /baseboard
25692024-12-19T21:52:02.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56056
25702024-12-19T21:52:02.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56056 req_id = 7d99e868-34ca-4cdd-b6a2-7eb323fee274 response_code = 200 uri = /v2p
25712024-12-19T21:52:02.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59226 req_id = 1944ae00-03db-4ee7-add6-36175c0938b4 response_code = 204 uri = /vpc-routes
25722024-12-19T21:52:02.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61961
25732024-12-19T21:52:02.861ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
25742024-12-19T21:52:02.899ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
25752024-12-19T21:52:02.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96033 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61961 req_id = 1a8fdaf2-2872-4f8b-ad47-a65b589344b9 response_code = 204 uri = /switch-ports
25762024-12-19T21:52:02.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47083
25772024-12-19T21:52:02.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47083 req_id = 9873dcb9-821d-4005-b847-3b18a7c82ce5 response_code = 200 uri = /vpc-routes
25782024-12-19T21:52:02.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61961 req_id = c7b76517-0c42-497b-ac77-dcb9f430e791 response_code = 200 uri = /network-bootstore-config
25792024-12-19T21:52:02.972ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
25802024-12-19T21:52:02.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47083 req_id = 1450f628-d1a1-432c-9b5e-b77cd81753f0 response_code = 204 uri = /eip-gateways
25812024-12-19T21:52:02.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39078
25822024-12-19T21:52:02.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39078 req_id = 81401b58-4276-4e1b-b867-cb284368a693 response_code = 200 uri = /v2p
25832024-12-19T21:52:02.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47083 req_id = 2d951466-0738-4856-a128-ac86c1b9a01e response_code = 204 uri = /vpc-routes
25842024-12-19T21:52:02.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44835
25852024-12-19T21:52:02.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
25862024-12-19T21:52:03.021ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
25872024-12-19T21:52:03.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44835 req_id = 2c0b0447-7533-4ec4-a469-717481b87dbf response_code = 204 uri = /switch-ports
25882024-12-19T21:52:03.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44835 req_id = 3aed7078-a0c1-440b-ae80-1de12c6c488c response_code = 200 uri = /network-bootstore-config
25892024-12-19T21:52:16.147ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6109 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 6a32db2f-f543-448e-9d36-b87994cd957b response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
25902024-12-19T21:52:31.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49986
25912024-12-19T21:52:31.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49986 req_id = 50be61b8-a35a-498b-a8ed-e8ef4672cd40 response_code = 200 uri = /vpc-routes
25922024-12-19T21:52:31.741ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
25932024-12-19T21:52:31.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49986 req_id = 2ef042e3-c3ad-4df2-a851-8ad719fb1435 response_code = 204 uri = /eip-gateways
25942024-12-19T21:52:31.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49986 req_id = 51e35a4b-fe6d-41af-b33f-9a0a96d8c2c2 response_code = 204 uri = /vpc-routes
25952024-12-19T21:52:31.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33635
25962024-12-19T21:52:31.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33635 req_id = 73fbfb79-531d-427a-94dc-0972da97c2a4 response_code = 200 uri = /v2p
25972024-12-19T21:52:32.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57875
25982024-12-19T21:52:32.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
25992024-12-19T21:52:32.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
26002024-12-19T21:52:32.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57875 req_id = 9f2e1897-5182-45e7-ab92-d17a9a424981 response_code = 204 uri = /switch-ports
26012024-12-19T21:52:32.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57875 req_id = 18d62169-3053-49bd-8fc4-ee53e9adfdbc response_code = 200 uri = /network-bootstore-config
26022024-12-19T21:52:32.775ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42720
26032024-12-19T21:52:32.775ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42720 req_id = 856318bd-09d8-443b-afa1-24933dbca1ec response_code = 200 uri = /baseboard
26042024-12-19T21:52:32.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33386
26052024-12-19T21:52:32.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33386 req_id = 39180b21-eab9-42e5-ab76-aab4ef4fe477 response_code = 200 uri = /v2p
26062024-12-19T21:52:33.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37750
26072024-12-19T21:52:33.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37750 req_id = 3d4b11a8-f2fa-4d0a-a9e2-0e3491016868 response_code = 200 uri = /vpc-routes
26082024-12-19T21:52:33.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57473
26092024-12-19T21:52:33.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57473 req_id = d3f87147-56fa-4330-8e7e-15fd46eef857 response_code = 200 uri = /vpc-routes
26102024-12-19T21:52:33.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
26112024-12-19T21:52:33.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37750 req_id = c2d54ac3-e0a7-4976-8b9e-13ba5bcc3d80 response_code = 204 uri = /eip-gateways
26122024-12-19T21:52:33.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37750 req_id = 1b89d736-a755-4033-9949-7a25723ffd17 response_code = 204 uri = /vpc-routes
26132024-12-19T21:52:33.097ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
26142024-12-19T21:52:33.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57473 req_id = b3751aad-91ab-473a-8776-55c1edebfdac response_code = 204 uri = /eip-gateways
26152024-12-19T21:52:33.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57473 req_id = 684876e6-3704-4a9a-b51c-bb155d6fc871 response_code = 204 uri = /vpc-routes
26162024-12-19T21:52:33.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35677
26172024-12-19T21:52:33.127ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
26182024-12-19T21:52:33.166ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
26192024-12-19T21:52:33.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104687 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35677 req_id = e7d63d8b-d079-49c3-8a87-6a7d9c8453dc response_code = 204 uri = /switch-ports
26202024-12-19T21:52:33.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39195
26212024-12-19T21:52:33.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35677 req_id = 2304e5f1-10ea-42bb-b0b4-2c7c53bc3f3e response_code = 200 uri = /network-bootstore-config
26222024-12-19T21:52:33.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39195 req_id = 279855b0-1f42-4baa-8e45-2a216994b901 response_code = 200 uri = /v2p
26232024-12-19T21:52:33.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40304
26242024-12-19T21:52:33.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
26252024-12-19T21:52:33.343ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
26262024-12-19T21:52:33.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40304 req_id = 946ec2d3-d9ec-4e4c-bf0b-af54e7bd05ca response_code = 204 uri = /switch-ports
26272024-12-19T21:52:33.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40304 req_id = 13966cfa-e365-4b9d-bb3c-e55535679454 response_code = 200 uri = /network-bootstore-config
26282024-12-19T21:52:37.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34150
26292024-12-19T21:52:37.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34150 req_id = aa646d58-a38a-4515-9edf-56a83e310081 response_code = 200 uri = /v2p
26302024-12-19T21:52:37.361ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(5738855) }
26312024-12-19T21:52:37.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 983 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34150 req_id = d91799e7-aa75-4795-941f-27ad8226c360 response_code = 204 uri = /v2p
26322024-12-19T21:52:37.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56971
26332024-12-19T21:52:37.494ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5738855))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-7f07af9de2f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: dd08caa3-cb5d-440a-9e7b-0b822777a152, read_only_parent: Some(Volume { block_size: 512, id: 9c9c5583-d0ab-4b64-9447-c25e1d8e5fc1, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: de1101b9-72f1-4eac-abfc-b02fa925ff0d, key: Some("TNOYeuO1ms4z8GSAae7YgYCdCRnENYe9LAsRTT0OiEY="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: dd08caa3-cb5d-440a-9e7b-0b822777a152, key: Some("w6tXN5uTgHPgbcvTwqZrH3fLDEOmzD2tcSggy04gs1s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-7f07af9de2f" }] }), cloud_init_bytes: Some(..) } instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 metadata = InstanceMetadata { silo_id: 0feefa69-b2eb-468b-9298-c35069cb9c00, project_id: 5911a1ff-a2c4-4911-a032-b1821bb21f81 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-19T21:52:37.479214678Z }
26342024-12-19T21:52:37.494ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 migration_id = None propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26352024-12-19T21:52:37.494ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 migration_id = None propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5738855))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 35a1219c-a829-406f-a419-e8ab993a78b8, kind: Instance { id: 97873b4f-ed90-4513-8cb0-5796e7fda3e8 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5738855), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-7f07af9de2f", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: dd08caa3-cb5d-440a-9e7b-0b822777a152, read_only_parent: Some(Volume { block_size: 512, id: 9c9c5583-d0ab-4b64-9447-c25e1d8e5fc1, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: de1101b9-72f1-4eac-abfc-b02fa925ff0d, key: Some("TNOYeuO1ms4z8GSAae7YgYCdCRnENYe9LAsRTT0OiEY="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::1a]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: dd08caa3-cb5d-440a-9e7b-0b822777a152, key: Some("w6tXN5uTgHPgbcvTwqZrH3fLDEOmzD2tcSggy04gs1s="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-7f07af9de2f" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-19T21:52:37.479214678Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26362024-12-19T21:52:37.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56971 req_id = 53e43482-5254-4fab-8478-1ce2e2477329 response_code = 200 uri = /vmms/62a5a36a-6fc5-4601-b28b-5b1074cebce5
26372024-12-19T21:52:37.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40581
26382024-12-19T21:52:37.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 814 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40581 req_id = 34b4e88d-8a39-4e06-a75a-c52a76a1a7e5 response_code = 200 uri = /vmms/62a5a36a-6fc5-4601-b28b-5b1074cebce5/state
26392024-12-19T21:52:37.578ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 5738855 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26402024-12-19T21:52:37.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26412024-12-19T21:52:37.614ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5 file = illumos-utils/src/zone.rs:325 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26422024-12-19T21:52:37.640ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5 file = illumos-utils/src/zone.rs:363 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26432024-12-19T21:52:37.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52560
26442024-12-19T21:52:37.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52560 req_id = e100beca-1775-4e18-8fa9-f5586825c8c7 response_code = 200 uri = /vpc-routes
26452024-12-19T21:52:37.694ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {35a1219c-a829-406f-a419-e8ab993a78b8: {10.151.1.175: {50e5f2b8-1051-401e-b8db-e6cef566f018}, 10.151.1.176: {50e5f2b8-1051-401e-b8db-e6cef566f018}}} }
26462024-12-19T21:52:39.363ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26472024-12-19T21:52:39.363ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26482024-12-19T21:52:39.531ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 61.419358ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26492024-12-19T21:52:39.615ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 119.65421ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26502024-12-19T21:52:39.774ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 294.845802ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26512024-12-19T21:52:40.084ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 256.413348ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26522024-12-19T21:52:40.353ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 928.261115ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26532024-12-19T21:52:41.293ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 1.416411878s file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26542024-12-19T21:52:42.719ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 1.134058833s file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26552024-12-19T21:52:43.865ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 610.574568ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 zone = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26562024-12-19T21:52:44.503ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5 file = sled-agent/src/instance.rs:1786 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26572024-12-19T21:52:44.515ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 40.613911ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26582024-12-19T21:52:44.567ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 118.954461ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26592024-12-19T21:52:44.696ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 226.118165ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26602024-12-19T21:52:44.932ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5") failed: Property not found. retry in 452.767738ms file = illumos-utils/src/svc.rs:36 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26612024-12-19T21:52:45.396ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26622024-12-19T21:52:45.432ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26632024-12-19T21:52:45.575ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26642024-12-19T21:52:45.577ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
26652024-12-19T21:52:45.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7883926 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52560 req_id = 2e746bdd-b25e-49d9-8c6c-7d70c04c609b response_code = 204 uri = /eip-gateways
26662024-12-19T21:52:45.578ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-19T21:52:45.578973890Z } file = sled-agent/src/instance.rs:780 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26672024-12-19T21:52:45.579ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-19T21:52:45.578973890Z } propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26682024-12-19T21:52:45.579ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-19T21:52:45.578973890Z }, migration_in: None, migration_out: None }
26692024-12-19T21:52:45.617ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-19T21:52:45.617669940Z } file = sled-agent/src/instance.rs:780 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26702024-12-19T21:52:45.617ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T21:52:45.617669940Z } propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26712024-12-19T21:52:45.617ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T21:52:45.617669940Z }, migration_in: None, migration_out: None }
26722024-12-19T21:52:45.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52560 req_id = 110557ef-9327-4032-a073-06f813e9ed5a response_code = 204 uri = /vpc-routes
26732024-12-19T21:52:46.146ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4757 local_addr = [fd00:1122:3344:101::1]:48203 method = GET remote_addr = [fd00:1122:3344:101::d]:42001 req_id = 5472e6e7-7353-482a-a4e8-418185c74f78 response_code = 200 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 uri = /e282623f-c8b6-42e1-8711-fe2573bc5d47
26742024-12-19T21:52:55.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51031
26752024-12-19T21:52:55.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51031 req_id = 547010f6-d6d0-40a5-bdbc-d84e7113bb4a response_code = 200 uri = /vmms/62a5a36a-6fc5-4601-b28b-5b1074cebce5/state
26762024-12-19T21:52:55.136ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-19T21:52:55.136617355Z } file = sled-agent/src/instance.rs:780 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26772024-12-19T21:52:55.136ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-19T21:52:55.136617355Z } propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26782024-12-19T21:52:55.136ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-19T21:52:55.136617355Z }, migration_in: None, migration_out: None }
26792024-12-19T21:52:55.148ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-19T21:52:55.148273302Z } file = sled-agent/src/instance.rs:780 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26802024-12-19T21:52:55.148ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-19T21:52:55.148273302Z } propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26812024-12-19T21:52:55.148ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26822024-12-19T21:52:55.148ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26832024-12-19T21:52:55.148ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26842024-12-19T21:52:55.148ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/11590bd1-5f0c-4942-ab1c-f5a5c84179e5/debug/bundle/zone", "/pool/int/6ef2c18a-f256-4fe5-a7ee-a09adaf7d5ce/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/50ee5ee8-be28-48eb-9f52-740c68ec2afb/crypt/debug", "/pool/ext/595b6dc4-b331-490d-aa08-f0377a395ba7/crypt/debug", "/pool/ext/677b0ae4-1f6d-497a-99d2-f8e48312f55e/crypt/debug", "/pool/ext/5645011c-c670-4c29-977d-a05bbfd29ef2/crypt/debug", "/pool/ext/9fe82e84-6cd1-4c00-8033-68c6ea1e14de/crypt/debug", "/pool/ext/92b40c7e-f135-40c8-a6af-87cc98f4ede3/crypt/debug", "/pool/ext/ecb3b641-1217-432e-886e-545d59bd115f/crypt/debug", "/pool/ext/9fa7ff32-4dc0-440e-825a-982f046e9c3f/crypt/debug", "/pool/ext/38420449-1e6d-401e-aebc-3fbcbbcdf7de/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5
26852024-12-19T21:52:55.787ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5", bundle_id: 9b4ea1d9-43ff-4ee9-8fc2-d4fed58afb5b }, time_created: 2024-12-19T21:52:55.149590543Z, version: 0, cause: TerminatedInstance }
26862024-12-19T21:52:55.787ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_62a5a36a-6fc5-4601-b28b-5b1074cebce5 file = sled-agent/src/instance.rs:1032 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26872024-12-19T21:52:57.557ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26882024-12-19T21:52:57.574ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(5738855), kind: System }
26892024-12-19T21:52:57.574ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(5738855), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
26902024-12-19T21:52:57.574ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T21:52:57.574466876Z }, migration_in: None, migration_out: None }
26912024-12-19T21:52:57.597ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T21:52:57.574466876Z }, migration_in: None, migration_out: None }
26922024-12-19T21:52:57.602ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 97873b4f-ed90-4513-8cb0-5796e7fda3e8 propolis_id = 62a5a36a-6fc5-4601-b28b-5b1074cebce5
26932024-12-19T21:52:57.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55793
26942024-12-19T21:52:57.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55793 req_id = 929ed410-8c86-4009-8747-c90ef48c4e04 response_code = 200 uri = /vpc-routes
26952024-12-19T21:52:57.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {35a1219c-a829-406f-a419-e8ab993a78b8: {10.151.1.176: {50e5f2b8-1051-401e-b8db-e6cef566f018}, 10.151.1.175: {50e5f2b8-1051-401e-b8db-e6cef566f018}}} }
26962024-12-19T21:52:57.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55793 req_id = b555f110-cfec-4be5-9f69-6d2e5aff1f99 response_code = 204 uri = /eip-gateways
26972024-12-19T21:52:58.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55793 req_id = e3f8ea99-4b13-4e4e-84be-27f6264256ac response_code = 204 uri = /vpc-routes
26982024-12-19T21:52:58.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62349
26992024-12-19T21:52:58.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62349 req_id = 515fe319-bc38-4f5d-a489-eece8c7d0872 response_code = 200 uri = /v2p
27002024-12-19T21:52:58.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38695
27012024-12-19T21:52:58.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38695 req_id = da139f57-b569-4e3b-a5f9-573126e96de4 response_code = 200 uri = /v2p
27022024-12-19T21:52:58.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54619
27032024-12-19T21:52:58.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54619 req_id = 8ecf9e86-6f85-4663-8571-21bbfb872a4b response_code = 200 uri = /vpc-routes
27042024-12-19T21:52:58.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
27052024-12-19T21:52:58.314ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47
27062024-12-19T21:52:58.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54619 req_id = 8310bf08-c3f8-462b-b769-6bd2e60a00d6 response_code = 204 uri = /eip-gateways
27072024-12-19T21:52:58.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54619 req_id = e019d7d2-2033-4ee7-8828-2a10707aabc0 response_code = 204 uri = /vpc-routes
27082024-12-19T21:52:59.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42688
27092024-12-19T21:52:59.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42688 req_id = e8c70945-c348-4b39-838d-e223a0d5468e response_code = 200 uri = /vpc-routes
27102024-12-19T21:52:59.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
27112024-12-19T21:52:59.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42688 req_id = 449bbc47-9812-452e-bbff-3fe3bc1e70de response_code = 204 uri = /eip-gateways
27122024-12-19T21:52:59.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42688 req_id = 08f48cd4-c1a0-489a-8210-d10b4f026f9d response_code = 204 uri = /vpc-routes
27132024-12-19T21:53:01.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38092
27142024-12-19T21:53:01.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38092 req_id = 153a7137-bc8f-409d-8fb2-5b85eab8a1dc response_code = 200 uri = /v2p
27152024-12-19T21:53:01.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49542
27162024-12-19T21:53:01.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49542 req_id = 5537e8b1-10cd-42a7-bd00-85f8e05f5acf response_code = 200 uri = /vpc-routes
27172024-12-19T21:53:01.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e282623f-c8b6-42e1-8711-fe2573bc5d47 values = ExternalIpGatewayMap { mappings: {} }
27182024-12-19T21:53:01.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49542 req_id = a2209dd7-8588-4dd3-a25a-97f99722f2eb response_code = 204 uri = /eip-gateways
27192024-12-19T21:53:01.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49542 req_id = ded1dd66-65c0-47ec-a4d2-3f83e2eafd3e response_code = 204 uri = /vpc-routes
27202024-12-19T21:53:01.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33687
27212024-12-19T21:53:01.778ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4160
27222024-12-19T21:53:01.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4184
27232024-12-19T21:53:01.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85228 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33687 req_id = 07cd4125-61e8-4516-8a74-d93a5d7f2a65 response_code = 204 uri = /switch-ports
27242024-12-19T21:53:01.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33687 req_id = b9d6d20d-fbaf-42e5-933b-1c4923674335 response_code = 200 uri = /network-bootstore-config