Max level shown:
1 [ Dec 3 23:11:00 Enabled. ]
2 [ Dec 3 23:11:00 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 3 23:11:00 Method "start" exited with status 0. ]
4 [ Dec 3 23:11:00 Rereading configuration. ]
5 [ Dec 3 23:11:00 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-03T23:11:00.256ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-03T23:11:00.256ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-03T23:11:00.309ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-03T23:11:00.309ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-03T23:11:00.425ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-03T23:11:00.435ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-03T23:11:00.443ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-03T23:11:01.048ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-03T23:11:01.188ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-03T23:11:01.188ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-03T23:11:01.188ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-03T23:11:01.188ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-03T23:11:01.188ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-03T23:11:01.188ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-03T23:11:01.191ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-03T23:11:01.191ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-03T23:11:01.191ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-03T23:11:01.191ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-03T23:11:01.191ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-03T23:11:01.191ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-03T23:11:01.191ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-03T23:11:01.191ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-03T23:11:01.191ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-03T23:11:01.203ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-03T23:11:01.203ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool)
322024-12-03T23:11:01.300ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal }
332024-12-03T23:11:01.751ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-03T23:11:01.751ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-03T23:11:01.751ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-03T23:11:01.751ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-03T23:11:01.751ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-03T23:11:01.751ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-03T23:11:01.751ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-03T23:11:01.759ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-03T23:11:01.759ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool)
422024-12-03T23:11:01.843ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal }
432024-12-03T23:11:02.304ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-03T23:11:02.304ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-03T23:11:02.304ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-03T23:11:02.304ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-03T23:11:02.305ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-12-03T23:11:02.305ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-03T23:11:02.305ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-03T23:11:02.305ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-03T23:11:02.305ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-03T23:11:02.305ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-03T23:11:02.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1032024-12-03T23:11:02.305ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-03T23:11:02.305ZINFOSledAgent (bootstore): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-03T23:11:02.305ZINFOSledAgent (bootstore): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-03T23:11:02.305ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-03T23:11:02.305ZINFOSledAgent (bootstore): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-03T23:11:02.305ZINFOSledAgent (bootstore): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-03T23:11:02.305ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-03T23:11:02.305ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-03T23:11:02.305ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-03T23:11:02.317ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-03T23:11:02.317ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 5178, tv_nsec: 952203424 } time_to_next_cleanup = 599.999909848s
1142024-12-03T23:11:02.317ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-03T23:11:02.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-03T23:11:02.317ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-03T23:11:02.317ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-03T23:11:02.320ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-03T23:11:02.322ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-03T23:11:02.322ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-03T23:11:02.322ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-03T23:11:02.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-03T23:11:02.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-03T23:11:02.322ZINFOSledAgent (RSS): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-03T23:11:02.322ZINFOSledAgent (RSS): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-03T23:11:02.322ZINFOSledAgent (RSS): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-03T23:11:02.322ZINFOSledAgent (RSS): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-03T23:11:02.322ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-03T23:11:02.322ZINFOSledAgent (RSS): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-03T23:11:02.323ZINFOSledAgent (RSS): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-03T23:11:02.323ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-03T23:11:02.323ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-03T23:11:02.323ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-03T23:11:02.323ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-03T23:11:02.323ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-03T23:11:02.323ZINFOSledAgent (bootstore): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-03T23:11:02.323ZINFOSledAgent (bootstore): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-03T23:11:02.323ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-03T23:11:02.323ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 9497a29b-1799-4726-9b95-53dee50af36d (sled), rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-03T23:11:02.324ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-03T23:11:02.324ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-03T23:11:02.328ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-03T23:11:02.334ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-03T23:11:02.334ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-03T23:11:02.338ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-03T23:11:02.338ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-03T23:11:02.338ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:38075
1482024-12-03T23:11:02.339ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 9497a29b-1799-4726-9b95-53dee50af36d (sled), rack_id: 0835cb15-df31-4676-b043-2039c00a9b2e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-03T23:11:02.339ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-03T23:11:02.339ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-03T23:11:02.339ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-03T23:11:02.339ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-03T23:11:02.339ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-03T23:11:02.339ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-03T23:11:02.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-03T23:11:02.377ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-03T23:11:02.390ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1652024-12-03T23:11:02.390ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1662024-12-03T23:11:02.390ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1672024-12-03T23:11:02.390ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1682024-12-03T23:11:02.393ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 148.231772ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e583d42f-2d47-429b-b2c7-c8913d7fbe05", "content-length": "124", "date": "Tue, 03 Dec 2024 23:11:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e583d42f-2d47-429b-b2c7-c8913d7fbe05" } file = clients/ddm-admin-client/src/lib.rs:177
1692024-12-03T23:11:02.396ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1702024-12-03T23:11:02.403ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_19e69794-96f9-49bd-b112-d5d8ccde31a9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-03T23:11:02.427ZINFOSledAgent: successfully created encrypted zvol: name="oxi_19e69794-96f9-49bd-b112-d5d8ccde31a9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-03T23:11:02.427ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_19e69794-96f9-49bd-b112-d5d8ccde31a9/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-03T23:11:02.433ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1742024-12-03T23:11:02.433ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-03T23:11:02.433ZINFOSledAgent (BackingFs): Ensuring dataset oxi_19e69794-96f9-49bd-b112-d5d8ccde31a9/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-03T23:11:02.518ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1772024-12-03T23:11:02.542ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-03T23:11:02.543ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 118.043057ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d2423812-5cf8-4a18-a3d0-51d226611c75", "content-length": "124", "date": "Tue, 03 Dec 2024 23:11:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d2423812-5cf8-4a18-a3d0-51d226611c75" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-03T23:11:02.662ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-03T23:11:02.662ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 182.4161ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bd20d3ca-d542-4e94-ba47-fd8ef2d087d0", "content-length": "124", "date": "Tue, 03 Dec 2024 23:11:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bd20d3ca-d542-4e94-ba47-fd8ef2d087d0" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-03T23:11:02.736ZINFOSledAgent (BackingFs): Mounting oxi_19e69794-96f9-49bd-b112-d5d8ccde31a9/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1822024-12-03T23:11:02.749ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1832024-12-03T23:11:02.749ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1842024-12-03T23:11:02.749ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1852024-12-03T23:11:02.749ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1862024-12-03T23:11:02.847ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-03T23:11:02.849ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 255.656552ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a1262346-f281-4780-8d56-7d4d5174116b", "content-length": "124", "date": "Tue, 03 Dec 2024 23:11:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a1262346-f281-4780-8d56-7d4d5174116b" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-03T23:11:03.104ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-03T23:11:03.105ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 132.273267ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4a285918-e07c-454c-a5b0-b807e2f32fb2", "content-length": "124", "date": "Tue, 03 Dec 2024 23:11:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4a285918-e07c-454c-a5b0-b807e2f32fb2" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-03T23:11:03.238ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-03T23:11:03.238ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 241.473971ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "361fcf94-2db0-44f5-a744-5af828e91553", "content-length": "124", "date": "Tue, 03 Dec 2024 23:11:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "361fcf94-2db0-44f5-a744-5af828e91553" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-03T23:11:03.481ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-03T23:11:03.486ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1942024-12-03T23:11:03.491ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:62783 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1952024-12-03T23:11:03.491ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1962024-12-03T23:11:03.491ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:62783 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 9497a29b-1799-4726-9b95-53dee50af36d sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1972024-12-03T23:11:03.492ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 133.755659ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1982024-12-03T23:11:03.493ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
1992024-12-03T23:11:03.493ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2002024-12-03T23:11:03.494ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2012024-12-03T23:11:03.494ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022024-12-03T23:11:03.628ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 529.776159ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2032024-12-03T23:11:04.160ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 775.645345ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2042024-12-03T23:11:04.937ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.159818481s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2052024-12-03T23:11:06.053ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2062024-12-03T23:11:06.053ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2072024-12-03T23:11:06.053ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2082024-12-03T23:11:06.053ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2092024-12-03T23:11:06.053ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2102024-12-03T23:11:06.053ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2112024-12-03T23:11:06.055ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2122024-12-03T23:11:06.057ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2132024-12-03T23:11:06.057ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='bd24fba9-f4ae-42d0-93fa-50e420afd825'/> <propval type="astring" name="rack_id" value='0835cb15-df31-4676-b043-2039c00a9b2e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe96:5a80'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='0835cb15-df31-4676-b043-2039c00a9b2e'/> <propval type="astring" name="sled_id" value='9497a29b-1799-4726-9b95-53dee50af36d'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='9497a29b-1799-4726-9b95-53dee50af36d'/> <propval type="astring" name="rack_uuid" value='0835cb15-df31-4676-b043-2039c00a9b2e'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='9497a29b-1799-4726-9b95-53dee50af36d'/> <propval type="astring" name="rack_uuid" value='0835cb15-df31-4676-b043-2039c00a9b2e'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-03T23:11:06.058ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-03T23:11:06.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 39.220868ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-03T23:11:06.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 93.416227ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-12-03T23:11:06.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 164.836817ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-03T23:11:07.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 354.216365ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-03T23:11:07.098ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.712589767s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2202024-12-03T23:11:07.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 471.948722ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-03T23:11:07.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 927.198449ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-03T23:11:08.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.074858761s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-03T23:11:10.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.366181396s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-03T23:11:11.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 783.08541ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-03T23:11:11.813ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.581981138s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2262024-12-03T23:11:12.635ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/nexus.rs:527 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2272024-12-03T23:11:12.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2282024-12-03T23:11:12.672ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2292024-12-03T23:11:12.673ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2302024-12-03T23:11:12.673ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312024-12-03T23:11:12.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2322024-12-03T23:11:12.673ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-03T23:11:12.674ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-03T23:11:12.674ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352024-12-03T23:11:12.674ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362024-12-03T23:11:12.674ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2372024-12-03T23:11:12.674ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:38075
2382024-12-03T23:11:12.841ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-12-03T23:11:12.841ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-12-03T23:11:12.846ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412024-12-03T23:11:12.846ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2422024-12-03T23:11:12.846ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432024-12-03T23:11:13.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39255
2442024-12-03T23:11:13.097ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2452024-12-03T23:11:13.097ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462024-12-03T23:11:13.097ZINFOSledAgent (ServiceManager): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-03T23:11:13.097ZINFOSledAgent (ServiceManager): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-03T23:11:13.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39255 req_id = 8a231583-5c26-4ed2-9baf-e5dc30cf958e response_code = 200 uri = /inventory
2492024-12-03T23:11:13.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38262
2502024-12-03T23:11:13.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38262 req_id = 615450ad-fe56-457a-85eb-ab9954cf25ae response_code = 200 uri = /sled-role
2512024-12-03T23:11:13.158ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7876f9fe-9600-4d85-9253-fb29825fa0f7 (physical_disk), pool_id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3005309f-754b-4a74-b605-05b267001cb4 (physical_disk), pool_id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a4a8d2c4-d376-44f8-9129-b8cfcb4cad5d (physical_disk), pool_id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 935118cf-d44a-4572-860d-001b2ec71a98 (physical_disk), pool_id: 477f8969-b73f-4886-851b-8d5be079baff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 13520fb9-f97f-4571-bb3d-1040a07c49a1 (physical_disk), pool_id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 364d9dcc-d739-4613-b878-322b6a1992f7 (physical_disk), pool_id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 5f9bb4b0-c72d-4bc2-bf6d-fea099e448f0 (physical_disk), pool_id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: a43919e1-847b-4353-9221-b0b020e39c6c (physical_disk), pool_id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 308fc6d3-7d32-4d54-9afe-e01ba559b93c (physical_disk), pool_id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522024-12-03T23:11:13.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40968
2532024-12-03T23:11:13.158ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2542024-12-03T23:11:13.158ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 7876f9fe-9600-4d85-9253-fb29825fa0f7 (physical_disk), pool_id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3005309f-754b-4a74-b605-05b267001cb4 (physical_disk), pool_id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a4a8d2c4-d376-44f8-9129-b8cfcb4cad5d (physical_disk), pool_id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 935118cf-d44a-4572-860d-001b2ec71a98 (physical_disk), pool_id: 477f8969-b73f-4886-851b-8d5be079baff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 13520fb9-f97f-4571-bb3d-1040a07c49a1 (physical_disk), pool_id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 364d9dcc-d739-4613-b878-322b6a1992f7 (physical_disk), pool_id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 5f9bb4b0-c72d-4bc2-bf6d-fea099e448f0 (physical_disk), pool_id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: a43919e1-847b-4353-9221-b0b020e39c6c (physical_disk), pool_id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 308fc6d3-7d32-4d54-9afe-e01ba559b93c (physical_disk), pool_id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2552024-12-03T23:11:13.158ZINFOSledAgent (StorageManager): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-03T23:11:13.158ZINFOSledAgent (StorageManager): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-03T23:11:13.158ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2582024-12-03T23:11:13.158ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592024-12-03T23:11:13.158ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602024-12-03T23:11:13.158ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612024-12-03T23:11:13.158ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622024-12-03T23:11:13.317ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632024-12-03T23:11:13.317ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool)
2642024-12-03T23:11:13.526ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2652024-12-03T23:11:13.527ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10260760115481919046 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2662024-12-03T23:11:13.528ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12800092969812200993 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2672024-12-03T23:11:13.620ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }
2682024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2692024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2702024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2712024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2722024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-03T23:11:13.628ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2752024-12-03T23:11:13.662ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762024-12-03T23:11:13.670ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone file = sled-storage/src/dataset.rs:303
2772024-12-03T23:11:13.675ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
2782024-12-03T23:11:13.838ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9 file = sled-storage/src/dataset.rs:389
2792024-12-03T23:11:13.845ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-03T23:11:13.845ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-03T23:11:13.845ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-03T23:11:13.845ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-03T23:11:13.845ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-03T23:11:13.855ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-03T23:11:13.855ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool)
2862024-12-03T23:11:13.946ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }
2872024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2882024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2892024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2902024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2912024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-03T23:11:13.954ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2942024-12-03T23:11:13.988ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-12-03T23:11:13.996ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone file = sled-storage/src/dataset.rs:303
2962024-12-03T23:11:14.167ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_88c18331-f96d-4496-b80c-5b839f36e5ec file = sled-storage/src/dataset.rs:389
2972024-12-03T23:11:14.174ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982024-12-03T23:11:14.174ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992024-12-03T23:11:14.174ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002024-12-03T23:11:14.174ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012024-12-03T23:11:14.174ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-12-03T23:11:14.183ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032024-12-03T23:11:14.184ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool)
3042024-12-03T23:11:14.275ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }
3052024-12-03T23:11:14.283ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3062024-12-03T23:11:14.283ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3072024-12-03T23:11:14.283ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3082024-12-03T23:11:14.283ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3092024-12-03T23:11:14.283ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-03T23:11:14.284ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-03T23:11:14.284ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3122024-12-03T23:11:14.319ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-12-03T23:11:14.326ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone file = sled-storage/src/dataset.rs:303
3142024-12-03T23:11:14.490ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a file = sled-storage/src/dataset.rs:389
3152024-12-03T23:11:14.498ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162024-12-03T23:11:14.498ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172024-12-03T23:11:14.498ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182024-12-03T23:11:14.498ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192024-12-03T23:11:14.498ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-12-03T23:11:14.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212024-12-03T23:11:14.507ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 477f8969-b73f-4886-851b-8d5be079baff (zpool)
3222024-12-03T23:11:14.599ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }
3232024-12-03T23:11:14.607ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3242024-12-03T23:11:14.607ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3252024-12-03T23:11:14.607ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3262024-12-03T23:11:14.607ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3272024-12-03T23:11:14.607ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-12-03T23:11:14.608ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-03T23:11:14.608ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3302024-12-03T23:11:14.642ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-12-03T23:11:14.650ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/zone file = sled-storage/src/dataset.rs:303
3322024-12-03T23:11:14.677ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
3332024-12-03T23:11:14.827ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_477f8969-b73f-4886-851b-8d5be079baff file = sled-storage/src/dataset.rs:389
3342024-12-03T23:11:14.836ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-03T23:11:14.836ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-03T23:11:14.836ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-03T23:11:14.836ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-03T23:11:14.836ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-03T23:11:14.846ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-03T23:11:14.846ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool)
3412024-12-03T23:11:14.940ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }
3422024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3432024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3442024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3452024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3462024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-03T23:11:14.949ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3492024-12-03T23:11:14.985ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-12-03T23:11:14.993ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone file = sled-storage/src/dataset.rs:303
3512024-12-03T23:11:15.170ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5 file = sled-storage/src/dataset.rs:389
3522024-12-03T23:11:15.178ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-03T23:11:15.178ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-03T23:11:15.178ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-03T23:11:15.178ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-03T23:11:15.178ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-03T23:11:15.188ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-03T23:11:15.188ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 92da16e7-325b-473a-8169-ae1c2827470d (zpool)
3592024-12-03T23:11:15.285ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }
3602024-12-03T23:11:15.293ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3612024-12-03T23:11:15.293ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3622024-12-03T23:11:15.293ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3632024-12-03T23:11:15.293ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3642024-12-03T23:11:15.293ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-03T23:11:15.294ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-03T23:11:15.294ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3672024-12-03T23:11:15.330ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-03T23:11:15.338ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_92da16e7-325b-473a-8169-ae1c2827470d/crypt/zone file = sled-storage/src/dataset.rs:303
3692024-12-03T23:11:15.513ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_92da16e7-325b-473a-8169-ae1c2827470d file = sled-storage/src/dataset.rs:389
3702024-12-03T23:11:15.521ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-03T23:11:15.521ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-03T23:11:15.521ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-03T23:11:15.521ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-03T23:11:15.521ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-03T23:11:15.531ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-03T23:11:15.531ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b1979523-9de1-40bb-ac9e-46203987b285 (zpool)
3772024-12-03T23:11:15.625ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }
3782024-12-03T23:11:15.633ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3792024-12-03T23:11:15.633ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3802024-12-03T23:11:15.633ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3812024-12-03T23:11:15.633ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3822024-12-03T23:11:15.633ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-03T23:11:15.634ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-03T23:11:15.634ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3852024-12-03T23:11:15.668ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862024-12-03T23:11:15.676ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone file = sled-storage/src/dataset.rs:303
3872024-12-03T23:11:15.680ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
3882024-12-03T23:11:15.855ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b1979523-9de1-40bb-ac9e-46203987b285 file = sled-storage/src/dataset.rs:389
3892024-12-03T23:11:15.863ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-03T23:11:15.863ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-03T23:11:15.863ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-03T23:11:15.863ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-03T23:11:15.863ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-03T23:11:15.873ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-03T23:11:15.873ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool)
3962024-12-03T23:11:15.965ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }
3972024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3982024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3992024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4002024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4012024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-03T23:11:15.973ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4042024-12-03T23:11:16.009ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-03T23:11:16.017ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone file = sled-storage/src/dataset.rs:303
4062024-12-03T23:11:16.188ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 file = sled-storage/src/dataset.rs:389
4072024-12-03T23:11:16.196ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-03T23:11:16.196ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-03T23:11:16.196ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-03T23:11:16.196ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-03T23:11:16.196ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-03T23:11:16.205ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-03T23:11:16.205ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool)
4142024-12-03T23:11:16.319ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }
4152024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4162024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4172024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4182024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4192024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-03T23:11:16.327ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4222024-12-03T23:11:16.364ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-03T23:11:16.375ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/zone file = sled-storage/src/dataset.rs:303
4242024-12-03T23:11:16.553ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d file = sled-storage/src/dataset.rs:389
4252024-12-03T23:11:16.561ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-03T23:11:16.561ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-03T23:11:16.561ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-03T23:11:16.561ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 19e69794-96f9-49bd-b112-d5d8ccde31a9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 81b3a86c-bba7-4eaf-a631-921a7ea80989 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-03T23:11:16.561ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-03T23:11:16.561ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-03T23:11:16.562ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-03T23:11:16.562ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4332024-12-03T23:11:16.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4342024-12-03T23:11:16.562ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4352024-12-03T23:11:16.562ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4362024-12-03T23:11:16.562ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4372024-12-03T23:11:16.562ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4382024-12-03T23:11:16.562ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4392024-12-03T23:11:16.562ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-03T23:11:16.562ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4412024-12-03T23:11:16.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3403960 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40968 req_id = 2eccf116-608b-4fb0-b841-686f0272d8fb response_code = 200 uri = /omicron-physical-disks
4422024-12-03T23:11:16.594ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0026bb7c-2cac-4c48-ad9b-a11d3c393f32 (dataset): DatasetConfig { id: 0026bb7c-2cac-4c48-ad9b-a11d3c393f32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0071d946-b525-46fa-bb72-dbe3ba7bc42d (dataset): DatasetConfig { id: 0071d946-b525-46fa-bb72-dbe3ba7bc42d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03ff2559-6e88-4824-9b4a-d676c68578df (dataset): DatasetConfig { id: 03ff2559-6e88-4824-9b4a-d676c68578df (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05188beb-22b5-4b98-921b-c2e8358053ed (dataset): DatasetConfig { id: 05188beb-22b5-4b98-921b-c2e8358053ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a5671d8-494b-4845-875a-20486f246da9 (dataset): DatasetConfig { id: 0a5671d8-494b-4845-875a-20486f246da9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a363c4d-fddb-434b-8929-564392c1648a (dataset): DatasetConfig { id: 1a363c4d-fddb-434b-8929-564392c1648a (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c322f91-6c8f-4969-a27e-bfdf947122c3 (dataset): DatasetConfig { id: 1c322f91-6c8f-4969-a27e-bfdf947122c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 212fd4af-8474-49b6-bbf8-ee99cd51741c (dataset): DatasetConfig { id: 212fd4af-8474-49b6-bbf8-ee99cd51741c (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 249e1d6c-32a7-4acd-ac5b-a17d665d1abb (dataset): DatasetConfig { id: 249e1d6c-32a7-4acd-ac5b-a17d665d1abb (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 264cf2fb-d8d9-4589-b6d4-3daa7f3cfacf (dataset): DatasetConfig { id: 264cf2fb-d8d9-4589-b6d4-3daa7f3cfacf (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 281d7f66-b5fa-4654-8ce3-4e648867cacc (dataset): DatasetConfig { id: 281d7f66-b5fa-4654-8ce3-4e648867cacc (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29c040d8-db1a-4c14-a217-7db61f661d24 (dataset): DatasetConfig { id: 29c040d8-db1a-4c14-a217-7db61f661d24 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 310be48f-8657-447d-811b-12bcc828c851 (dataset): DatasetConfig { id: 310be48f-8657-447d-811b-12bcc828c851 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3df60f72-cd88-4573-98d2-05dee78ae75b (dataset): DatasetConfig { id: 3df60f72-cd88-4573-98d2-05dee78ae75b (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43577eaf-1505-45d5-a5e0-7aa003ad42ca (dataset): DatasetConfig { id: 43577eaf-1505-45d5-a5e0-7aa003ad42ca (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44c06b4f-e20c-4693-bc4f-65da8258d8b6 (dataset): DatasetConfig { id: 44c06b4f-e20c-4693-bc4f-65da8258d8b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f835bd2-5a53-416f-b05e-208fd61b1d02 (dataset): DatasetConfig { id: 4f835bd2-5a53-416f-b05e-208fd61b1d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 50c54a4b-991d-49ad-8ac3-181a8b1ffd51 (dataset): DatasetConfig { id: 50c54a4b-991d-49ad-8ac3-181a8b1ffd51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50f9b9a9-b1ba-4918-9141-4f5efed2f6bb (dataset): DatasetConfig { id: 50f9b9a9-b1ba-4918-9141-4f5efed2f6bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51267435-3a8d-47bc-ad92-059c087130ba (dataset): DatasetConfig { id: 51267435-3a8d-47bc-ad92-059c087130ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aa73377-9725-4f02-b16b-084c8f070b8f (dataset): DatasetConfig { id: 5aa73377-9725-4f02-b16b-084c8f070b8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bd5e540-c1e7-4751-a0b9-109446c8e4ac (dataset): DatasetConfig { id: 5bd5e540-c1e7-4751-a0b9-109446c8e4ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f91f367-4c07-4492-86ca-c97ae828b242 (dataset): DatasetConfig { id: 5f91f367-4c07-4492-86ca-c97ae828b242 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 657c036a-a8da-49b4-bc77-ad91b5e9df0d (dataset): DatasetConfig { id: 657c036a-a8da-49b4-bc77-ad91b5e9df0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b469359-a93e-422f-99e2-6e78fa8ccacb (dataset): DatasetConfig { id: 6b469359-a93e-422f-99e2-6e78fa8ccacb (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72e49172-60cd-4deb-90a1-1290a507ebff (dataset): DatasetConfig { id: 72e49172-60cd-4deb-90a1-1290a507ebff (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7d63aff3-64b9-45f6-b5d4-dce468bca705 (dataset): DatasetConfig { id: 7d63aff3-64b9-45f6-b5d4-dce468bca705 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80668169-1044-4f5b-8633-65f6b9d8b635 (dataset): DatasetConfig { id: 80668169-1044-4f5b-8633-65f6b9d8b635 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 856bd791-9ba2-4d4c-9cb9-ce34c66231e2 (dataset): DatasetConfig { id: 856bd791-9ba2-4d4c-9cb9-ce34c66231e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85e3c158-b121-4708-90ac-d7fbb3ac89e3 (dataset): DatasetConfig { id: 85e3c158-b121-4708-90ac-d7fbb3ac89e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c7da664-1979-4426-bead-3e81030949ec (dataset): DatasetConfig { id: 8c7da664-1979-4426-bead-3e81030949ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93113b8a-9c73-4e44-bd12-bf6897e66380 (dataset): DatasetConfig { id: 93113b8a-9c73-4e44-bd12-bf6897e66380 (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9328fcc6-a696-403c-96b3-eb04fb67163d (dataset): DatasetConfig { id: 9328fcc6-a696-403c-96b3-eb04fb67163d (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 991c17ba-9eb1-47fc-9a5d-95eda53cb1fd (dataset): DatasetConfig { id: 991c17ba-9eb1-47fc-9a5d-95eda53cb1fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e2ae46a-088d-4687-86bc-bb7c75233dcf (dataset): DatasetConfig { id: 9e2ae46a-088d-4687-86bc-bb7c75233dcf (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e4662f8-0824-4c58-92e3-7faaa9208614 (dataset): DatasetConfig { id: 9e4662f8-0824-4c58-92e3-7faaa9208614 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1566d02-3dbc-444f-9059-56aa99ea2255 (dataset): DatasetConfig { id: a1566d02-3dbc-444f-9059-56aa99ea2255 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a265790c-fcac-4de7-905f-8cd3cfdcce9f (dataset): DatasetConfig { id: a265790c-fcac-4de7-905f-8cd3cfdcce9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a611fb22-f054-4ca0-8c46-e7abe4f33776 (dataset): DatasetConfig { id: a611fb22-f054-4ca0-8c46-e7abe4f33776 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab0186cd-a34c-46b3-99a0-8eae545031bf (dataset): DatasetConfig { id: ab0186cd-a34c-46b3-99a0-8eae545031bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab6fa709-b0d8-42e0-b166-ded7b71e2597 (dataset): DatasetConfig { id: ab6fa709-b0d8-42e0-b166-ded7b71e2597 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac1d5c29-cf32-41be-b31c-93085e2ec1d6 (dataset): DatasetConfig { id: ac1d5c29-cf32-41be-b31c-93085e2ec1d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac5e6ae6-adf9-486c-915f-4a9593333990 (dataset): DatasetConfig { id: ac5e6ae6-adf9-486c-915f-4a9593333990 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1e41baf-2055-487e-866e-d0315b0d4bc0 (dataset): DatasetConfig { id: b1e41baf-2055-487e-866e-d0315b0d4bc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2044bd0-24dc-436e-8e9e-48d0e6432711 (dataset): DatasetConfig { id: b2044bd0-24dc-436e-8e9e-48d0e6432711 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3286239-30e8-44d4-b694-bbb3181d9f5c (dataset): DatasetConfig { id: b3286239-30e8-44d4-b694-bbb3181d9f5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcca23a9-7b58-4301-af8f-a2690f1b7b36 (dataset): DatasetConfig { id: bcca23a9-7b58-4301-af8f-a2690f1b7b36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bcf6f7b1-844c-407e-8f22-821e830e8fdb (dataset): DatasetConfig { id: bcf6f7b1-844c-407e-8f22-821e830e8fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bea60cab-119b-49f7-9417-2ae4dba54025 (dataset): DatasetConfig { id: bea60cab-119b-49f7-9417-2ae4dba54025 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c49f82d8-be2c-4a9c-8366-b5c0a82c6c6c (dataset): DatasetConfig { id: c49f82d8-be2c-4a9c-8366-b5c0a82c6c6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c806b568-5e25-48e5-a383-577788ef9c89 (dataset): DatasetConfig { id: c806b568-5e25-48e5-a383-577788ef9c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ce305967-1bea-4cad-8cbc-f10909339d6f (dataset): DatasetConfig { id: ce305967-1bea-4cad-8cbc-f10909339d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cec53dbc-7c94-43bf-a939-06e1b36f9190 (dataset): DatasetConfig { id: cec53dbc-7c94-43bf-a939-06e1b36f9190 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfea6f0f-287d-4b0d-a1fb-4713d83f988f (dataset): DatasetConfig { id: cfea6f0f-287d-4b0d-a1fb-4713d83f988f (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0fd4f52-bd74-420e-880f-f08ba1fb2ea7 (dataset): DatasetConfig { id: d0fd4f52-bd74-420e-880f-f08ba1fb2ea7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6d1c99a-b4cf-4b89-8f11-f599b672455f (dataset): DatasetConfig { id: d6d1c99a-b4cf-4b89-8f11-f599b672455f (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db02d5ac-b41f-420a-8140-c9239ecd04ef (dataset): DatasetConfig { id: db02d5ac-b41f-420a-8140-c9239ecd04ef (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dba3692b-4f6f-4ec5-82cd-c97464818ac4 (dataset): DatasetConfig { id: dba3692b-4f6f-4ec5-82cd-c97464818ac4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de5338aa-7846-4db1-b20f-33260fe26388 (dataset): DatasetConfig { id: de5338aa-7846-4db1-b20f-33260fe26388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4490331-3373-4062-a7af-1008e04399b5 (dataset): DatasetConfig { id: e4490331-3373-4062-a7af-1008e04399b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4f04a30-549f-462b-944c-2bfdfcd93551 (dataset): DatasetConfig { id: e4f04a30-549f-462b-944c-2bfdfcd93551 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb0b4ff4-10bb-4c84-a2ff-6b3b0d4eea25 (dataset): DatasetConfig { id: eb0b4ff4-10bb-4c84-a2ff-6b3b0d4eea25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef46cfad-cb89-420f-b94b-7d1bfd2643af (dataset): DatasetConfig { id: ef46cfad-cb89-420f-b94b-7d1bfd2643af (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5bda3ab-b6f0-48ff-938c-8b3af694c549 (dataset): DatasetConfig { id: f5bda3ab-b6f0-48ff-938c-8b3af694c549 (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f62767d0-3cac-4ed7-8945-4be9cb227c1e (dataset): DatasetConfig { id: f62767d0-3cac-4ed7-8945-4be9cb227c1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fe767831-992c-436c-86ed-4c888e016d71 (dataset): DatasetConfig { id: fe767831-992c-436c-86ed-4c888e016d71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-03T23:11:16.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54244
4442024-12-03T23:11:16.595ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4452024-12-03T23:11:16.595ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0026bb7c-2cac-4c48-ad9b-a11d3c393f32 (dataset): DatasetConfig { id: 0026bb7c-2cac-4c48-ad9b-a11d3c393f32 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0071d946-b525-46fa-bb72-dbe3ba7bc42d (dataset): DatasetConfig { id: 0071d946-b525-46fa-bb72-dbe3ba7bc42d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03ff2559-6e88-4824-9b4a-d676c68578df (dataset): DatasetConfig { id: 03ff2559-6e88-4824-9b4a-d676c68578df (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05188beb-22b5-4b98-921b-c2e8358053ed (dataset): DatasetConfig { id: 05188beb-22b5-4b98-921b-c2e8358053ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a5671d8-494b-4845-875a-20486f246da9 (dataset): DatasetConfig { id: 0a5671d8-494b-4845-875a-20486f246da9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a363c4d-fddb-434b-8929-564392c1648a (dataset): DatasetConfig { id: 1a363c4d-fddb-434b-8929-564392c1648a (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c322f91-6c8f-4969-a27e-bfdf947122c3 (dataset): DatasetConfig { id: 1c322f91-6c8f-4969-a27e-bfdf947122c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 212fd4af-8474-49b6-bbf8-ee99cd51741c (dataset): DatasetConfig { id: 212fd4af-8474-49b6-bbf8-ee99cd51741c (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 249e1d6c-32a7-4acd-ac5b-a17d665d1abb (dataset): DatasetConfig { id: 249e1d6c-32a7-4acd-ac5b-a17d665d1abb (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 264cf2fb-d8d9-4589-b6d4-3daa7f3cfacf (dataset): DatasetConfig { id: 264cf2fb-d8d9-4589-b6d4-3daa7f3cfacf (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 281d7f66-b5fa-4654-8ce3-4e648867cacc (dataset): DatasetConfig { id: 281d7f66-b5fa-4654-8ce3-4e648867cacc (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29c040d8-db1a-4c14-a217-7db61f661d24 (dataset): DatasetConfig { id: 29c040d8-db1a-4c14-a217-7db61f661d24 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 310be48f-8657-447d-811b-12bcc828c851 (dataset): DatasetConfig { id: 310be48f-8657-447d-811b-12bcc828c851 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3df60f72-cd88-4573-98d2-05dee78ae75b (dataset): DatasetConfig { id: 3df60f72-cd88-4573-98d2-05dee78ae75b (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43577eaf-1505-45d5-a5e0-7aa003ad42ca (dataset): DatasetConfig { id: 43577eaf-1505-45d5-a5e0-7aa003ad42ca (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44c06b4f-e20c-4693-bc4f-65da8258d8b6 (dataset): DatasetConfig { id: 44c06b4f-e20c-4693-bc4f-65da8258d8b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4f835bd2-5a53-416f-b05e-208fd61b1d02 (dataset): DatasetConfig { id: 4f835bd2-5a53-416f-b05e-208fd61b1d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 50c54a4b-991d-49ad-8ac3-181a8b1ffd51 (dataset): DatasetConfig { id: 50c54a4b-991d-49ad-8ac3-181a8b1ffd51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 50f9b9a9-b1ba-4918-9141-4f5efed2f6bb (dataset): DatasetConfig { id: 50f9b9a9-b1ba-4918-9141-4f5efed2f6bb (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 51267435-3a8d-47bc-ad92-059c087130ba (dataset): DatasetConfig { id: 51267435-3a8d-47bc-ad92-059c087130ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5aa73377-9725-4f02-b16b-084c8f070b8f (dataset): DatasetConfig { id: 5aa73377-9725-4f02-b16b-084c8f070b8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5bd5e540-c1e7-4751-a0b9-109446c8e4ac (dataset): DatasetConfig { id: 5bd5e540-c1e7-4751-a0b9-109446c8e4ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f91f367-4c07-4492-86ca-c97ae828b242 (dataset): DatasetConfig { id: 5f91f367-4c07-4492-86ca-c97ae828b242 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 657c036a-a8da-49b4-bc77-ad91b5e9df0d (dataset): DatasetConfig { id: 657c036a-a8da-49b4-bc77-ad91b5e9df0d (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b469359-a93e-422f-99e2-6e78fa8ccacb (dataset): DatasetConfig { id: 6b469359-a93e-422f-99e2-6e78fa8ccacb (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 72e49172-60cd-4deb-90a1-1290a507ebff (dataset): DatasetConfig { id: 72e49172-60cd-4deb-90a1-1290a507ebff (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7d63aff3-64b9-45f6-b5d4-dce468bca705 (dataset): DatasetConfig { id: 7d63aff3-64b9-45f6-b5d4-dce468bca705 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 80668169-1044-4f5b-8633-65f6b9d8b635 (dataset): DatasetConfig { id: 80668169-1044-4f5b-8633-65f6b9d8b635 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 856bd791-9ba2-4d4c-9cb9-ce34c66231e2 (dataset): DatasetConfig { id: 856bd791-9ba2-4d4c-9cb9-ce34c66231e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 85e3c158-b121-4708-90ac-d7fbb3ac89e3 (dataset): DatasetConfig { id: 85e3c158-b121-4708-90ac-d7fbb3ac89e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c7da664-1979-4426-bead-3e81030949ec (dataset): DatasetConfig { id: 8c7da664-1979-4426-bead-3e81030949ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 93113b8a-9c73-4e44-bd12-bf6897e66380 (dataset): DatasetConfig { id: 93113b8a-9c73-4e44-bd12-bf6897e66380 (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9328fcc6-a696-403c-96b3-eb04fb67163d (dataset): DatasetConfig { id: 9328fcc6-a696-403c-96b3-eb04fb67163d (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 991c17ba-9eb1-47fc-9a5d-95eda53cb1fd (dataset): DatasetConfig { id: 991c17ba-9eb1-47fc-9a5d-95eda53cb1fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e2ae46a-088d-4687-86bc-bb7c75233dcf (dataset): DatasetConfig { id: 9e2ae46a-088d-4687-86bc-bb7c75233dcf (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9e4662f8-0824-4c58-92e3-7faaa9208614 (dataset): DatasetConfig { id: 9e4662f8-0824-4c58-92e3-7faaa9208614 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1566d02-3dbc-444f-9059-56aa99ea2255 (dataset): DatasetConfig { id: a1566d02-3dbc-444f-9059-56aa99ea2255 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a265790c-fcac-4de7-905f-8cd3cfdcce9f (dataset): DatasetConfig { id: a265790c-fcac-4de7-905f-8cd3cfdcce9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a611fb22-f054-4ca0-8c46-e7abe4f33776 (dataset): DatasetConfig { id: a611fb22-f054-4ca0-8c46-e7abe4f33776 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab0186cd-a34c-46b3-99a0-8eae545031bf (dataset): DatasetConfig { id: ab0186cd-a34c-46b3-99a0-8eae545031bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ab6fa709-b0d8-42e0-b166-ded7b71e2597 (dataset): DatasetConfig { id: ab6fa709-b0d8-42e0-b166-ded7b71e2597 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac1d5c29-cf32-41be-b31c-93085e2ec1d6 (dataset): DatasetConfig { id: ac1d5c29-cf32-41be-b31c-93085e2ec1d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac5e6ae6-adf9-486c-915f-4a9593333990 (dataset): DatasetConfig { id: ac5e6ae6-adf9-486c-915f-4a9593333990 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1e41baf-2055-487e-866e-d0315b0d4bc0 (dataset): DatasetConfig { id: b1e41baf-2055-487e-866e-d0315b0d4bc0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2044bd0-24dc-436e-8e9e-48d0e6432711 (dataset): DatasetConfig { id: b2044bd0-24dc-436e-8e9e-48d0e6432711 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3286239-30e8-44d4-b694-bbb3181d9f5c (dataset): DatasetConfig { id: b3286239-30e8-44d4-b694-bbb3181d9f5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcca23a9-7b58-4301-af8f-a2690f1b7b36 (dataset): DatasetConfig { id: bcca23a9-7b58-4301-af8f-a2690f1b7b36 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bcf6f7b1-844c-407e-8f22-821e830e8fdb (dataset): DatasetConfig { id: bcf6f7b1-844c-407e-8f22-821e830e8fdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bea60cab-119b-49f7-9417-2ae4dba54025 (dataset): DatasetConfig { id: bea60cab-119b-49f7-9417-2ae4dba54025 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c49f82d8-be2c-4a9c-8366-b5c0a82c6c6c (dataset): DatasetConfig { id: c49f82d8-be2c-4a9c-8366-b5c0a82c6c6c (dataset), name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c806b568-5e25-48e5-a383-577788ef9c89 (dataset): DatasetConfig { id: c806b568-5e25-48e5-a383-577788ef9c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ce305967-1bea-4cad-8cbc-f10909339d6f (dataset): DatasetConfig { id: ce305967-1bea-4cad-8cbc-f10909339d6f (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cec53dbc-7c94-43bf-a939-06e1b36f9190 (dataset): DatasetConfig { id: cec53dbc-7c94-43bf-a939-06e1b36f9190 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cfea6f0f-287d-4b0d-a1fb-4713d83f988f (dataset): DatasetConfig { id: cfea6f0f-287d-4b0d-a1fb-4713d83f988f (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0fd4f52-bd74-420e-880f-f08ba1fb2ea7 (dataset): DatasetConfig { id: d0fd4f52-bd74-420e-880f-f08ba1fb2ea7 (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6d1c99a-b4cf-4b89-8f11-f599b672455f (dataset): DatasetConfig { id: d6d1c99a-b4cf-4b89-8f11-f599b672455f (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, db02d5ac-b41f-420a-8140-c9239ecd04ef (dataset): DatasetConfig { id: db02d5ac-b41f-420a-8140-c9239ecd04ef (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dba3692b-4f6f-4ec5-82cd-c97464818ac4 (dataset): DatasetConfig { id: dba3692b-4f6f-4ec5-82cd-c97464818ac4 (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de5338aa-7846-4db1-b20f-33260fe26388 (dataset): DatasetConfig { id: de5338aa-7846-4db1-b20f-33260fe26388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4490331-3373-4062-a7af-1008e04399b5 (dataset): DatasetConfig { id: e4490331-3373-4062-a7af-1008e04399b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e4f04a30-549f-462b-944c-2bfdfcd93551 (dataset): DatasetConfig { id: e4f04a30-549f-462b-944c-2bfdfcd93551 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb0b4ff4-10bb-4c84-a2ff-6b3b0d4eea25 (dataset): DatasetConfig { id: eb0b4ff4-10bb-4c84-a2ff-6b3b0d4eea25 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef46cfad-cb89-420f-b94b-7d1bfd2643af (dataset): DatasetConfig { id: ef46cfad-cb89-420f-b94b-7d1bfd2643af (dataset), name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5bda3ab-b6f0-48ff-938c-8b3af694c549 (dataset): DatasetConfig { id: f5bda3ab-b6f0-48ff-938c-8b3af694c549 (dataset), name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f62767d0-3cac-4ed7-8945-4be9cb227c1e (dataset): DatasetConfig { id: f62767d0-3cac-4ed7-8945-4be9cb227c1e (dataset), name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fe767831-992c-436c-86ed-4c888e016d71 (dataset): DatasetConfig { id: fe767831-992c-436c-86ed-4c888e016d71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4462024-12-03T23:11:16.595ZINFOSledAgent (StorageManager): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-03T23:11:16.595ZINFOSledAgent (StorageManager): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-03T23:11:16.595ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4492024-12-03T23:11:16.595ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4502024-12-03T23:11:16.595ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone" } file = sled-storage/src/manager.rs:1331
4512024-12-03T23:11:16.665ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4522024-12-03T23:11:16.665ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone"), full_name: "oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone" } file = sled-storage/src/manager.rs:1331
4532024-12-03T23:11:16.682ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4542024-12-03T23:11:16.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4552024-12-03T23:11:16.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/477f8969-b73f-4886-851b-8d5be079baff/crypt/zone/oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/zone/oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c" } file = sled-storage/src/manager.rs:1331
4562024-12-03T23:11:16.830ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4572024-12-03T23:11:16.830ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e" } file = sled-storage/src/manager.rs:1331
4582024-12-03T23:11:16.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4592024-12-03T23:11:16.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/477f8969-b73f-4886-851b-8d5be079baff/crypt/debug"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/debug" } file = sled-storage/src/manager.rs:1331
4602024-12-03T23:11:16.999ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4612024-12-03T23:11:16.999ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4622024-12-03T23:11:17.089ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4632024-12-03T23:11:17.089ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone/oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone/oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec" } file = sled-storage/src/manager.rs:1331
4642024-12-03T23:11:17.188ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4652024-12-03T23:11:17.188ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/debug"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/debug" } file = sled-storage/src/manager.rs:1331
4662024-12-03T23:11:17.257ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4672024-12-03T23:11:17.257ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/477f8969-b73f-4886-851b-8d5be079baff/crypt/zone/oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/zone/oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11" } file = sled-storage/src/manager.rs:1331
4682024-12-03T23:11:17.357ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4692024-12-03T23:11:17.357ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone/oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone/oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7" } file = sled-storage/src/manager.rs:1331
4702024-12-03T23:11:17.456ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712024-12-03T23:11:17.456ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone/oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61"), full_name: "oxp_b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone/oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61" } file = sled-storage/src/manager.rs:1331
4722024-12-03T23:11:17.554ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-12-03T23:11:17.554ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crucible" } file = sled-storage/src/manager.rs:1331
4742024-12-03T23:11:17.642ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-12-03T23:11:17.642ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b" } file = sled-storage/src/manager.rs:1331
4762024-12-03T23:11:17.685ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
4772024-12-03T23:11:17.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-12-03T23:11:17.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a" } file = sled-storage/src/manager.rs:1331
4792024-12-03T23:11:17.840ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-12-03T23:11:17.840ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone"), full_name: "oxp_b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone" } file = sled-storage/src/manager.rs:1331
4812024-12-03T23:11:17.907ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-12-03T23:11:17.907ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/zone/oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828"), full_name: "oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/zone/oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828" } file = sled-storage/src/manager.rs:1331
4832024-12-03T23:11:18.013ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4842024-12-03T23:11:18.013ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b1979523-9de1-40bb-ac9e-46203987b285/crypt/debug"), full_name: "oxp_b1979523-9de1-40bb-ac9e-46203987b285/crypt/debug" } file = sled-storage/src/manager.rs:1331
4852024-12-03T23:11:18.079ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4862024-12-03T23:11:18.079ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86" } file = sled-storage/src/manager.rs:1331
4872024-12-03T23:11:18.175ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4882024-12-03T23:11:18.175ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4892024-12-03T23:11:18.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902024-12-03T23:11:18.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone" } file = sled-storage/src/manager.rs:1331
4912024-12-03T23:11:18.330ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922024-12-03T23:11:18.330ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656" } file = sled-storage/src/manager.rs:1331
4932024-12-03T23:11:18.426ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942024-12-03T23:11:18.427ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone/oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753"), full_name: "oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone/oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753" } file = sled-storage/src/manager.rs:1331
4952024-12-03T23:11:18.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-12-03T23:11:18.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/debug"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/debug" } file = sled-storage/src/manager.rs:1331
4972024-12-03T23:11:18.589ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-12-03T23:11:18.589ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8" } file = sled-storage/src/manager.rs:1331
4992024-12-03T23:11:18.685ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-12-03T23:11:18.685ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone/oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone/oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac" } file = sled-storage/src/manager.rs:1331
5012024-12-03T23:11:18.688ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
5022024-12-03T23:11:18.782ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-03T23:11:18.782ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92da16e7-325b-473a-8169-ae1c2827470d/crypt/debug"), full_name: "oxp_92da16e7-325b-473a-8169-ae1c2827470d/crypt/debug" } file = sled-storage/src/manager.rs:1331
5042024-12-03T23:11:18.847ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-03T23:11:18.847ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5062024-12-03T23:11:18.937ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-03T23:11:18.937ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92da16e7-325b-473a-8169-ae1c2827470d/crypt/zone"), full_name: "oxp_92da16e7-325b-473a-8169-ae1c2827470d/crypt/zone" } file = sled-storage/src/manager.rs:1331
5082024-12-03T23:11:19.004ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-03T23:11:19.005ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a" } file = sled-storage/src/manager.rs:1331
5102024-12-03T23:11:19.103ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112024-12-03T23:11:19.103ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5122024-12-03T23:11:19.193ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132024-12-03T23:11:19.193ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crucible" } file = sled-storage/src/manager.rs:1331
5142024-12-03T23:11:19.282ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152024-12-03T23:11:19.282ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crucible" } file = sled-storage/src/manager.rs:1331
5162024-12-03T23:11:19.369ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172024-12-03T23:11:19.369ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/92da16e7-325b-473a-8169-ae1c2827470d/crypt/zone/oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00"), full_name: "oxp_92da16e7-325b-473a-8169-ae1c2827470d/crypt/zone/oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00" } file = sled-storage/src/manager.rs:1331
5182024-12-03T23:11:19.469ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192024-12-03T23:11:19.469ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone" } file = sled-storage/src/manager.rs:1331
5202024-12-03T23:11:19.538ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-12-03T23:11:19.538ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5222024-12-03T23:11:19.627ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-03T23:11:19.627ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232" } file = sled-storage/src/manager.rs:1331
5242024-12-03T23:11:19.693ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
5252024-12-03T23:11:19.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-12-03T23:11:19.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b" } file = sled-storage/src/manager.rs:1331
5272024-12-03T23:11:19.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-12-03T23:11:19.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198" } file = sled-storage/src/manager.rs:1331
5292024-12-03T23:11:19.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-12-03T23:11:19.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d" } file = sled-storage/src/manager.rs:1331
5312024-12-03T23:11:20.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-12-03T23:11:20.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/debug"), full_name: "oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/debug" } file = sled-storage/src/manager.rs:1331
5332024-12-03T23:11:20.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342024-12-03T23:11:20.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crucible" } file = sled-storage/src/manager.rs:1331
5352024-12-03T23:11:20.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362024-12-03T23:11:20.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_92da16e7-325b-473a-8169-ae1c2827470d/crucible" } file = sled-storage/src/manager.rs:1331
5372024-12-03T23:11:20.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-12-03T23:11:20.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5392024-12-03T23:11:20.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-12-03T23:11:20.364ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346" } file = sled-storage/src/manager.rs:1331
5412024-12-03T23:11:20.467ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-12-03T23:11:20.467ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5" } file = sled-storage/src/manager.rs:1331
5432024-12-03T23:11:20.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-12-03T23:11:20.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crucible" } file = sled-storage/src/manager.rs:1331
5452024-12-03T23:11:20.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-12-03T23:11:20.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/debug"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/debug" } file = sled-storage/src/manager.rs:1331
5472024-12-03T23:11:20.694ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
5482024-12-03T23:11:20.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-12-03T23:11:20.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone/oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106"), full_name: "oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/zone/oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106" } file = sled-storage/src/manager.rs:1331
5502024-12-03T23:11:20.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-12-03T23:11:20.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5522024-12-03T23:11:20.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-12-03T23:11:20.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/zone"), full_name: "oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/zone" } file = sled-storage/src/manager.rs:1331
5542024-12-03T23:11:20.986ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-12-03T23:11:20.986ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/debug"), full_name: "oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/debug" } file = sled-storage/src/manager.rs:1331
5562024-12-03T23:11:21.054ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-12-03T23:11:21.054ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/477f8969-b73f-4886-851b-8d5be079baff/crypt/zone"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/zone" } file = sled-storage/src/manager.rs:1331
5582024-12-03T23:11:21.121ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-12-03T23:11:21.121ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/zone/oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf" } file = sled-storage/src/manager.rs:1331
5602024-12-03T23:11:21.221ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-03T23:11:21.221ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/477f8969-b73f-4886-851b-8d5be079baff/crypt/zone/oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crypt/zone/oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4" } file = sled-storage/src/manager.rs:1331
5622024-12-03T23:11:21.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-12-03T23:11:21.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/zone" } file = sled-storage/src/manager.rs:1331
5642024-12-03T23:11:21.415ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-12-03T23:11:21.415ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/zone/oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92" } file = sled-storage/src/manager.rs:1331
5662024-12-03T23:11:21.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5672024-12-03T23:11:21.519ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible" } file = sled-storage/src/manager.rs:1331
5682024-12-03T23:11:21.612ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692024-12-03T23:11:21.612ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone/oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b"), full_name: "oxp_b1979523-9de1-40bb-ac9e-46203987b285/crypt/zone/oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b" } file = sled-storage/src/manager.rs:1331
5702024-12-03T23:11:21.697ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
5712024-12-03T23:11:21.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-12-03T23:11:21.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/zone/oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a" } file = sled-storage/src/manager.rs:1331
5732024-12-03T23:11:21.816ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-12-03T23:11:21.816ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_477f8969-b73f-4886-851b-8d5be079baff/crucible" } file = sled-storage/src/manager.rs:1331
5752024-12-03T23:11:21.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-12-03T23:11:21.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5772024-12-03T23:11:22.008ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-12-03T23:11:22.008ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5792024-12-03T23:11:22.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-12-03T23:11:22.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5812024-12-03T23:11:22.200ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-12-03T23:11:22.200ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b1979523-9de1-40bb-ac9e-46203987b285/crucible" } file = sled-storage/src/manager.rs:1331
5832024-12-03T23:11:22.290ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-12-03T23:11:22.290ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/debug"), full_name: "oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/debug" } file = sled-storage/src/manager.rs:1331
5852024-12-03T23:11:22.350ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5862024-12-03T23:11:22.350ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5872024-12-03T23:11:22.357ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5882024-12-03T23:11:22.357ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5892024-12-03T23:11:22.368ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902024-12-03T23:11:22.368ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5912024-12-03T23:11:22.476ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5922024-12-03T23:11:22.477ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5932024-12-03T23:11:22.477ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
5942024-12-03T23:11:22.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5883043 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54244 req_id = a5190a33-495e-4797-905c-ef6eaf6906b5 response_code = 200 uri = /datasets
5952024-12-03T23:11:22.514ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5962024-12-03T23:11:22.514ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5972024-12-03T23:11:22.529ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 5214c3b9-a28c-4198-9ebd-ca644995515b (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 19545eb3-d94d-487b-9b4e-60396e458232 (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff4752e0-8ca8-4679-9200-bf75df1bbabf (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
5982024-12-03T23:11:22.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37654
5992024-12-03T23:11:22.530ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6002024-12-03T23:11:22.530ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6012024-12-03T23:11:22.557ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6022024-12-03T23:11:22.557ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6032024-12-03T23:11:22.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6042024-12-03T23:11:22.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
6052024-12-03T23:11:22.602ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6062024-12-03T23:11:22.603ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6072024-12-03T23:11:22.610ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6082024-12-03T23:11:22.610ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6092024-12-03T23:11:22.633ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6102024-12-03T23:11:22.633ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6112024-12-03T23:11:22.637ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12328475414384137088 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6122024-12-03T23:11:22.637ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18410245635158240983 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6132024-12-03T23:11:22.640ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6142024-12-03T23:11:22.641ZINFOSledAgent (ServiceManager): No ledger in /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:188
6152024-12-03T23:11:22.641ZINFOSledAgent (ServiceManager): No ledger in /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:188
6162024-12-03T23:11:22.641ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6172024-12-03T23:11:22.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6182024-12-03T23:11:22.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6192024-12-03T23:11:22.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6202024-12-03T23:11:22.700ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6212024-12-03T23:11:22.709ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6222024-12-03T23:11:22.709ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6232024-12-03T23:11:22.755ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b file = illumos-utils/src/zone.rs:325
6242024-12-03T23:11:22.761ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232 file = illumos-utils/src/zone.rs:325
6252024-12-03T23:11:22.765ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf file = illumos-utils/src/zone.rs:325
6262024-12-03T23:11:22.776ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b file = illumos-utils/src/zone.rs:363
6272024-12-03T23:11:22.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232 file = illumos-utils/src/zone.rs:363
6282024-12-03T23:11:22.788ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf file = illumos-utils/src/zone.rs:363
6292024-12-03T23:11:22.812ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6302024-12-03T23:11:22.812ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6312024-12-03T23:11:22.844ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6322024-12-03T23:11:22.845ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/nexus.rs:527 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6332024-12-03T23:11:22.880ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6342024-12-03T23:11:22.881ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6352024-12-03T23:11:22.881ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6362024-12-03T23:11:22.881ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6372024-12-03T23:11:22.934ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6382024-12-03T23:11:23.006ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6392024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6402024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6412024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6422024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6432024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6442024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6452024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6462024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6472024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6482024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6492024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6502024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6512024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6522024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6532024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6542024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6552024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6562024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6572024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6582024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6592024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6602024-12-03T23:11:23.006ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6612024-12-03T23:11:23.397ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.037247793s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6622024-12-03T23:11:23.530ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10260760115481919046 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6632024-12-03T23:11:23.530ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12800092969812200993 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6642024-12-03T23:11:23.702ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/9497a29b-1799-4726-9b95-53dee50af36d) file = sled-agent/src/probe_manager.rs:231 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
6652024-12-03T23:11:24.354ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6662024-12-03T23:11:24.355ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6672024-12-03T23:11:24.355ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6682024-12-03T23:11:24.842ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6692024-12-03T23:11:25.322ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6702024-12-03T23:11:25.322ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6712024-12-03T23:11:25.322ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6722024-12-03T23:11:25.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 30.493602ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6732024-12-03T23:11:25.331ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6742024-12-03T23:11:25.335ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6752024-12-03T23:11:25.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 148.073543ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6762024-12-03T23:11:25.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 47.537739ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6772024-12-03T23:11:25.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 45.897254ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6782024-12-03T23:11:25.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 111.288882ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6792024-12-03T23:11:25.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 149.320541ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6802024-12-03T23:11:25.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 175.956908ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6812024-12-03T23:11:25.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 191.13143ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6822024-12-03T23:11:25.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 153.32209ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6832024-12-03T23:11:25.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 527.500277ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6842024-12-03T23:11:25.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 239.105366ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6852024-12-03T23:11:25.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 284.365077ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6862024-12-03T23:11:26.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 1.150387744s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6872024-12-03T23:11:26.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 605.111443ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6882024-12-03T23:11:26.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 691.750807ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6892024-12-03T23:11:26.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 1.071622099s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6902024-12-03T23:11:26.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 1.109193298s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6912024-12-03T23:11:27.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 782.193397ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6922024-12-03T23:11:27.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 930.416892ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6932024-12-03T23:11:28.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 1.266992158s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6942024-12-03T23:11:28.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 980.168219ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6952024-12-03T23:11:28.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 602.125886ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6962024-12-03T23:11:29.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 771.313928ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
6972024-12-03T23:11:29.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b") failed: Property not found. retry in 1.029597332s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
6982024-12-03T23:11:29.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf") failed: Property not found. retry in 1.39566573s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
6992024-12-03T23:11:29.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232") failed: Property not found. retry in 1.329894865s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
7002024-12-03T23:11:31.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_5214c3b9-a28c-4198-9ebd-ca644995515b
7012024-12-03T23:11:31.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_19545eb3-d94d-487b-9b4e-60396e458232
7022024-12-03T23:11:31.234ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_ff4752e0-8ca8-4679-9200-bf75df1bbabf
7032024-12-03T23:11:31.234ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7042024-12-03T23:11:31.234ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7052024-12-03T23:11:31.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8704883 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37654 req_id = f2d472fc-d238-47f4-8d69-57407529fd06 response_code = 204 uri = /omicron-zones
7062024-12-03T23:11:31.237ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7072024-12-03T23:11:31.287ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7082024-12-03T23:11:31.317ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 121.879291ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7092024-12-03T23:11:31.460ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7102024-12-03T23:11:31.507ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7112024-12-03T23:11:31.507ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7122024-12-03T23:11:31.538ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7132024-12-03T23:11:31.539ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7142024-12-03T23:11:31.539ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7152024-12-03T23:11:31.568ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 5214c3b9-a28c-4198-9ebd-ca644995515b (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 19545eb3-d94d-487b-9b4e-60396e458232 (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff4752e0-8ca8-4679-9200-bf75df1bbabf (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a45296e9-ff8a-43c1-ad20-3796657ee346 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 12d2c2be-382f-48a2-8904-604176218244, kind: Service { id: a45296e9-ff8a-43c1-ad20-3796657ee346 }, name: Name("ntp-a45296e9-ff8a-43c1-ad20-3796657ee346"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 89])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7162024-12-03T23:11:31.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41668
7172024-12-03T23:11:31.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7182024-12-03T23:11:31.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7192024-12-03T23:11:31.608ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7202024-12-03T23:11:31.608ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
7212024-12-03T23:11:31.643ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7222024-12-03T23:11:31.643ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7232024-12-03T23:11:31.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7242024-12-03T23:11:31.679ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
7252024-12-03T23:11:31.679ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
7262024-12-03T23:11:31.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7272024-12-03T23:11:31.690ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7282024-12-03T23:11:31.723ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7292024-12-03T23:11:31.724ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7302024-12-03T23:11:31.724ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7312024-12-03T23:11:31.753ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 229, 89]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7322024-12-03T23:11:31.753ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7332024-12-03T23:11:31.753ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7342024-12-03T23:11:31.753ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7352024-12-03T23:11:31.754ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7362024-12-03T23:11:31.755ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7372024-12-03T23:11:31.779ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346 file = illumos-utils/src/zone.rs:325
7382024-12-03T23:11:31.798ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346 file = illumos-utils/src/zone.rs:363
7392024-12-03T23:11:32.407ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7402024-12-03T23:11:32.407ZINFOSledAgent (ServiceManager): Booting oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7412024-12-03T23:11:32.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 72.841307ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7422024-12-03T23:11:32.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 146.230663ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7432024-12-03T23:11:32.640ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12328475414384137088 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7442024-12-03T23:11:32.641ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18410245635158240983 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7452024-12-03T23:11:32.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 270.865763ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7462024-12-03T23:11:33.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 262.822175ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7472024-12-03T23:11:33.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 497.157957ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7482024-12-03T23:11:33.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10260760115481919046 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7492024-12-03T23:11:33.532ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12800092969812200993 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7502024-12-03T23:11:33.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 1.273623032s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7512024-12-03T23:11:35.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 1.089476687s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7522024-12-03T23:11:36.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346") failed: Property not found. retry in 1.444192577s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7532024-12-03T23:11:37.696ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346
7542024-12-03T23:11:37.696ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7552024-12-03T23:11:37.697ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7562024-12-03T23:11:37.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6128493 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41668 req_id = e83a17f7-06d3-416a-afc1-3b3cf9bdcb07 response_code = 204 uri = /omicron-zones
7572024-12-03T23:11:37.699ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7582024-12-03T23:11:37.730ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7592024-12-03T23:11:37.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61860
7602024-12-03T23:11:37.740ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7612024-12-03T23:11:37.740ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61860 req_id = 7b2e6ca1-37c8-4f6c-9af8-9d62e00bc984 response_code = 500 uri = /timesync
7622024-12-03T23:11:37.743ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7632024-12-03T23:11:37.876ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7642024-12-03T23:11:37.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63864
7652024-12-03T23:11:40.441ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11100311968294274312 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7662024-12-03T23:11:40.891ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3886446014531553744 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7672024-12-03T23:11:41.237ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4774353651083839220 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7682024-12-03T23:11:41.884ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7692024-12-03T23:11:41.885ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63864 req_id = 7ef0a87e-8f81-49c5-ac14-cf5cb6454b46 response_code = 500 uri = /timesync
7702024-12-03T23:11:41.888ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7712024-12-03T23:11:42.062ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7722024-12-03T23:11:42.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35373
7732024-12-03T23:11:42.071ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7742024-12-03T23:11:42.072ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35373 req_id = 91e740c7-f88f-4842-b155-beec6c217f42 response_code = 500 uri = /timesync
7752024-12-03T23:11:42.074ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7762024-12-03T23:11:42.211ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7772024-12-03T23:11:42.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55882
7782024-12-03T23:11:42.643ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12328475414384137088 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7792024-12-03T23:11:42.643ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18410245635158240983 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7802024-12-03T23:11:43.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10260760115481919046 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7812024-12-03T23:11:43.534ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12800092969812200993 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
7822024-12-03T23:11:46.219ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a45296e9-ff8a-43c1-ad20-3796657ee346': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7832024-12-03T23:11:46.219ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008876 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55882 req_id = bde86016-2683-48c1-a8c7-a66a4c08e30e response_code = 500 uri = /timesync
7842024-12-03T23:11:46.222ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7852024-12-03T23:11:46.505ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7862024-12-03T23:11:46.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35194
7872024-12-03T23:11:46.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9093 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35194 req_id = 1794b104-6a6c-40ca-b5a7-32a70d3c8a2c response_code = 200 uri = /timesync
7882024-12-03T23:11:46.518ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.051504858 } file = sled-agent/src/rack_setup/service.rs:743
7892024-12-03T23:11:46.518ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7902024-12-03T23:11:46.816ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7912024-12-03T23:11:46.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46628
7922024-12-03T23:11:46.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8899 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46628 req_id = 9e5a5c89-ee25-4338-8d44-f3411690bdad response_code = 200 uri = /timesync
7932024-12-03T23:11:46.829ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.050660077 } file = sled-agent/src/rack_setup/service.rs:743
7942024-12-03T23:11:46.829ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7952024-12-03T23:11:46.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7962024-12-03T23:11:46.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44246
7972024-12-03T23:11:47.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44246 req_id = 3efd78d6-a131-46e5-b066-09b1313298e8 response_code = 200 uri = /timesync
7982024-12-03T23:11:47.005ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 398108674, ip_addr: 23.186.168.2, stratum: 3, ref_time: 1733267506.2969248, correction: -0.050731245 } file = sled-agent/src/rack_setup/service.rs:743
7992024-12-03T23:11:47.005ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8002024-12-03T23:11:47.380ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8012024-12-03T23:11:47.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36636
8022024-12-03T23:11:47.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18776 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36636 req_id = 3a85a153-b6b6-4de7-8797-860373b419ab response_code = 200 uri = /timesync
8032024-12-03T23:11:47.403ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 398108674, ip_addr: 23.186.168.2, stratum: 3, ref_time: 1733267506.2969248, correction: -0.049685154 } file = sled-agent/src/rack_setup/service.rs:743
8042024-12-03T23:11:47.403ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8052024-12-03T23:11:47.433ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 5214c3b9-a28c-4198-9ebd-ca644995515b (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 19545eb3-d94d-487b-9b4e-60396e458232 (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff4752e0-8ca8-4679-9200-bf75df1bbabf (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a45296e9-ff8a-43c1-ad20-3796657ee346 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 12d2c2be-382f-48a2-8904-604176218244, kind: Service { id: a45296e9-ff8a-43c1-ad20-3796657ee346 }, name: Name("ntp-a45296e9-ff8a-43c1-ad20-3796657ee346"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 89])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: dfd5c5e5-4591-433d-a76b-ec49815c0b86 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: f69d65ab-a718-4a27-a728-8ba9afce654a (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 51c64dbb-4582-4b52-af81-992d5fe0912b (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } } } }, OmicronZoneConfig { id: ae51a408-82be-4db5-973a-92a68664b70c (service), filesystem_pool: Some(ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External } } } }, OmicronZoneConfig { id: f4a5af66-4f40-4244-8321-18fbf3b00bac (service), filesystem_pool: Some(ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8062024-12-03T23:11:47.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41348
8072024-12-03T23:11:47.433ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8082024-12-03T23:11:47.433ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8092024-12-03T23:11:47.473ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8102024-12-03T23:11:47.473ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
8112024-12-03T23:11:47.503ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8122024-12-03T23:11:47.503ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }
8132024-12-03T23:11:47.534ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dfd5c5e5-4591-433d-a76b-ec49815c0b86, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8142024-12-03T23:11:47.534ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: dfd5c5e5-4591-433d-a76b-ec49815c0b86, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8152024-12-03T23:11:47.566ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f69d65ab-a718-4a27-a728-8ba9afce654a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8162024-12-03T23:11:47.566ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f69d65ab-a718-4a27-a728-8ba9afce654a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Cockroach }, responder: ... }
8172024-12-03T23:11:47.598ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 51c64dbb-4582-4b52-af81-992d5fe0912b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8182024-12-03T23:11:47.598ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 51c64dbb-4582-4b52-af81-992d5fe0912b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Cockroach }, responder: ... }
8192024-12-03T23:11:47.629ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ae51a408-82be-4db5-973a-92a68664b70c, dataset_name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8202024-12-03T23:11:47.630ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ae51a408-82be-4db5-973a-92a68664b70c, dataset_name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Cockroach }, responder: ... }
8212024-12-03T23:11:47.663ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f4a5af66-4f40-4244-8321-18fbf3b00bac, dataset_name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8222024-12-03T23:11:47.663ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f4a5af66-4f40-4244-8321-18fbf3b00bac, dataset_name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8232024-12-03T23:11:47.694ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8242024-12-03T23:11:47.694ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
8252024-12-03T23:11:47.694ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
8262024-12-03T23:11:47.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8272024-12-03T23:11:47.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8282024-12-03T23:11:47.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8292024-12-03T23:11:47.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8302024-12-03T23:11:47.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8312024-12-03T23:11:47.776ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8322024-12-03T23:11:47.863ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b file = illumos-utils/src/zone.rs:325
8332024-12-03T23:11:47.867ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a file = illumos-utils/src/zone.rs:325
8342024-12-03T23:11:47.871ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c file = illumos-utils/src/zone.rs:325
8352024-12-03T23:11:47.875ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac file = illumos-utils/src/zone.rs:325
8362024-12-03T23:11:47.880ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86 file = illumos-utils/src/zone.rs:325
8372024-12-03T23:11:47.884ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b file = illumos-utils/src/zone.rs:363
8382024-12-03T23:11:47.889ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a file = illumos-utils/src/zone.rs:363
8392024-12-03T23:11:47.893ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c file = illumos-utils/src/zone.rs:363
8402024-12-03T23:11:47.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac file = illumos-utils/src/zone.rs:363
8412024-12-03T23:11:47.902ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86 file = illumos-utils/src/zone.rs:363
8422024-12-03T23:11:50.458ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 294.185541ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
8432024-12-03T23:11:50.865ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='dfd5c5e5-4591-433d-a76b-ec49815c0b86'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8442024-12-03T23:11:50.865ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8452024-12-03T23:11:50.880ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ae51a408-82be-4db5-973a-92a68664b70c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8462024-12-03T23:11:50.880ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8472024-12-03T23:11:50.907ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f4a5af66-4f40-4244-8321-18fbf3b00bac'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8482024-12-03T23:11:50.907ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f69d65ab-a718-4a27-a728-8ba9afce654a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8492024-12-03T23:11:50.907ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8502024-12-03T23:11:50.913ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8512024-12-03T23:11:50.968ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='51c64dbb-4582-4b52-af81-992d5fe0912b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8522024-12-03T23:11:50.968ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8532024-12-03T23:11:51.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 41.438468ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8542024-12-03T23:11:51.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 26.857011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8552024-12-03T23:11:51.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 69.633037ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8562024-12-03T23:11:51.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 50.700765ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8572024-12-03T23:11:51.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 122.021828ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8582024-12-03T23:11:51.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 148.235207ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8592024-12-03T23:11:51.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 84.911119ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8602024-12-03T23:11:51.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 211.81959ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8612024-12-03T23:11:51.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 60.12971ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8622024-12-03T23:11:51.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 156.229549ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8632024-12-03T23:11:51.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 43.001537ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8642024-12-03T23:11:51.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 169.589729ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8652024-12-03T23:11:52.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 386.421558ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8662024-12-03T23:11:52.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 201.064346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8672024-12-03T23:11:52.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 387.33445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8682024-12-03T23:11:52.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 78.955166ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8692024-12-03T23:11:52.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 283.974298ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8702024-12-03T23:11:52.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 573.173292ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8712024-12-03T23:11:52.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 164.070232ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8722024-12-03T23:11:52.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 617.876069ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8732024-12-03T23:11:52.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 231.233145ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8742024-12-03T23:11:52.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 920.415457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8752024-12-03T23:11:52.574ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34984
8762024-12-03T23:11:52.585ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34984 req_id = 6354ba70-76f1-49de-b117-4a3f30c4652e response_code = 200 uri = /baseboard
8772024-12-03T23:11:52.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 997.310757ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8782024-12-03T23:11:52.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 1.087653635s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8792024-12-03T23:11:52.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 874.153113ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8802024-12-03T23:11:53.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 1.358046404s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8812024-12-03T23:11:53.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 887.058936ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8822024-12-03T23:11:53.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 565.001767ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8832024-12-03T23:11:53.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 695.203479ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8842024-12-03T23:11:53.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 921.661109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8852024-12-03T23:11:54.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 1.021776973s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8862024-12-03T23:11:54.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 639.475512ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8872024-12-03T23:11:54.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 838.581447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8882024-12-03T23:11:54.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 577.707165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8892024-12-03T23:11:54.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 714.027898ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8902024-12-03T23:11:55.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 1.132582013s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8912024-12-03T23:11:55.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 525.725792ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8922024-12-03T23:11:55.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 674.628708ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8932024-12-03T23:11:55.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 992.257076ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8942024-12-03T23:11:55.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 1.248554264s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
8952024-12-03T23:11:55.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 692.128346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
8962024-12-03T23:11:55.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 1.144362547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
8972024-12-03T23:11:56.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 570.211598ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
8982024-12-03T23:11:56.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 660.691072ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
8992024-12-03T23:11:56.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 1.286599283s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
9002024-12-03T23:11:56.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 1.311297741s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
9012024-12-03T23:11:56.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 1.15126626s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
9022024-12-03T23:11:57.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 1.215721166s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
9032024-12-03T23:11:57.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 551.339906ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
9042024-12-03T23:11:57.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 798.560569ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
9052024-12-03T23:11:57.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 1.252912936s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
9062024-12-03T23:11:57.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 839.134962ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
9072024-12-03T23:11:58.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 1.164206176s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
9082024-12-03T23:11:58.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 633.88658ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
9092024-12-03T23:11:58.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 1.269315942s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
9102024-12-03T23:11:58.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 1.444759031s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
9112024-12-03T23:11:58.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 978.107404ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
9122024-12-03T23:11:59.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 1.429862621s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
9132024-12-03T23:11:59.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 1.220664577s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
9142024-12-03T23:11:59.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 1.26088994s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
9152024-12-03T23:11:59.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 640.147489ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
9162024-12-03T23:12:00.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 894.39624ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
9172024-12-03T23:12:00.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c") failed: Property not found. retry in 1.354208422s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
9182024-12-03T23:12:00.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac") failed: Property not found. retry in 1.450561874s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
9192024-12-03T23:12:00.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 867.666348ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
9202024-12-03T23:12:00.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86") failed: Property not found. retry in 1.187584366s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
9212024-12-03T23:12:01.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b") failed: Property not found. retry in 1.151206225s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
9222024-12-03T23:12:01.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a") failed: Property not found. retry in 1.068600932s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
9232024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b
9242024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f69d65ab-a718-4a27-a728-8ba9afce654a
9252024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ae51a408-82be-4db5-973a-92a68664b70c
9262024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_f4a5af66-4f40-4244-8321-18fbf3b00bac
9272024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_dfd5c5e5-4591-433d-a76b-ec49815c0b86
9282024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9292024-12-03T23:12:02.471ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9302024-12-03T23:12:02.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15080728 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41348 req_id = ce7c8722-617a-470e-977b-57d650c2ec99 response_code = 204 uri = /omicron-zones
9312024-12-03T23:12:02.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51322
9322024-12-03T23:12:02.532ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = 8eb973ee-8ba0-4cb9-be60-ae10593892c0 response_code = 500 uri = /cockroachdb
9332024-12-03T23:12:02.533ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8eb973ee-8ba0-4cb9-be60-ae10593892c0", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8eb973ee-8ba0-4cb9-be60-ae10593892c0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 127.459013ms
9342024-12-03T23:12:02.689ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28269 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = dfb945fc-13cd-4d2c-a716-6fa3ad848e66 response_code = 500 uri = /cockroachdb
9352024-12-03T23:12:02.689ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dfb945fc-13cd-4d2c-a716-6fa3ad848e66", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dfb945fc-13cd-4d2c-a716-6fa3ad848e66" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 165.65441ms
9362024-12-03T23:12:02.885ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29031 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = d09bcf87-9986-4c51-a2ee-f7263c7f7cc5 response_code = 500 uri = /cockroachdb
9372024-12-03T23:12:02.885ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d09bcf87-9986-4c51-a2ee-f7263c7f7cc5", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d09bcf87-9986-4c51-a2ee-f7263c7f7cc5" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 211.188424ms
9382024-12-03T23:12:03.124ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27409 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = 75f2975d-8b52-4bd9-8f6c-e748d87a22c7 response_code = 500 uri = /cockroachdb
9392024-12-03T23:12:03.124ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "75f2975d-8b52-4bd9-8f6c-e748d87a22c7", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "75f2975d-8b52-4bd9-8f6c-e748d87a22c7" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 170.972372ms
9402024-12-03T23:12:03.322ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26367 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = bf758795-10fa-4426-8cba-3f3e54faf072 response_code = 500 uri = /cockroachdb
9412024-12-03T23:12:03.323ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bf758795-10fa-4426-8cba-3f3e54faf072", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bf758795-10fa-4426-8cba-3f3e54faf072" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 147.446742ms
9422024-12-03T23:12:03.498ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = 6f47c6fc-eac5-4592-a884-143e624be330 response_code = 500 uri = /cockroachdb
9432024-12-03T23:12:03.498ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6f47c6fc-eac5-4592-a884-143e624be330", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6f47c6fc-eac5-4592-a884-143e624be330" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 309.76021ms
9442024-12-03T23:12:03.833ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24545 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = aefdca75-8ca8-4b13-b444-486d321bdcb7 response_code = 500 uri = /cockroachdb
9452024-12-03T23:12:03.833ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aefdca75-8ca8-4b13-b444-486d321bdcb7", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aefdca75-8ca8-4b13-b444-486d321bdcb7" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 444.434415ms
9462024-12-03T23:12:04.308ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29952 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = f7514573-4460-4c19-84f9-c4020a83be77 response_code = 500 uri = /cockroachdb
9472024-12-03T23:12:04.309ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f7514573-4460-4c19-84f9-c4020a83be77", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f7514573-4460-4c19-84f9-c4020a83be77" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 236.70841ms
9482024-12-03T23:12:04.574ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = 2292788d-7ca1-4cdf-850a-ff58c9bfeabf response_code = 500 uri = /cockroachdb
9492024-12-03T23:12:04.574ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2292788d-7ca1-4cdf-850a-ff58c9bfeabf", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2292788d-7ca1-4cdf-850a-ff58c9bfeabf" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 290.80395ms
9502024-12-03T23:12:04.893ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_51c64dbb-4582-4b52-af81-992d5fe0912b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = 3b1f0c36-2976-4932-9ee9-45707445cc73 response_code = 500 uri = /cockroachdb
9512024-12-03T23:12:04.893ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3b1f0c36-2976-4932-9ee9-45707445cc73", "content-length": "124", "date": "Tue, 03 Dec 2024 23:12:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3b1f0c36-2976-4932-9ee9-45707445cc73" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 732.754491ms
9522024-12-03T23:12:05.655ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3743
9532024-12-03T23:12:22.516ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
9542024-12-03T23:12:38.556ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
9552024-12-03T23:12:38.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32931180 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51322 req_id = 32619de4-2da3-452d-9711-4ba72876efbc response_code = 204 uri = /cockroachdb
9562024-12-03T23:12:38.561ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54693
9572024-12-03T23:12:38.567ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 264.009769ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
9582024-12-03T23:12:38.603ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 5214c3b9-a28c-4198-9ebd-ca644995515b (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 19545eb3-d94d-487b-9b4e-60396e458232 (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: ff4752e0-8ca8-4679-9200-bf75df1bbabf (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a45296e9-ff8a-43c1-ad20-3796657ee346 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 12d2c2be-382f-48a2-8904-604176218244, kind: Service { id: a45296e9-ff8a-43c1-ad20-3796657ee346 }, name: Name("ntp-a45296e9-ff8a-43c1-ad20-3796657ee346"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 89])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: dfd5c5e5-4591-433d-a76b-ec49815c0b86 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: f69d65ab-a718-4a27-a728-8ba9afce654a (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 51c64dbb-4582-4b52-af81-992d5fe0912b (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } } } }, OmicronZoneConfig { id: ae51a408-82be-4db5-973a-92a68664b70c (service), filesystem_pool: Some(ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External } } } }, OmicronZoneConfig { id: f4a5af66-4f40-4244-8321-18fbf3b00bac (service), filesystem_pool: Some(ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: cefcc61a-604d-424b-9499-5472a7e36656 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 (service), filesystem_pool: Some(ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d4da8d56-b5c2-41ca-9c75-cd3415fd634d (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 0df78535-c4ad-4fe8-8d6f-0dd84ea413f5 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7 (service), filesystem_pool: Some(ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 63fe980e-3ab0-485a-84b9-5cb330c0b9f4 (service), filesystem_pool: Some(ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 4df70ca3-bfb5-42be-9958-d29c6c820d61 (service), filesystem_pool: Some(ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: af4d2368-a81b-4174-aa08-7829c291ff92 (service), filesystem_pool: Some(ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7c46e9b1-a557-4d78-8772-ce23a633f25a (service), filesystem_pool: Some(ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External } } } }, OmicronZoneConfig { id: 562bf5e5-6372-49fb-9d89-d8f7b0d2f198 (service), filesystem_pool: Some(ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External } } } }, OmicronZoneConfig { id: a76be880-e7dc-4aae-b22a-cf02c2d5da11 (service), filesystem_pool: Some(ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External } } } }, OmicronZoneConfig { id: f704b582-8df5-4f82-9eb4-1bc8077ed7ec (service), filesystem_pool: Some(ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External } } } }, OmicronZoneConfig { id: b78235cb-ee94-4f69-8a04-012dd0a16e00 (service), filesystem_pool: Some(ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External } } } }, OmicronZoneConfig { id: e6a85ccf-1626-433e-a842-729751be286b (service), filesystem_pool: Some(ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External } } } }, OmicronZoneConfig { id: fef86ed4-ef71-40e2-8603-7b9e890ae753 (service), filesystem_pool: Some(ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4c05fd57-36cb-45b0-89f9-c6754520a828 (service), filesystem_pool: Some(ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9592024-12-03T23:12:38.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47628
9602024-12-03T23:12:38.604ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9612024-12-03T23:12:38.604ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5214c3b9-a28c-4198-9ebd-ca644995515b, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9622024-12-03T23:12:38.668ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9632024-12-03T23:12:38.668ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 19545eb3-d94d-487b-9b4e-60396e458232, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
9642024-12-03T23:12:38.735ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9652024-12-03T23:12:38.735ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff4752e0-8ca8-4679-9200-bf75df1bbabf, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: InternalDns }, responder: ... }
9662024-12-03T23:12:38.800ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dfd5c5e5-4591-433d-a76b-ec49815c0b86, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9672024-12-03T23:12:38.800ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: dfd5c5e5-4591-433d-a76b-ec49815c0b86, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9682024-12-03T23:12:38.859ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f69d65ab-a718-4a27-a728-8ba9afce654a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9692024-12-03T23:12:38.859ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f69d65ab-a718-4a27-a728-8ba9afce654a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Cockroach }, responder: ... }
9702024-12-03T23:12:38.915ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 51c64dbb-4582-4b52-af81-992d5fe0912b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9712024-12-03T23:12:38.915ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 51c64dbb-4582-4b52-af81-992d5fe0912b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Cockroach }, responder: ... }
9722024-12-03T23:12:39.013ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ae51a408-82be-4db5-973a-92a68664b70c, dataset_name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9732024-12-03T23:12:39.013ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ae51a408-82be-4db5-973a-92a68664b70c, dataset_name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Cockroach }, responder: ... }
9742024-12-03T23:12:39.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f4a5af66-4f40-4244-8321-18fbf3b00bac, dataset_name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9752024-12-03T23:12:39.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f4a5af66-4f40-4244-8321-18fbf3b00bac, dataset_name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9762024-12-03T23:12:39.157ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 171286db-25de-47f2-bf8e-94bd6450ccc8, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9772024-12-03T23:12:39.157ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 171286db-25de-47f2-bf8e-94bd6450ccc8, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9782024-12-03T23:12:39.218ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9792024-12-03T23:12:39.218ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9802024-12-03T23:12:39.297ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0df78535-c4ad-4fe8-8d6f-0dd84ea413f5, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
9812024-12-03T23:12:39.297ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 0df78535-c4ad-4fe8-8d6f-0dd84ea413f5, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9822024-12-03T23:12:39.368ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af4d2368-a81b-4174-aa08-7829c291ff92, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9832024-12-03T23:12:39.368ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: af4d2368-a81b-4174-aa08-7829c291ff92, dataset_name: DatasetName { pool_name: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, kind: Crucible }, responder: ... }
9842024-12-03T23:12:39.445ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7c46e9b1-a557-4d78-8772-ce23a633f25a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9852024-12-03T23:12:39.445ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7c46e9b1-a557-4d78-8772-ce23a633f25a, dataset_name: DatasetName { pool_name: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, kind: Crucible }, responder: ... }
9862024-12-03T23:12:39.515ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 562bf5e5-6372-49fb-9d89-d8f7b0d2f198, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9872024-12-03T23:12:39.515ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 562bf5e5-6372-49fb-9d89-d8f7b0d2f198, dataset_name: DatasetName { pool_name: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, kind: Crucible }, responder: ... }
9882024-12-03T23:12:39.576ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a76be880-e7dc-4aae-b22a-cf02c2d5da11, dataset_name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9892024-12-03T23:12:39.576ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a76be880-e7dc-4aae-b22a-cf02c2d5da11, dataset_name: DatasetName { pool_name: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, kind: Crucible }, responder: ... }
9902024-12-03T23:12:39.639ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f704b582-8df5-4f82-9eb4-1bc8077ed7ec, dataset_name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9912024-12-03T23:12:39.639ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f704b582-8df5-4f82-9eb4-1bc8077ed7ec, dataset_name: DatasetName { pool_name: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, kind: Crucible }, responder: ... }
9922024-12-03T23:12:39.720ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b78235cb-ee94-4f69-8a04-012dd0a16e00, dataset_name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9932024-12-03T23:12:39.720ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b78235cb-ee94-4f69-8a04-012dd0a16e00, dataset_name: DatasetName { pool_name: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, kind: Crucible }, responder: ... }
9942024-12-03T23:12:39.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e6a85ccf-1626-433e-a842-729751be286b, dataset_name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9952024-12-03T23:12:39.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e6a85ccf-1626-433e-a842-729751be286b, dataset_name: DatasetName { pool_name: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, kind: Crucible }, responder: ... }
9962024-12-03T23:12:39.889ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fef86ed4-ef71-40e2-8603-7b9e890ae753, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9972024-12-03T23:12:39.889ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fef86ed4-ef71-40e2-8603-7b9e890ae753, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, kind: Crucible }, responder: ... }
9982024-12-03T23:12:39.974ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4c05fd57-36cb-45b0-89f9-c6754520a828, dataset_name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9992024-12-03T23:12:39.974ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4c05fd57-36cb-45b0-89f9-c6754520a828, dataset_name: DatasetName { pool_name: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, kind: Crucible }, responder: ... }
10002024-12-03T23:12:40.054ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10012024-12-03T23:12:40.054ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
10022024-12-03T23:12:40.055ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
10032024-12-03T23:12:40.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10042024-12-03T23:12:40.170ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10052024-12-03T23:12:40.210ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10062024-12-03T23:12:40.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10072024-12-03T23:12:40.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10082024-12-03T23:12:40.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10092024-12-03T23:12:40.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10102024-12-03T23:12:40.248ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10112024-12-03T23:12:40.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10122024-12-03T23:12:40.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10132024-12-03T23:12:40.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10142024-12-03T23:12:40.459ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10152024-12-03T23:12:40.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10162024-12-03T23:12:40.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10172024-12-03T23:12:40.459ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10182024-12-03T23:12:40.462ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10192024-12-03T23:12:40.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10202024-12-03T23:12:40.487ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10212024-12-03T23:12:40.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10222024-12-03T23:12:40.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10232024-12-03T23:12:40.487ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198 file = illumos-utils/src/zone.rs:325
10242024-12-03T23:12:40.492ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = illumos-utils/src/zone.rs:325
10252024-12-03T23:12:40.497ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00 file = illumos-utils/src/zone.rs:325
10262024-12-03T23:12:40.502ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753 file = illumos-utils/src/zone.rs:325
10272024-12-03T23:12:40.508ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5 file = illumos-utils/src/zone.rs:325
10282024-12-03T23:12:40.513ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92 file = illumos-utils/src/zone.rs:325
10292024-12-03T23:12:40.517ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b file = illumos-utils/src/zone.rs:325
10302024-12-03T23:12:40.523ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61 file = illumos-utils/src/zone.rs:325
10312024-12-03T23:12:40.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198 file = illumos-utils/src/zone.rs:363
10322024-12-03T23:12:40.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d file = illumos-utils/src/zone.rs:363
10332024-12-03T23:12:40.663ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00 file = illumos-utils/src/zone.rs:363
10342024-12-03T23:12:40.667ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753 file = illumos-utils/src/zone.rs:363
10352024-12-03T23:12:40.672ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5 file = illumos-utils/src/zone.rs:363
10362024-12-03T23:12:40.679ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92 file = illumos-utils/src/zone.rs:363
10372024-12-03T23:12:40.683ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b file = illumos-utils/src/zone.rs:363
10382024-12-03T23:12:40.688ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61 file = illumos-utils/src/zone.rs:363
10392024-12-03T23:12:40.693ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11 file = illumos-utils/src/zone.rs:325
10402024-12-03T23:12:40.698ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec file = illumos-utils/src/zone.rs:325
10412024-12-03T23:12:40.704ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828 file = illumos-utils/src/zone.rs:325
10422024-12-03T23:12:40.709ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4 file = illumos-utils/src/zone.rs:325
10432024-12-03T23:12:40.716ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a file = illumos-utils/src/zone.rs:325
10442024-12-03T23:12:40.722ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7 file = illumos-utils/src/zone.rs:325
10452024-12-03T23:12:40.801ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10462024-12-03T23:12:40.802ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11 file = illumos-utils/src/zone.rs:363
10472024-12-03T23:12:40.823ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec file = illumos-utils/src/zone.rs:363
10482024-12-03T23:12:40.867ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828 file = illumos-utils/src/zone.rs:363
10492024-12-03T23:12:40.891ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4 file = illumos-utils/src/zone.rs:363
10502024-12-03T23:12:40.904ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a file = illumos-utils/src/zone.rs:363
10512024-12-03T23:12:40.917ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7 file = illumos-utils/src/zone.rs:363
10522024-12-03T23:12:40.992ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10532024-12-03T23:12:40.996ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10542024-12-03T23:12:40.996ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10552024-12-03T23:12:41.052ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 150, 223]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10562024-12-03T23:12:41.052ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
10572024-12-03T23:12:41.054ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10582024-12-03T23:12:41.054ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10592024-12-03T23:12:41.108ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 214, 126]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10602024-12-03T23:12:41.108ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
10612024-12-03T23:12:41.166ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10622024-12-03T23:12:41.227ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10632024-12-03T23:12:41.288ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10642024-12-03T23:12:41.291ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10652024-12-03T23:12:41.291ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10662024-12-03T23:12:41.353ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 168, 133]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10672024-12-03T23:12:41.353ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
10682024-12-03T23:12:41.354ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
10692024-12-03T23:12:41.354ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
10702024-12-03T23:12:41.354ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
10712024-12-03T23:12:41.354ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
10722024-12-03T23:12:41.356ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10732024-12-03T23:12:41.356ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10742024-12-03T23:12:41.408ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 245, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10752024-12-03T23:12:41.408ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
10762024-12-03T23:12:41.409ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10772024-12-03T23:12:41.409ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10782024-12-03T23:12:41.459ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 213, 171]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10792024-12-03T23:12:41.459ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
10802024-12-03T23:12:41.459ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
10812024-12-03T23:12:41.460ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
10822024-12-03T23:12:41.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10832024-12-03T23:12:41.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10842024-12-03T23:12:41.540ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
10852024-12-03T23:12:41.540ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
10862024-12-03T23:12:41.542ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656 file = illumos-utils/src/zone.rs:325
10872024-12-03T23:12:41.552ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
10882024-12-03T23:12:41.552ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
10892024-12-03T23:12:41.552ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
10902024-12-03T23:12:41.552ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
10912024-12-03T23:12:41.552ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
10922024-12-03T23:12:41.555ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10932024-12-03T23:12:41.555ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
10942024-12-03T23:12:41.558ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
10952024-12-03T23:12:41.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10962024-12-03T23:12:41.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10972024-12-03T23:12:41.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656 file = illumos-utils/src/zone.rs:363
10982024-12-03T23:12:41.609ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106 file = illumos-utils/src/zone.rs:325
10992024-12-03T23:12:41.697ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8 file = illumos-utils/src/zone.rs:325
11002024-12-03T23:12:41.709ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106 file = illumos-utils/src/zone.rs:363
11012024-12-03T23:12:41.720ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a file = illumos-utils/src/zone.rs:325
11022024-12-03T23:12:41.731ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e file = illumos-utils/src/zone.rs:325
11032024-12-03T23:12:41.741ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8 file = illumos-utils/src/zone.rs:363
11042024-12-03T23:12:41.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a file = illumos-utils/src/zone.rs:363
11052024-12-03T23:12:41.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e file = illumos-utils/src/zone.rs:363
11062024-12-03T23:12:53.412ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11072024-12-03T23:12:53.414ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
11082024-12-03T23:12:53.441ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11092024-12-03T23:12:53.441ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
11102024-12-03T23:12:53.453ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_477f8969-b73f-4886-851b-8d5be079baff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='16eb355f-8230-48fa-ac2c-a1605bff0b13'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11112024-12-03T23:12:53.454ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='deeb56c5-9867-4a87-a141-d9a24deb938c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11122024-12-03T23:12:53.455ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_88c18331-f96d-4496-b80c-5b839f36e5ec/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3f978a15-2783-4dc1-9756-c8b7e12b0942'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11132024-12-03T23:12:53.456ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='66a46587-e386-4ed5-ba66-0abc58c067dc'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11142024-12-03T23:12:53.456ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_92da16e7-325b-473a-8169-ae1c2827470d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cd4f0331-4a93-44b1-a10f-c51eddae752f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11152024-12-03T23:12:53.456ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5f75eb37-e61b-4e90-ab96-eca80d3a14d0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11162024-12-03T23:12:53.457ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5cf10be6-b131-4e35-b7f1-e16e7234426e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11172024-12-03T23:12:53.458ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b1979523-9de1-40bb-ac9e-46203987b285/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bfefc379-a88e-4768-b351-fc040486887b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11182024-12-03T23:12:53.458ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
11192024-12-03T23:12:53.467ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
11202024-12-03T23:12:53.474ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
11212024-12-03T23:12:53.482ZINFOSledAgent (ServiceManager): Booting oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
11222024-12-03T23:12:53.490ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
11232024-12-03T23:12:53.497ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
11242024-12-03T23:12:53.503ZINFOSledAgent (ServiceManager): Booting oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
11252024-12-03T23:12:53.510ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
11262024-12-03T23:12:53.772ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11272024-12-03T23:12:53.772ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
11282024-12-03T23:12:53.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 47.769857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
11292024-12-03T23:12:53.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 34.496691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
11302024-12-03T23:12:53.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 52.483972ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
11312024-12-03T23:12:53.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 64.641121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
11322024-12-03T23:12:53.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 71.407834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
11332024-12-03T23:12:53.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 70.555144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
11342024-12-03T23:12:53.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 71.663982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
11352024-12-03T23:12:53.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 53.174034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
11362024-12-03T23:12:54.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 128.617567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
11372024-12-03T23:12:54.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 63.387333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
11382024-12-03T23:12:54.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 143.561354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
11392024-12-03T23:12:54.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 92.840175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
11402024-12-03T23:12:54.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 53.068894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
11412024-12-03T23:12:54.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 135.912552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
11422024-12-03T23:12:54.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 31.162698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
11432024-12-03T23:12:54.947ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4c100ab1-a178-4e44-becb-dda4c3b8c13f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11442024-12-03T23:12:54.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 51.449672ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
11452024-12-03T23:12:54.975ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 574.329468ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
11462024-12-03T23:12:54.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 107.820983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
11472024-12-03T23:12:55.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 118.796711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
11482024-12-03T23:12:55.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 58.136432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
11492024-12-03T23:12:55.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 105.562223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
11502024-12-03T23:12:55.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 160.254786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
11512024-12-03T23:12:55.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 109.31621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
11522024-12-03T23:12:55.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 203.54491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
11532024-12-03T23:12:55.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 115.982834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
11542024-12-03T23:12:55.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 142.505635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
11552024-12-03T23:12:55.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 115.653569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
11562024-12-03T23:12:55.158ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
11572024-12-03T23:12:55.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 64.018115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
11582024-12-03T23:12:55.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 273.304393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
11592024-12-03T23:12:55.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 208.298952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
11602024-12-03T23:12:55.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 123.074935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
11612024-12-03T23:12:55.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 554.634567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
11622024-12-03T23:12:55.234ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='d4da8d56-b5c2-41ca-9c75-cd3415fd634d'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11632024-12-03T23:12:55.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 479.580157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
11642024-12-03T23:12:55.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 285.493655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
11652024-12-03T23:12:55.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 411.769896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
11662024-12-03T23:12:55.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 201.015018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
11672024-12-03T23:12:55.284ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
11682024-12-03T23:12:55.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 431.227517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
11692024-12-03T23:12:55.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 205.124021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
11702024-12-03T23:12:55.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 227.555957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
11712024-12-03T23:12:55.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 180.467341ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
11722024-12-03T23:12:55.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 257.48016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
11732024-12-03T23:12:55.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 60.081815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
11742024-12-03T23:12:55.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 392.260983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
11752024-12-03T23:12:55.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 399.835166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
11762024-12-03T23:12:55.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 51.582784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
11772024-12-03T23:12:55.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 321.544674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
11782024-12-03T23:12:55.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 31.947463ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
11792024-12-03T23:12:55.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 428.764236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
11802024-12-03T23:12:55.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 1.085365613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
11812024-12-03T23:12:55.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 695.996411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
11822024-12-03T23:12:55.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 270.140918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
11832024-12-03T23:12:55.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 73.072926ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
11842024-12-03T23:12:55.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 756.340829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
11852024-12-03T23:12:55.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 228.318531ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
11862024-12-03T23:12:55.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 715.863284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
11872024-12-03T23:12:55.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 1.134417236s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
11882024-12-03T23:12:55.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 680.83713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
11892024-12-03T23:12:55.754ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-12-03T23:12:55.755ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
11912024-12-03T23:12:55.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 1.130781455s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
11922024-12-03T23:12:55.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 616.349956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
11932024-12-03T23:12:55.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 470.585017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
11942024-12-03T23:12:55.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 456.622616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
11952024-12-03T23:12:55.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 1.075883573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
11962024-12-03T23:12:55.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 244.879418ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
11972024-12-03T23:12:55.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 70.590172ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
11982024-12-03T23:12:56.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 597.582093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
11992024-12-03T23:12:56.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 95.229285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12002024-12-03T23:12:56.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 179.099717ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12012024-12-03T23:12:56.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 505.00509ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
12022024-12-03T23:12:56.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 1.427206953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
12032024-12-03T23:12:56.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 795.413052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
12042024-12-03T23:12:56.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 475.78428ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12052024-12-03T23:12:56.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 1.448927981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
12062024-12-03T23:12:56.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 1.223378376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
12072024-12-03T23:12:56.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 1.079604006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
12082024-12-03T23:12:56.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 782.714715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
12092024-12-03T23:12:56.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 1.300410101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
12102024-12-03T23:12:56.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 689.867811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
12112024-12-03T23:12:56.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 1.133039797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
12122024-12-03T23:12:56.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 1.283392083s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
12132024-12-03T23:12:56.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 929.602894ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12142024-12-03T23:12:56.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 714.704922ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
12152024-12-03T23:12:56.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 1.427444634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
12162024-12-03T23:12:57.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 1.387485611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
12172024-12-03T23:12:57.026ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12182024-12-03T23:12:57.027ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12192024-12-03T23:12:57.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 577.076082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
12202024-12-03T23:12:57.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 54.948349ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12212024-12-03T23:12:57.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 753.245852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
12222024-12-03T23:12:57.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 803.362616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
12232024-12-03T23:12:57.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 124.890778ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12242024-12-03T23:12:57.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 280.560626ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12252024-12-03T23:12:57.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 829.94338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
12262024-12-03T23:12:57.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 1.330598976s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
12272024-12-03T23:12:57.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 653.962941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
12282024-12-03T23:12:57.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 994.540599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
12292024-12-03T23:12:57.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 657.738311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
12302024-12-03T23:12:57.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 954.234754ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12312024-12-03T23:12:57.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 652.29463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
12322024-12-03T23:12:57.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 693.328865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
12332024-12-03T23:12:57.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 371.650678ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12342024-12-03T23:12:57.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 758.925716ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
12352024-12-03T23:12:57.932ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362024-12-03T23:12:57.932ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-12-03T23:12:57.932ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12382024-12-03T23:12:57.940ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12392024-12-03T23:12:58.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 1.443045065s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
12402024-12-03T23:12:58.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 1.394027842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
12412024-12-03T23:12:58.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 1.332122938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
12422024-12-03T23:12:58.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 34.009508ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12432024-12-03T23:12:58.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 1.175937172s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12442024-12-03T23:12:58.311ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12452024-12-03T23:12:58.311ZINFOSledAgent (ServiceManager): Booting oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12462024-12-03T23:12:58.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 71.786392ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12472024-12-03T23:12:58.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 47.831616ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12482024-12-03T23:12:58.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 902.935267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
12492024-12-03T23:12:58.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 1.466777312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
12502024-12-03T23:12:58.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 1.436298649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
12512024-12-03T23:12:58.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 148.331599ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12522024-12-03T23:12:58.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 1.103993044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
12532024-12-03T23:12:58.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 658.650415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
12542024-12-03T23:12:58.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 561.540411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
12552024-12-03T23:12:58.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 128.989202ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12562024-12-03T23:12:58.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 715.430527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
12572024-12-03T23:12:58.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 1.134067055s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
12582024-12-03T23:12:58.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 649.379237ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12592024-12-03T23:12:58.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 796.068726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
12602024-12-03T23:12:58.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 172.371301ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12612024-12-03T23:12:58.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 52.936375ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12622024-12-03T23:12:58.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 352.733497ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12632024-12-03T23:12:58.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 57.22958ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12642024-12-03T23:12:58.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 791.670726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
12652024-12-03T23:12:59.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 234.152282ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12662024-12-03T23:12:59.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 227.152951ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12672024-12-03T23:12:59.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 491.029078ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12682024-12-03T23:12:59.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 551.117119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
12692024-12-03T23:12:59.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 1.495199484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
12702024-12-03T23:12:59.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 742.715974ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12712024-12-03T23:12:59.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 1.415969233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
12722024-12-03T23:12:59.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 932.674316ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12732024-12-03T23:12:59.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 1.277702569s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12742024-12-03T23:12:59.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 1.134939337s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
12752024-12-03T23:12:59.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 897.599688ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12762024-12-03T23:12:59.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 528.618788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
12772024-12-03T23:12:59.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 518.663747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
12782024-12-03T23:12:59.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 653.181409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
12792024-12-03T23:12:59.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 949.002587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
12802024-12-03T23:12:59.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 1.107156672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
12812024-12-03T23:12:59.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 1.162360327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
12822024-12-03T23:12:59.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 421.24369ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12832024-12-03T23:12:59.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 1.35751379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
12842024-12-03T23:12:59.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 1.455040785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
12852024-12-03T23:13:00.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 723.761445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
12862024-12-03T23:13:00.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 1.437776613s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
12872024-12-03T23:13:00.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 508.676392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
12882024-12-03T23:13:00.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 772.881194ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
12892024-12-03T23:13:00.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 1.348321933s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
12902024-12-03T23:13:00.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 842.507816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
12912024-12-03T23:13:00.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 1.209421677s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
12922024-12-03T23:13:00.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 937.725394ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
12932024-12-03T23:13:00.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 708.73452ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
12942024-12-03T23:13:00.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 873.044902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
12952024-12-03T23:13:00.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 563.923321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
12962024-12-03T23:13:00.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 916.40963ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
12972024-12-03T23:13:00.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 817.996404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
12982024-12-03T23:13:00.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 1.141986081s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
12992024-12-03T23:13:00.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 1.095885871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
13002024-12-03T23:13:00.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 1.46681315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
13012024-12-03T23:13:00.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 1.455634568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
13022024-12-03T23:13:00.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 846.196154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
13032024-12-03T23:13:00.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 688.759803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
13042024-12-03T23:13:01.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 861.764479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
13052024-12-03T23:13:01.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 1.148639544s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13062024-12-03T23:13:01.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 1.102869963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
13072024-12-03T23:13:01.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 569.95706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
13082024-12-03T23:13:01.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 1.325268028s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13092024-12-03T23:13:01.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 1.462796916s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
13102024-12-03T23:13:01.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 788.642756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
13112024-12-03T23:13:01.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 591.333189ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13122024-12-03T23:13:01.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 1.008899883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13132024-12-03T23:13:01.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 789.943283ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13142024-12-03T23:13:01.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 947.615578ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
13152024-12-03T23:13:01.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 696.78409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
13162024-12-03T23:13:01.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 956.89324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
13172024-12-03T23:13:01.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 992.727512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
13182024-12-03T23:13:01.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 1.006216943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
13192024-12-03T23:13:01.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 1.255029662s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
13202024-12-03T23:13:01.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a") failed: Property not found. retry in 1.19287242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
13212024-12-03T23:13:01.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 576.048612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
13222024-12-03T23:13:02.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 916.817619ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13232024-12-03T23:13:02.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 1.457429298s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
13242024-12-03T23:13:02.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 723.865221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
13252024-12-03T23:13:02.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 1.401899616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
13262024-12-03T23:13:02.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 791.542571ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13272024-12-03T23:13:02.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 805.808966ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13282024-12-03T23:13:02.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 801.069542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
13292024-12-03T23:13:02.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 517.625069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
13302024-12-03T23:13:02.515ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13312024-12-03T23:13:02.517ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13322024-12-03T23:13:02.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 957.204375ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
13332024-12-03T23:13:02.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 964.400846ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13342024-12-03T23:13:02.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 1.485015054s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
13352024-12-03T23:13:02.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 995.115907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
13362024-12-03T23:13:02.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 1.098846943s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13372024-12-03T23:13:02.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 1.013717494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
13382024-12-03T23:13:02.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 54.840814ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13392024-12-03T23:13:02.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 118.008079ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13402024-12-03T23:13:02.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7") failed: Property not found. retry in 1.208288086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
13412024-12-03T23:13:03.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 528.387655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
13422024-12-03T23:13:03.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 100.94389ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13432024-12-03T23:13:03.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11") failed: Property not found. retry in 930.941102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
13442024-12-03T23:13:03.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 1.218780352s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13452024-12-03T23:13:03.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 1.169540509s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13462024-12-03T23:13:03.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61") failed: Property not found. retry in 1.155906683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
13472024-12-03T23:13:03.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828") failed: Property not found. retry in 1.137251474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
13482024-12-03T23:13:03.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 607.33765ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
13492024-12-03T23:13:03.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 825.012609ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13502024-12-03T23:13:03.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 434.409153ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13512024-12-03T23:13:03.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 1.133920601s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
13522024-12-03T23:13:03.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 1.114323754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13532024-12-03T23:13:03.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198") failed: Property not found. retry in 1.223491437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
13542024-12-03T23:13:03.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00") failed: Property not found. retry in 1.153248945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
13552024-12-03T23:13:03.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 913.307379ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13562024-12-03T23:13:03.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4") failed: Property not found. retry in 940.643541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
13572024-12-03T23:13:03.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 1.120828594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
13582024-12-03T23:13:03.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 724.792149ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13592024-12-03T23:13:03.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753") failed: Property not found. retry in 719.538795ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
13602024-12-03T23:13:03.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 551.155433ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
13612024-12-03T23:13:04.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b") failed: Property not found. retry in 911.204933ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
13622024-12-03T23:13:04.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 1.049177129s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13632024-12-03T23:13:04.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 542.367376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13642024-12-03T23:13:04.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 931.154267ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13652024-12-03T23:13:04.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 1.185994817s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
13662024-12-03T23:13:04.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 1.159561885s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13672024-12-03T23:13:04.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 583.857776ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13682024-12-03T23:13:04.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 892.93531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13692024-12-03T23:13:04.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 576.693403ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
13702024-12-03T23:13:04.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec") failed: Property not found. retry in 897.63719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
13712024-12-03T23:13:04.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 844.325073ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13722024-12-03T23:13:05.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 1.143355888s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13732024-12-03T23:13:05.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 893.467932ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13742024-12-03T23:13:05.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 1.231416339s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
13752024-12-03T23:13:05.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 1.41362675s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13762024-12-03T23:13:05.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 968.683197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13772024-12-03T23:13:05.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 677.218588ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
13782024-12-03T23:13:05.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 1.107820153s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13792024-12-03T23:13:05.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 1.111213306s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13802024-12-03T23:13:06.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 1.024657939s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13812024-12-03T23:13:06.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 650.100242ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13822024-12-03T23:13:06.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a") failed: Property not found. retry in 1.088066892s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
13832024-12-03T23:13:06.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d") failed: Property not found. retry in 864.892964ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
13842024-12-03T23:13:06.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 522.834375ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13852024-12-03T23:13:06.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 720.222934ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13862024-12-03T23:13:06.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 1.372163739s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13872024-12-03T23:13:06.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 754.624708ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13882024-12-03T23:13:07.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 543.791048ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13892024-12-03T23:13:07.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92") failed: Property not found. retry in 1.373184652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
13902024-12-03T23:13:07.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 841.081134ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13912024-12-03T23:13:07.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8") failed: Property not found. retry in 1.152793326s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
13922024-12-03T23:13:07.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e") failed: Property not found. retry in 1.290896394s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
13932024-12-03T23:13:07.689ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49804
13942024-12-03T23:13:07.696ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49804 req_id = 82ad0a9e-6b7c-4c88-8336-67c3e2a12eb7 response_code = 200 uri = /baseboard
13952024-12-03T23:13:07.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106") failed: Property not found. retry in 616.70211ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
13962024-12-03T23:13:08.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 1.43320462s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13972024-12-03T23:13:08.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656") failed: Property not found. retry in 938.241976ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
13982024-12-03T23:13:09.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 877.520407ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
13992024-12-03T23:13:10.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5") failed: Property not found. retry in 560.617377ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
14002024-12-03T23:13:10.712ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.55633563s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
14012024-12-03T23:13:10.980ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_cefcc61a-604d-424b-9499-5472a7e36656
14022024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_562bf5e5-6372-49fb-9d89-d8f7b0d2f198
14032024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_d4da8d56-b5c2-41ca-9c75-cd3415fd634d
14042024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b78235cb-ee94-4f69-8a04-012dd0a16e00
14052024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_fef86ed4-ef71-40e2-8603-7b9e890ae753
14062024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_9f85fe03-0f74-4d11-a2fe-8ac14316d106
14072024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_0df78535-c4ad-4fe8-8d6f-0dd84ea413f5
14082024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_af4d2368-a81b-4174-aa08-7829c291ff92
14092024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e6a85ccf-1626-433e-a842-729751be286b
14102024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_4df70ca3-bfb5-42be-9958-d29c6c820d61
14112024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a76be880-e7dc-4aae-b22a-cf02c2d5da11
14122024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f704b582-8df5-4f82-9eb4-1bc8077ed7ec
14132024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_4c05fd57-36cb-45b0-89f9-c6754520a828
14142024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_f99e1aa0-2073-4d3a-8402-3721fac4ac0a
14152024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_63fe980e-3ab0-485a-84b9-5cb330c0b9f4
14162024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_e13fe529-56a8-4837-bfdb-ac84d9d5a41e
14172024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_7c46e9b1-a557-4d78-8772-ce23a633f25a
14182024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_f60f0cbb-d86d-41d9-a7d4-45e7c0bac0f7
14192024-12-03T23:13:10.981ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_171286db-25de-47f2-bf8e-94bd6450ccc8
14202024-12-03T23:13:10.986ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14212024-12-03T23:13:10.991ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14222024-12-03T23:13:11.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32398782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47628 req_id = 259a6cb1-dce7-483e-bd53-cd9b017027dd response_code = 204 uri = /omicron-zones
14232024-12-03T23:13:11.034ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
14242024-12-03T23:13:11.047ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
14252024-12-03T23:13:11.050ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
14262024-12-03T23:13:11.085ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
14272024-12-03T23:13:11.090ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14282024-12-03T23:13:11.219ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14292024-12-03T23:13:11.361ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14302024-12-03T23:13:11.473ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14312024-12-03T23:13:11.712ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14322024-12-03T23:13:11.881ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14332024-12-03T23:13:12.137ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14342024-12-03T23:13:12.457ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14352024-12-03T23:13:12.782ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14362024-12-03T23:13:13.024ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14372024-12-03T23:13:13.309ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.332011247s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
14382024-12-03T23:13:13.687ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14392024-12-03T23:13:14.307ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14402024-12-03T23:13:15.209ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/0835cb15-df31-4676-b043-2039c00a9b2e/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14412024-12-03T23:13:16.275ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "909497d2-b232-4951-bf83-807368eb85bf", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"0835cb15-df31-4676-b043-2039c00a9b2e\"", request_id: "909497d2-b232-4951-bf83-807368eb85bf" } file = sled-agent/src/rack_setup/service.rs:1078
14422024-12-03T23:13:17.202ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9adcb5df-2368-4987-abf7-4324f3737f85", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"0835cb15-df31-4676-b043-2039c00a9b2e\"", request_id: "9adcb5df-2368-4987-abf7-4324f3737f85" } file = sled-agent/src/rack_setup/service.rs:1078
14432024-12-03T23:13:19.510ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2620c09a-0a5b-4485-9151-5ab7b0ba26fa", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:18 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "2620c09a-0a5b-4485-9151-5ab7b0ba26fa" } file = sled-agent/src/rack_setup/service.rs:1078
14442024-12-03T23:13:22.317ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "eba8fd8f-9a84-4e1b-9cfd-d1a05933fdeb", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:22 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "eba8fd8f-9a84-4e1b-9cfd-d1a05933fdeb" } file = sled-agent/src/rack_setup/service.rs:1078
14452024-12-03T23:13:26.809ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f056a583-0184-4ada-89b1-56e5daf981b7", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "f056a583-0184-4ada-89b1-56e5daf981b7" } file = sled-agent/src/rack_setup/service.rs:1078
14462024-12-03T23:13:28.497ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "378154e3-135c-4a32-b056-e4edad5408d4", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "378154e3-135c-4a32-b056-e4edad5408d4" } file = sled-agent/src/rack_setup/service.rs:1078
14472024-12-03T23:13:30.912ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:62783 remote_addr = [fd00:1122:3344:101::d]:37919 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
14482024-12-03T23:13:30.940ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25925 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = b9cccb5e-79e2-478c-aad1-3e3deedfbbbc response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
14492024-12-03T23:13:32.076ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "56e1c207-11c1-46ec-ac08-5ca1832719d3", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "56e1c207-11c1-46ec-ac08-5ca1832719d3" } file = sled-agent/src/rack_setup/service.rs:1078
14502024-12-03T23:13:36.090ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f2cc2c20-04a7-44ca-a7a0-2288d77c91ad", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "f2cc2c20-04a7-44ca-a7a0-2288d77c91ad" } file = sled-agent/src/rack_setup/service.rs:1078
14512024-12-03T23:13:37.732ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47213
14522024-12-03T23:13:37.733ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47213 req_id = 53204a95-8121-4858-af66-35c34013ca57 response_code = 200 uri = /baseboard
14532024-12-03T23:13:38.854ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3261c23a-d2f1-48fe-92a2-ea34c491dfcb", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "3261c23a-d2f1-48fe-92a2-ea34c491dfcb" } file = sled-agent/src/rack_setup/service.rs:1078
14542024-12-03T23:13:42.669ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "eb42d5a4-21ba-4950-8fa2-e39175b57a76", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "eb42d5a4-21ba-4950-8fa2-e39175b57a76" } file = sled-agent/src/rack_setup/service.rs:1078
14552024-12-03T23:13:48.835ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "70d72ffc-03b7-4309-ac50-f687872a354e", "content-length": "173", "date": "Tue, 03 Dec 2024 23:13:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"9497a29b-1799-4726-9b95-53dee50af36d\"", request_id: "70d72ffc-03b7-4309-ac50-f687872a354e" } file = sled-agent/src/rack_setup/service.rs:1078
14562024-12-03T23:13:50.789ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
14572024-12-03T23:13:50.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62854
14582024-12-03T23:13:50.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
14592024-12-03T23:13:50.885ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
14602024-12-03T23:13:50.887ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
14612024-12-03T23:13:50.890ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
14622024-12-03T23:13:50.904ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14632024-12-03T23:13:50.905ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9
14642024-12-03T23:13:50.932ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14652024-12-03T23:13:50.932ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_88c18331-f96d-4496-b80c-5b839f36e5ec
14662024-12-03T23:13:50.955ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14672024-12-03T23:13:50.955ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a
14682024-12-03T23:13:50.977ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14692024-12-03T23:13:50.977ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_477f8969-b73f-4886-851b-8d5be079baff
14702024-12-03T23:13:50.998ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14712024-12-03T23:13:50.998ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5
14722024-12-03T23:13:51.018ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14732024-12-03T23:13:51.019ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92da16e7-325b-473a-8169-ae1c2827470d
14742024-12-03T23:13:51.040ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14752024-12-03T23:13:51.040ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b1979523-9de1-40bb-ac9e-46203987b285
14762024-12-03T23:13:51.060ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14772024-12-03T23:13:51.060ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1
14782024-12-03T23:13:51.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14792024-12-03T23:13:51.080ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d
14802024-12-03T23:13:51.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62854 req_id = 7346e039-dc6c-475a-b600-1c8e7d1a5688 response_code = 200 uri = /inventory
14812024-12-03T23:13:54.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52048
14822024-12-03T23:13:54.592ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14832024-12-03T23:13:54.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
14842024-12-03T23:13:54.592ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14852024-12-03T23:13:54.593ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14862024-12-03T23:13:54.593ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14872024-12-03T23:13:54.593ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14882024-12-03T23:13:54.593ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14892024-12-03T23:13:54.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52048 req_id = d6c6fa72-7425-4b80-8b2c-0f19c39d5934 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14902024-12-03T23:13:54.594ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
14912024-12-03T23:13:54.598ZINFOSledAgent (RSS): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14922024-12-03T23:13:54.598ZINFOSledAgent (RSS): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14932024-12-03T23:13:54.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51024
14942024-12-03T23:13:54.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
14952024-12-03T23:13:54.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
14962024-12-03T23:13:54.797ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
14972024-12-03T23:13:54.797ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
14982024-12-03T23:13:54.810ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
14992024-12-03T23:13:54.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9
15002024-12-03T23:13:54.834ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15012024-12-03T23:13:54.834ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_88c18331-f96d-4496-b80c-5b839f36e5ec
15022024-12-03T23:13:54.855ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15032024-12-03T23:13:54.855ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a
15042024-12-03T23:13:54.878ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15052024-12-03T23:13:54.878ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_477f8969-b73f-4886-851b-8d5be079baff
15062024-12-03T23:13:54.899ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15072024-12-03T23:13:54.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5
15082024-12-03T23:13:54.920ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15092024-12-03T23:13:54.920ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92da16e7-325b-473a-8169-ae1c2827470d
15102024-12-03T23:13:54.939ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15112024-12-03T23:13:54.939ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b1979523-9de1-40bb-ac9e-46203987b285
15122024-12-03T23:13:54.959ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15132024-12-03T23:13:54.959ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1
15142024-12-03T23:13:54.979ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15152024-12-03T23:13:54.979ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d
15162024-12-03T23:13:54.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51024 req_id = 8cca28d6-0983-4dc8-8a21-54e7327c7ff9 response_code = 200 uri = /inventory
15172024-12-03T23:13:55.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48459
15182024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15192024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15202024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15212024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15222024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15232024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15242024-12-03T23:13:55.462ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15252024-12-03T23:13:55.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48459 req_id = 934a1a4b-53c2-4d7a-b270-de0da909eae3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15262024-12-03T23:13:55.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55577
15272024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15282024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15292024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15302024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15312024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15322024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15332024-12-03T23:13:55.820ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15342024-12-03T23:13:55.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55577 req_id = 73ac5999-68ff-424b-9530-4ba511d3af43 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15352024-12-03T23:13:56.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60529
15362024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15372024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15382024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15392024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15402024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15412024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15422024-12-03T23:13:56.093ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15432024-12-03T23:13:56.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60529 req_id = 2236d81a-257d-4c09-bef0-7eea15a1e621 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15442024-12-03T23:14:00.634ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7821 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = f56865a2-094b-4a41-bf92-26f8a3b30be1 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
15452024-12-03T23:14:01.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56849
15462024-12-03T23:14:01.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56849 req_id = b37d0a83-aedf-4c51-a95d-7adc9ac9c26e response_code = 200 uri = /vpc-routes
15472024-12-03T23:14:01.905ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
15482024-12-03T23:14:01.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 648 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56849 req_id = fa9d42f7-4daf-4572-82e0-81b7a37c7b36 response_code = 204 uri = /eip-gateways
15492024-12-03T23:14:02.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3454 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56849 req_id = b19be28d-8f0a-447c-baa7-5ed3eeb68958 response_code = 204 uri = /vpc-routes
15502024-12-03T23:14:07.767ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47654
15512024-12-03T23:14:07.767ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47654 req_id = de6c919c-cb56-491d-ad79-94ee2c3b7ae7 response_code = 200 uri = /baseboard
15522024-12-03T23:14:17.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50383
15532024-12-03T23:14:17.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50383 req_id = 8e4c03ac-591e-45b6-a137-fb9fc89e8d31 response_code = 200 uri = /vpc-routes
15542024-12-03T23:14:17.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
15552024-12-03T23:14:17.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50383 req_id = 5f67006f-c66d-42a0-879d-b34b5d28791d response_code = 204 uri = /eip-gateways
15562024-12-03T23:14:17.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56194
15572024-12-03T23:14:17.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56194 req_id = 04a6d2d1-6368-4f78-918b-85ff6430de4e response_code = 200 uri = /v2p
15582024-12-03T23:14:17.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50383 req_id = 4d2b32af-c8f0-4141-b064-519b5e2ebce4 response_code = 204 uri = /vpc-routes
15592024-12-03T23:14:17.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50910
15602024-12-03T23:14:17.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50910 req_id = 8aaea066-2e1a-4585-b293-f40aeabb8703 response_code = 200 uri = /vpc-routes
15612024-12-03T23:14:18.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40724
15622024-12-03T23:14:18.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40724 req_id = 3d165193-de41-496f-a515-8735095ec413 response_code = 200 uri = /vpc-routes
15632024-12-03T23:14:18.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37604
15642024-12-03T23:14:18.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37604 req_id = 30f1bac0-8349-4aef-87e8-b6a41a688976 response_code = 200 uri = /v2p
15652024-12-03T23:14:18.100ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
15662024-12-03T23:14:18.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40724 req_id = b3053aef-bb4e-4982-950c-abda6eb4dc1d response_code = 204 uri = /eip-gateways
15672024-12-03T23:14:18.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40724 req_id = a17c32c7-bed4-499b-936a-dffa051dfe29 response_code = 204 uri = /vpc-routes
15682024-12-03T23:14:18.113ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
15692024-12-03T23:14:18.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50910 req_id = 74f421f8-1131-43c0-9a98-634cdb2ae4fe response_code = 204 uri = /eip-gateways
15702024-12-03T23:14:18.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50910 req_id = 43b3ca8c-a2c0-4201-b51b-f07b0705f94a response_code = 204 uri = /vpc-routes
15712024-12-03T23:14:18.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59168
15722024-12-03T23:14:18.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59168 req_id = 010c00dc-0591-41dd-9393-c47d9fd1eb89 response_code = 200 uri = /v2p
15732024-12-03T23:14:18.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57455
15742024-12-03T23:14:18.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
15752024-12-03T23:14:18.310ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
15762024-12-03T23:14:18.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57455 req_id = 9015cc71-142a-41eb-bc64-92e861c862b3 response_code = 204 uri = /switch-ports
15772024-12-03T23:14:18.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49904
15782024-12-03T23:14:18.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
15792024-12-03T23:14:18.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57455 req_id = b79c24a2-74b3-4b7a-b6e5-2ef8655889c2 response_code = 200 uri = /network-bootstore-config
15802024-12-03T23:14:18.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61473
15812024-12-03T23:14:18.423ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15822024-12-03T23:14:18.423ZINFOSledAgent (bootstore): Writing ledger to /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15832024-12-03T23:14:18.426ZINFOSledAgent (bootstore): Writing ledger to /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15842024-12-03T23:14:18.428ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15852024-12-03T23:14:18.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5406 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57455 req_id = 797de209-c696-481f-9cd4-ef495960208d response_code = 204 uri = /network-bootstore-config
15862024-12-03T23:14:18.428ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
15872024-12-03T23:14:18.493ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
15882024-12-03T23:14:18.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49904 req_id = b567c387-7c3f-42ae-85ec-2ecc3e4ce174 response_code = 204 uri = /switch-ports
15892024-12-03T23:14:18.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 476 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49904 req_id = 328bd0ab-c008-46f8-8a1c-5f028d31b005 response_code = 200 uri = /network-bootstore-config
15902024-12-03T23:14:18.532ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
15912024-12-03T23:14:18.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198244 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61473 req_id = 64b1b1bf-a4b8-48ec-8520-04a980c4ad0c response_code = 204 uri = /switch-ports
15922024-12-03T23:14:18.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61473 req_id = 764ffb9d-29a1-42b1-bdc5-14ee94a3481e response_code = 200 uri = /network-bootstore-config
15932024-12-03T23:14:30.610ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7908 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 68d251f4-65b6-4ee8-87fd-ed5996a0ea8f response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
15942024-12-03T23:14:37.802ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43914
15952024-12-03T23:14:37.802ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43914 req_id = 49e23db1-0fea-42f3-b16c-0f7b51f58ce5 response_code = 200 uri = /baseboard
15962024-12-03T23:14:47.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57209
15972024-12-03T23:14:47.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57209 req_id = 4cec0b74-831d-4543-af6d-a643a6317962 response_code = 200 uri = /v2p
15982024-12-03T23:14:47.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59101
15992024-12-03T23:14:47.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59101 req_id = 2043fb33-b911-4f4d-89fb-40655bfc8c5a response_code = 200 uri = /vpc-routes
16002024-12-03T23:14:47.768ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16012024-12-03T23:14:47.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59101 req_id = 96acaebf-5525-4a47-80d3-3814bd4ff619 response_code = 204 uri = /eip-gateways
16022024-12-03T23:14:47.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59101 req_id = 61224650-cf5d-4904-a740-3a2a12ebece1 response_code = 204 uri = /vpc-routes
16032024-12-03T23:14:47.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47052
16042024-12-03T23:14:47.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47052 req_id = 3d45f640-9b31-4dd6-bd06-6d52b1e75af7 response_code = 200 uri = /vpc-routes
16052024-12-03T23:14:47.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50889
16062024-12-03T23:14:47.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16072024-12-03T23:14:47.984ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16082024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95239 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50889 req_id = c9a833c9-fc23-4966-9a7a-edb338437140 response_code = 204 uri = /switch-ports
16092024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63187
16102024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35005
16112024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48238
16122024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57072
16132024-12-03T23:14:48.041ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16142024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47052 req_id = d77e3951-3df2-4d1e-8f0b-f126a2a5b46f response_code = 204 uri = /eip-gateways
16152024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63187 req_id = ab740d1d-4ee2-429d-b28a-e9e70aa96cae response_code = 200 uri = /vpc-routes
16162024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50889 req_id = d70fa4a7-6390-4f1a-b3b5-84eea21b25e5 response_code = 200 uri = /network-bootstore-config
16172024-12-03T23:14:48.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57072 req_id = 7a5c28b0-4289-4bd5-a9c4-d2fa369a2cd8 response_code = 200 uri = /v2p
16182024-12-03T23:14:48.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16192024-12-03T23:14:48.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3780 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48238 req_id = c7b916e4-c1be-4ff6-949c-701378ae4194 response_code = 200 uri = /v2p
16202024-12-03T23:14:48.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47052 req_id = 6891287b-e42e-4314-a413-b2848d00cb02 response_code = 204 uri = /vpc-routes
16212024-12-03T23:14:48.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16222024-12-03T23:14:48.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16232024-12-03T23:14:48.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63187 req_id = 75c7ab90-87f5-4da6-8eff-149e9b398efb response_code = 204 uri = /eip-gateways
16242024-12-03T23:14:48.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63187 req_id = d49f73fc-67d0-4a2b-bceb-4d6ce1deb725 response_code = 204 uri = /vpc-routes
16252024-12-03T23:14:48.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35005 req_id = ca9572bf-f40a-4913-bc1d-5a2b63a8db69 response_code = 204 uri = /switch-ports
16262024-12-03T23:14:48.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35005 req_id = 31e68a15-a599-4952-8ce2-d3557bc5be0d response_code = 200 uri = /network-bootstore-config
16272024-12-03T23:14:48.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52038
16282024-12-03T23:14:48.168ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16292024-12-03T23:14:48.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16302024-12-03T23:14:48.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86166 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52038 req_id = 46aa7f26-2ee4-416d-b5ab-df1d43390ebc response_code = 204 uri = /switch-ports
16312024-12-03T23:14:48.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52038 req_id = 27cd92d0-d446-4ad1-9b98-866f78e7b07e response_code = 200 uri = /network-bootstore-config
16322024-12-03T23:15:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8515 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 2b305b31-f22b-4726-830a-200d93392db0 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
16332024-12-03T23:15:07.836ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60789
16342024-12-03T23:15:07.836ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60789 req_id = c705c3d5-c9c1-42aa-9943-7a4738a39030 response_code = 200 uri = /baseboard
16352024-12-03T23:15:17.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62576
16362024-12-03T23:15:17.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62576 req_id = 07ec0a6b-6dea-4be1-ba71-0d68dbffd17d response_code = 200 uri = /vpc-routes
16372024-12-03T23:15:17.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49341
16382024-12-03T23:15:17.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49341 req_id = 065bfd07-fc5c-4f73-898e-23e8abcb48c5 response_code = 200 uri = /v2p
16392024-12-03T23:15:17.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16402024-12-03T23:15:17.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62576 req_id = 2a6dd9ad-a6d1-4d5e-bcb3-8847756034e4 response_code = 204 uri = /eip-gateways
16412024-12-03T23:15:17.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62576 req_id = 06785e49-ce42-4681-8ff7-8ac3d6815aa4 response_code = 204 uri = /vpc-routes
16422024-12-03T23:15:17.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62221
16432024-12-03T23:15:17.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62221 req_id = b90d1c9f-5e67-41fd-817c-35c3c441709b response_code = 200 uri = /vpc-routes
16442024-12-03T23:15:17.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33022
16452024-12-03T23:15:17.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33022 req_id = dd0d9fc2-7209-4faa-94e5-4083db749bac response_code = 200 uri = /v2p
16462024-12-03T23:15:18.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16472024-12-03T23:15:18.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62221 req_id = bfc53102-29a2-455d-b9bb-92299c15de4f response_code = 204 uri = /eip-gateways
16482024-12-03T23:15:18.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62221 req_id = 15eb0237-b2be-4467-bc86-99342d883312 response_code = 204 uri = /vpc-routes
16492024-12-03T23:15:18.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51220
16502024-12-03T23:15:18.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16512024-12-03T23:15:18.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16522024-12-03T23:15:18.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51220 req_id = b07847ea-02be-4e5e-82eb-52f0938f2307 response_code = 204 uri = /switch-ports
16532024-12-03T23:15:18.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58120
16542024-12-03T23:15:18.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64799
16552024-12-03T23:15:18.178ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16562024-12-03T23:15:18.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3057 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58120 req_id = 6c391dde-17dc-4272-bb94-3e623340773f response_code = 200 uri = /vpc-routes
16572024-12-03T23:15:18.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51220 req_id = 159cc9aa-ab74-4a58-93e2-6860918c0c53 response_code = 200 uri = /network-bootstore-config
16582024-12-03T23:15:18.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64740
16592024-12-03T23:15:18.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64740 req_id = bc92b055-dc0f-4157-ac00-8e00dd97752f response_code = 200 uri = /v2p
16602024-12-03T23:15:18.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16612024-12-03T23:15:18.228ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16622024-12-03T23:15:18.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 532 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58120 req_id = eb819ee2-03ba-4a59-8922-a037be1917ff response_code = 204 uri = /eip-gateways
16632024-12-03T23:15:18.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58120 req_id = f5cbf91a-f3cd-430c-8041-58f347e294a4 response_code = 204 uri = /vpc-routes
16642024-12-03T23:15:18.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64799 req_id = 6cae1a47-c3cb-4211-a781-6fc20d9ca557 response_code = 204 uri = /switch-ports
16652024-12-03T23:15:18.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64799 req_id = 816324d9-c92c-4fb2-8264-47dc5895ba46 response_code = 200 uri = /network-bootstore-config
16662024-12-03T23:15:18.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40647
16672024-12-03T23:15:18.332ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16682024-12-03T23:15:18.367ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16692024-12-03T23:15:18.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90611 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40647 req_id = 7a9ab9b5-d451-4cdb-9e1f-c438ed7c8e74 response_code = 204 uri = /switch-ports
16702024-12-03T23:15:18.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40647 req_id = 0415a577-d513-40bf-9368-697544c462d5 response_code = 200 uri = /network-bootstore-config
16712024-12-03T23:15:30.614ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9103 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 27496687-3a9c-483c-ac91-55340201cb12 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
16722024-12-03T23:15:37.872ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37758
16732024-12-03T23:15:37.872ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37758 req_id = e35cda61-725d-42b4-9bdf-91696b9cede2 response_code = 200 uri = /baseboard
16742024-12-03T23:15:47.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61785
16752024-12-03T23:15:47.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61785 req_id = 88172619-4d1e-405c-81fa-c789bc1e7de0 response_code = 200 uri = /vpc-routes
16762024-12-03T23:15:47.627ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16772024-12-03T23:15:47.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61785 req_id = 8685f4c4-80ca-4dcb-93ce-1e56b9e232be response_code = 204 uri = /eip-gateways
16782024-12-03T23:15:47.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61785 req_id = 9c8479d5-ca1d-44b4-8d89-c57b4da86a48 response_code = 204 uri = /vpc-routes
16792024-12-03T23:15:47.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32921
16802024-12-03T23:15:47.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16812024-12-03T23:15:47.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16822024-12-03T23:15:47.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122492 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32921 req_id = cfbf5e44-ce69-479f-b94c-58b9d0a9d30d response_code = 204 uri = /switch-ports
16832024-12-03T23:15:47.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64494
16842024-12-03T23:15:47.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64494 req_id = 0427c5fa-7179-46c9-9b15-1271920770ee response_code = 200 uri = /vpc-routes
16852024-12-03T23:15:47.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32921 req_id = 7f687ac3-5c99-4dd4-a650-12d8d0948e51 response_code = 200 uri = /network-bootstore-config
16862024-12-03T23:15:47.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53517
16872024-12-03T23:15:47.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53517 req_id = 079d4daf-433d-474e-9cbe-1ff07db7d746 response_code = 200 uri = /v2p
16882024-12-03T23:15:47.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
16892024-12-03T23:15:47.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64494 req_id = 35d1d950-53c1-427b-b732-0c131abc5118 response_code = 204 uri = /eip-gateways
16902024-12-03T23:15:47.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64494 req_id = 20262e5f-3ce7-48ec-bd40-c852ea22ff4e response_code = 204 uri = /vpc-routes
16912024-12-03T23:15:47.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55174
16922024-12-03T23:15:47.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16932024-12-03T23:15:47.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16942024-12-03T23:15:48.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55174 req_id = c9f92a34-885d-4a17-a7dc-1310b7a2dedf response_code = 204 uri = /switch-ports
16952024-12-03T23:15:48.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53659
16962024-12-03T23:15:48.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57954
16972024-12-03T23:15:48.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60021
16982024-12-03T23:15:48.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53659 req_id = 200ba58f-424a-45f0-a568-cba80f159d38 response_code = 200 uri = /vpc-routes
16992024-12-03T23:15:48.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55174 req_id = ddd0dba8-b57b-4eec-be12-4bf4947b9e82 response_code = 200 uri = /network-bootstore-config
17002024-12-03T23:15:48.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60021 req_id = 317ccf53-72e9-43fd-8ab3-57fc0f354ad3 response_code = 200 uri = /v2p
17012024-12-03T23:15:48.026ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17022024-12-03T23:15:48.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33115
17032024-12-03T23:15:48.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33115 req_id = 302635d2-910b-4140-997c-aafa200ff2ae response_code = 200 uri = /v2p
17042024-12-03T23:15:48.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17052024-12-03T23:15:48.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17062024-12-03T23:15:48.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53659 req_id = 5fcd699f-880c-4628-b8c8-44d608fe633d response_code = 204 uri = /eip-gateways
17072024-12-03T23:15:48.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53659 req_id = bf32601e-39b7-473d-84f6-5aecb9209958 response_code = 204 uri = /vpc-routes
17082024-12-03T23:15:48.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57954 req_id = e0c9ccbd-5144-41e5-a39e-cf8736583ae6 response_code = 204 uri = /switch-ports
17092024-12-03T23:15:48.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57954 req_id = f256b72a-3d1c-4af7-8134-d5e062fbb01e response_code = 200 uri = /network-bootstore-config
17102024-12-03T23:16:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6571 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 31dd0670-1fb6-4baa-bd71-66911c4de3e9 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
17112024-12-03T23:16:07.906ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34420
17122024-12-03T23:16:07.906ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34420 req_id = b616d358-3ef0-42b3-b7a9-574ef887f7e2 response_code = 200 uri = /baseboard
17132024-12-03T23:16:16.512ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17142024-12-03T23:16:17.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45123
17152024-12-03T23:16:17.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45123 req_id = cdaf453f-0923-412e-8815-4dd7db831fa5 response_code = 200 uri = /vpc-routes
17162024-12-03T23:16:17.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43969
17172024-12-03T23:16:17.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43969 req_id = d746ef8b-4db1-4a18-9b15-4b503aeed521 response_code = 200 uri = /vpc-routes
17182024-12-03T23:16:17.953ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17192024-12-03T23:16:17.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45123 req_id = f0888e19-dc0e-4042-aafc-1932a4f37942 response_code = 204 uri = /eip-gateways
17202024-12-03T23:16:17.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51054
17212024-12-03T23:16:17.954ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17222024-12-03T23:16:17.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17232024-12-03T23:16:18.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99851 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51054 req_id = 8c267d13-8360-4f80-9bef-a0605be5e4da response_code = 204 uri = /switch-ports
17242024-12-03T23:16:18.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51928
17252024-12-03T23:16:18.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17262024-12-03T23:16:18.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43969 req_id = 6d8e49f7-4173-4b27-87ad-30be6bd5a7ce response_code = 204 uri = /eip-gateways
17272024-12-03T23:16:18.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51054 req_id = e88109a4-cf42-4dcd-b51c-5fb90850596e response_code = 200 uri = /network-bootstore-config
17282024-12-03T23:16:18.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51928 req_id = ab531c67-baf8-44d9-b003-d28059c79428 response_code = 200 uri = /v2p
17292024-12-03T23:16:18.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45123 req_id = e434c501-ec63-4f42-ac89-6184efcb343b response_code = 204 uri = /vpc-routes
17302024-12-03T23:16:18.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43969 req_id = 701ab04c-0e72-496f-a9c3-171e20b9db4d response_code = 204 uri = /vpc-routes
17312024-12-03T23:16:18.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37256
17322024-12-03T23:16:18.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37256 req_id = 11f5e548-625a-418a-aa15-f77fc5f0f589 response_code = 200 uri = /vpc-routes
17332024-12-03T23:16:18.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58657
17342024-12-03T23:16:18.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58657 req_id = dca194f6-713d-4bf7-81d1-938fa43326c9 response_code = 200 uri = /v2p
17352024-12-03T23:16:18.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57271
17362024-12-03T23:16:18.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57271 req_id = 5ef0f4d7-e5c7-4b3b-a018-10571952c796 response_code = 200 uri = /v2p
17372024-12-03T23:16:18.205ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17382024-12-03T23:16:18.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37256 req_id = ecb4a86e-5780-440a-a116-b50f7efdc186 response_code = 204 uri = /eip-gateways
17392024-12-03T23:16:18.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37256 req_id = 133532b9-55e2-404d-965b-972a52055843 response_code = 204 uri = /vpc-routes
17402024-12-03T23:16:18.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57344
17412024-12-03T23:16:18.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17422024-12-03T23:16:18.305ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17432024-12-03T23:16:18.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57344 req_id = 63967df3-3b6d-46ec-b80a-b3dab84cf7f0 response_code = 204 uri = /switch-ports
17442024-12-03T23:16:18.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57344 req_id = 873ac9ba-37e4-4eb5-a77d-7cba428bfeb9 response_code = 200 uri = /network-bootstore-config
17452024-12-03T23:16:18.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52964
17462024-12-03T23:16:18.416ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17472024-12-03T23:16:18.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17482024-12-03T23:16:18.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85844 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52964 req_id = 11ff9150-58e0-46c1-8ac0-7cd4f6e5fcbb response_code = 204 uri = /switch-ports
17492024-12-03T23:16:18.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52964 req_id = 708d6885-e418-4b37-80e6-50496a585a5b response_code = 200 uri = /network-bootstore-config
17502024-12-03T23:16:30.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7817 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = a7d389f2-77ae-4173-9dc0-6681350f0171 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
17512024-12-03T23:16:37.940ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36435
17522024-12-03T23:16:37.940ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36435 req_id = 1de4dae0-250a-414e-9be3-e0ead8c2fdc2 response_code = 200 uri = /baseboard
17532024-12-03T23:16:47.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37316
17542024-12-03T23:16:47.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37316 req_id = b27a23c3-fa71-4c85-9feb-922dbf3c5c0f response_code = 200 uri = /vpc-routes
17552024-12-03T23:16:47.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50809
17562024-12-03T23:16:47.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50809 req_id = c93a50f3-c9c8-4a89-aa6b-4401a1eec20b response_code = 200 uri = /v2p
17572024-12-03T23:16:47.814ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17582024-12-03T23:16:47.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37316 req_id = 85d1cfe0-1535-4c2a-9825-4753fc98b78f response_code = 204 uri = /eip-gateways
17592024-12-03T23:16:47.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37316 req_id = 6c5e9db4-a3ac-426e-ac59-c847a32069d7 response_code = 204 uri = /vpc-routes
17602024-12-03T23:16:47.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32846
17612024-12-03T23:16:47.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17622024-12-03T23:16:47.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17632024-12-03T23:16:47.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:32846 req_id = 8c054439-432d-4108-a018-5576903ee688 response_code = 204 uri = /switch-ports
17642024-12-03T23:16:47.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43003
17652024-12-03T23:16:47.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32846 req_id = 93c806db-5965-4cd8-896d-f9490cfdb797 response_code = 200 uri = /network-bootstore-config
17662024-12-03T23:16:47.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43003 req_id = b1da22c5-a07a-4ff5-a71a-ae7fe13bdfb8 response_code = 200 uri = /vpc-routes
17672024-12-03T23:16:47.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17682024-12-03T23:16:47.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43003 req_id = 5ebbc5a3-8cab-46d8-b0c8-4b63b76e5d0d response_code = 204 uri = /eip-gateways
17692024-12-03T23:16:47.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51799
17702024-12-03T23:16:47.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51799 req_id = 70b45485-db97-48f1-a9fa-bbed65737fca response_code = 200 uri = /vpc-routes
17712024-12-03T23:16:47.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57261
17722024-12-03T23:16:47.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57261 req_id = 9a8e59df-dd66-47b1-8630-49ccb95b9e7a response_code = 200 uri = /v2p
17732024-12-03T23:16:47.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43003 req_id = 9065ecb0-54ad-4e8f-bdb8-cbf84b193c5c response_code = 204 uri = /vpc-routes
17742024-12-03T23:16:48.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17752024-12-03T23:16:48.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51799 req_id = 67ab8c43-c8a0-4de9-b907-726d6d26b1f4 response_code = 204 uri = /eip-gateways
17762024-12-03T23:16:48.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55980
17772024-12-03T23:16:48.013ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17782024-12-03T23:16:48.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17792024-12-03T23:16:48.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105002 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55980 req_id = d3bf9e79-8a41-4dea-8f8a-a5f8c30569ec response_code = 204 uri = /switch-ports
17802024-12-03T23:16:48.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58017
17812024-12-03T23:16:48.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45956
17822024-12-03T23:16:48.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17832024-12-03T23:16:48.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45956 req_id = fb06e46f-aac4-4892-a4eb-07e7a6d80bfb response_code = 200 uri = /v2p
17842024-12-03T23:16:48.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3906 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55980 req_id = 028b6724-6c5f-40f7-8f1f-49f2426fd704 response_code = 200 uri = /network-bootstore-config
17852024-12-03T23:16:48.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3961 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51799 req_id = 314d9113-3625-414e-afaf-4c1b4fbc5744 response_code = 204 uri = /vpc-routes
17862024-12-03T23:16:48.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17872024-12-03T23:16:48.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58017 req_id = 117495e2-5210-4462-91e3-69618c4460fa response_code = 204 uri = /switch-ports
17882024-12-03T23:16:48.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58017 req_id = 7538bf6d-5020-4f26-88d5-1a407a70d2dc response_code = 200 uri = /network-bootstore-config
17892024-12-03T23:17:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7111 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 4c30358d-9036-4f12-b11c-3c54deb1c2c3 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
17902024-12-03T23:17:07.982ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35640
17912024-12-03T23:17:07.982ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35640 req_id = 2e18530d-41e2-48ee-9b5c-f1909235399d response_code = 200 uri = /baseboard
17922024-12-03T23:17:17.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44768
17932024-12-03T23:17:17.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44768 req_id = 0bb5fe0b-32a6-4d44-b331-43a837132ced response_code = 200 uri = /vpc-routes
17942024-12-03T23:17:17.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
17952024-12-03T23:17:17.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44768 req_id = e81b7c41-18fb-4c21-b4ac-d29e704ddc8d response_code = 204 uri = /eip-gateways
17962024-12-03T23:17:17.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63880
17972024-12-03T23:17:17.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63880 req_id = c86a1b2b-5f75-48a8-8bfc-f877f94af072 response_code = 200 uri = /v2p
17982024-12-03T23:17:17.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44768 req_id = a5c81e21-7976-4dbb-8dad-be6b40125f17 response_code = 204 uri = /vpc-routes
17992024-12-03T23:17:17.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47205
18002024-12-03T23:17:17.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47205 req_id = 1bd7a5cc-5d28-45c3-8c1c-150a4d289c5e response_code = 200 uri = /vpc-routes
18012024-12-03T23:17:17.990ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18022024-12-03T23:17:17.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47205 req_id = 9f566f57-37d6-4d6c-8029-8271ee3e3468 response_code = 204 uri = /eip-gateways
18032024-12-03T23:17:18.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47205 req_id = 3d6a35a7-7688-44a3-9275-439a4bc9c01d response_code = 204 uri = /vpc-routes
18042024-12-03T23:17:18.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49414
18052024-12-03T23:17:18.061ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18062024-12-03T23:17:18.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18072024-12-03T23:17:18.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96288 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49414 req_id = b82bfbd8-25ad-4d83-ac7a-a8c0343f6511 response_code = 204 uri = /switch-ports
18082024-12-03T23:17:18.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33786
18092024-12-03T23:17:18.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40697
18102024-12-03T23:17:18.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51785
18112024-12-03T23:17:18.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51785 req_id = ee72a5c6-3d8f-4b51-9c18-c2ca082cf48f response_code = 200 uri = /vpc-routes
18122024-12-03T23:17:18.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49414 req_id = 85a75c89-f4c6-4760-b373-4d1146469139 response_code = 200 uri = /network-bootstore-config
18132024-12-03T23:17:18.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33786 req_id = 3375a10f-32fc-4991-beff-b8e413592ddd response_code = 200 uri = /v2p
18142024-12-03T23:17:18.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18152024-12-03T23:17:18.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18162024-12-03T23:17:18.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18172024-12-03T23:17:18.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 680 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51785 req_id = c603648f-a4f9-4b5f-b262-277cc528eca8 response_code = 204 uri = /eip-gateways
18182024-12-03T23:17:18.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42782
18192024-12-03T23:17:18.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42782 req_id = b4fb6d55-2683-4861-b013-5a02fc909000 response_code = 200 uri = /v2p
18202024-12-03T23:17:18.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51785 req_id = 1e03a2cd-b872-4b94-9aec-4d23e87a0c1b response_code = 204 uri = /vpc-routes
18212024-12-03T23:17:18.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40697 req_id = 5a9047a2-86c8-482e-b1dc-488bb37d89ff response_code = 204 uri = /switch-ports
18222024-12-03T23:17:18.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40697 req_id = e0de56a2-7684-48c9-a4af-7ce20419572e response_code = 200 uri = /network-bootstore-config
18232024-12-03T23:17:18.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43741
18242024-12-03T23:17:18.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18252024-12-03T23:17:18.311ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18262024-12-03T23:17:18.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43741 req_id = f032dbd2-2698-4753-a842-0e7bb1165894 response_code = 204 uri = /switch-ports
18272024-12-03T23:17:18.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43741 req_id = 3a63f468-bfdd-4553-a94b-5f7e79324b13 response_code = 200 uri = /network-bootstore-config
18282024-12-03T23:17:30.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6676 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = dc78a440-a9b1-49c4-84d7-c2d0750ba40d response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
18292024-12-03T23:17:38.015ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63129
18302024-12-03T23:17:38.015ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63129 req_id = 438ba2ce-f839-40c9-9018-7db75c8364d5 response_code = 200 uri = /baseboard
18312024-12-03T23:17:47.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34357
18322024-12-03T23:17:47.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34357 req_id = 85d6e714-53c0-4d07-bc29-89de3d654cf3 response_code = 200 uri = /vpc-routes
18332024-12-03T23:17:47.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58817
18342024-12-03T23:17:47.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58817 req_id = 8827be79-174b-4903-b08d-54b8439ca159 response_code = 200 uri = /v2p
18352024-12-03T23:17:47.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18362024-12-03T23:17:47.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34357 req_id = eb44de8d-764e-4e7a-b556-f4f0ae896f39 response_code = 204 uri = /eip-gateways
18372024-12-03T23:17:47.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34357 req_id = c5f3e3f7-2b81-4b53-83bc-653b9ec9f6d2 response_code = 204 uri = /vpc-routes
18382024-12-03T23:17:47.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63256
18392024-12-03T23:17:47.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18402024-12-03T23:17:47.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18412024-12-03T23:17:47.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63256 req_id = df87a2ac-a944-4081-a04f-15f0d2ee111f response_code = 204 uri = /switch-ports
18422024-12-03T23:17:47.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58935
18432024-12-03T23:17:47.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58935 req_id = 83bf4547-933a-4700-9f86-edecc6b0c029 response_code = 200 uri = /vpc-routes
18442024-12-03T23:17:47.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63256 req_id = 3c9f31a6-5ae1-470e-bc9e-8de2358eecbd response_code = 200 uri = /network-bootstore-config
18452024-12-03T23:17:47.937ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18462024-12-03T23:17:47.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58935 req_id = ad9078e1-714a-433b-ab0c-71f7febec1d1 response_code = 204 uri = /eip-gateways
18472024-12-03T23:17:47.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62175
18482024-12-03T23:17:47.943ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18492024-12-03T23:17:47.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18502024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62175 req_id = f16327d4-5bd8-477a-ac08-c94618272f75 response_code = 204 uri = /switch-ports
18512024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43199
18522024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60816
18532024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62175 req_id = 46699b09-b98b-4477-abac-0a20086e51cd response_code = 200 uri = /network-bootstore-config
18542024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 562 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58935 req_id = 6fa8c79d-ef68-4d82-b1bd-dcd8c1e86892 response_code = 204 uri = /vpc-routes
18552024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43199 req_id = a50cc1e7-f884-4e51-9858-f8462fcab5e8 response_code = 200 uri = /vpc-routes
18562024-12-03T23:17:48.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60816 req_id = 09b2e2d8-cacd-4437-8ef7-99c8ed149312 response_code = 200 uri = /v2p
18572024-12-03T23:17:48.063ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18582024-12-03T23:17:48.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43199 req_id = c380f7c9-c5b9-4231-937b-d4d5edfb8b9c response_code = 204 uri = /eip-gateways
18592024-12-03T23:17:48.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43199 req_id = 348095f6-a77f-4cde-9fc5-eab47e9c4b38 response_code = 204 uri = /vpc-routes
18602024-12-03T23:17:48.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56467
18612024-12-03T23:17:48.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56467 req_id = 12f4a648-e4fb-48fb-9cae-4f81f6bd1ac8 response_code = 200 uri = /v2p
18622024-12-03T23:17:48.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36434
18632024-12-03T23:17:48.095ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18642024-12-03T23:17:48.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18652024-12-03T23:17:48.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36434 req_id = 9f8cbf61-9a49-4aa3-b614-cd607c47ba4e response_code = 204 uri = /switch-ports
18662024-12-03T23:17:48.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36434 req_id = d7946049-97ea-4cb4-a491-367c7e8d20fb response_code = 200 uri = /network-bootstore-config
18672024-12-03T23:18:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6724 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 9fda68ca-e128-4c5e-af38-230564d43ef2 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
18682024-12-03T23:18:08.049ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53601
18692024-12-03T23:18:08.049ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53601 req_id = d77ce3c3-ce47-4ca3-b4ee-6e3e8346a04f response_code = 200 uri = /baseboard
18702024-12-03T23:18:17.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58150
18712024-12-03T23:18:17.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58150 req_id = 362bd69d-66b7-4258-9c99-b13167fb5446 response_code = 200 uri = /vpc-routes
18722024-12-03T23:18:17.790ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18732024-12-03T23:18:17.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58150 req_id = 3a9d507f-fc38-4247-abc7-ce98b6d7b7f7 response_code = 204 uri = /eip-gateways
18742024-12-03T23:18:17.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51319
18752024-12-03T23:18:17.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51319 req_id = 7376ec66-0478-436d-ba76-fcc78ec8c399 response_code = 200 uri = /v2p
18762024-12-03T23:18:17.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58150 req_id = e807fc2a-a03e-4385-b74c-35ce4e4acd97 response_code = 204 uri = /vpc-routes
18772024-12-03T23:18:18.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52290
18782024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18792024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18802024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18812024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18822024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18832024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18842024-12-03T23:18:18.028ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18852024-12-03T23:18:18.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52290 req_id = f60d1c15-cfe1-498e-9d81-178b52fd9bd1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18862024-12-03T23:18:18.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62656
18872024-12-03T23:18:18.052ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18882024-12-03T23:18:18.098ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18892024-12-03T23:18:18.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116557 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62656 req_id = 3d90e09b-ac14-43e6-81aa-1538219b449f response_code = 204 uri = /switch-ports
18902024-12-03T23:18:18.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36709
18912024-12-03T23:18:18.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63836
18922024-12-03T23:18:18.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63836 req_id = 45c188fc-87b5-4f62-99c0-71e4ed0ebf2f response_code = 200 uri = /vpc-routes
18932024-12-03T23:18:18.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36709 req_id = a0c97ae7-9421-4726-b29d-baf997c3ad0e response_code = 200 uri = /vpc-routes
18942024-12-03T23:18:18.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62656 req_id = 53b90a87-9227-4b47-996f-ec98817dcce6 response_code = 200 uri = /network-bootstore-config
18952024-12-03T23:18:18.182ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
18962024-12-03T23:18:18.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63836 req_id = 885f1563-c2df-412c-ac46-2edba900564e response_code = 204 uri = /eip-gateways
18972024-12-03T23:18:18.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63836 req_id = a4df174e-a670-4c22-a098-6efc489f6564 response_code = 204 uri = /vpc-routes
18982024-12-03T23:18:18.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55805
18992024-12-03T23:18:18.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19002024-12-03T23:18:18.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19012024-12-03T23:18:18.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55805 req_id = df899d9e-957d-4e2c-b3ac-743fdc31f003 response_code = 204 uri = /switch-ports
19022024-12-03T23:18:18.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33568
19032024-12-03T23:18:18.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53586
19042024-12-03T23:18:18.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55805 req_id = efe6b41b-675f-4e6c-a879-9a01221d7106 response_code = 200 uri = /network-bootstore-config
19052024-12-03T23:18:18.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33568 req_id = 389df858-2560-4546-a111-08c36c15b64d response_code = 200 uri = /v2p
19062024-12-03T23:18:18.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53586 req_id = ba4a2c56-0e14-444a-88b2-246e9541200f response_code = 200 uri = /v2p
19072024-12-03T23:18:18.301ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19082024-12-03T23:18:18.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36709 req_id = 87382335-8caa-43d2-ad91-2d5efb923959 response_code = 204 uri = /eip-gateways
19092024-12-03T23:18:18.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36709 req_id = de4de869-42e2-467c-8925-b08bd963c33a response_code = 204 uri = /vpc-routes
19102024-12-03T23:18:18.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42149
19112024-12-03T23:18:18.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19122024-12-03T23:18:18.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19132024-12-03T23:18:18.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88755 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42149 req_id = 2abea4c4-d9f8-4808-bf11-7eae0d9d06d4 response_code = 204 uri = /switch-ports
19142024-12-03T23:18:18.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48703
19152024-12-03T23:18:18.445ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19162024-12-03T23:18:18.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42149 req_id = d6e9fdb8-b835-4cd9-8292-1b8e1b82b32b response_code = 200 uri = /network-bootstore-config
19172024-12-03T23:18:18.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19182024-12-03T23:18:18.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19192024-12-03T23:18:18.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19202024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19212024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19222024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19232024-12-03T23:18:18.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48703 req_id = 47fb9a74-c05d-4ef4-a69f-88acd271ee3e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19242024-12-03T23:18:18.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36851
19252024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19262024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19272024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19282024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19292024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19302024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19312024-12-03T23:18:18.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19322024-12-03T23:18:18.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36851 req_id = cdda54bb-6f5d-4f6f-b157-40b6617985d3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19332024-12-03T23:18:30.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6836 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 6bd07c63-f6ff-4ff1-94ad-11d5cc096bbb response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
19342024-12-03T23:18:38.082ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63130
19352024-12-03T23:18:38.082ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63130 req_id = b8d71e1d-11e0-42c7-afd5-78f122aba3d7 response_code = 200 uri = /baseboard
19362024-12-03T23:18:47.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61042
19372024-12-03T23:18:47.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61042 req_id = 064dfa77-ba9b-492e-b308-a8b9e8f5106e response_code = 200 uri = /vpc-routes
19382024-12-03T23:18:47.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34952
19392024-12-03T23:18:47.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34952 req_id = 22db318c-2bfa-4ab1-b5fa-b8cfab2da680 response_code = 200 uri = /v2p
19402024-12-03T23:18:47.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19412024-12-03T23:18:47.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61042 req_id = 23e6f982-80c2-4a5d-b6bc-4d4ad8684dfe response_code = 204 uri = /eip-gateways
19422024-12-03T23:18:47.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61042 req_id = 4261753d-0d0f-457c-b606-420283f3cd5d response_code = 204 uri = /vpc-routes
19432024-12-03T23:18:47.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40517
19442024-12-03T23:18:47.688ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19452024-12-03T23:18:47.746ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19462024-12-03T23:18:47.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127094 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40517 req_id = 72d6e736-5b9b-4c2c-813b-dce6925a4bc5 response_code = 204 uri = /switch-ports
19472024-12-03T23:18:47.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40517 req_id = c0a9f5cc-aea6-4989-a4b6-134bf334ae70 response_code = 200 uri = /network-bootstore-config
19482024-12-03T23:18:47.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52883
19492024-12-03T23:18:47.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52883 req_id = 31fb688e-012f-4be8-a6e7-8fda67d97a3d response_code = 200 uri = /vpc-routes
19502024-12-03T23:18:47.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55241
19512024-12-03T23:18:47.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55241 req_id = 4c2d2b0d-1e1e-4df3-8040-ae785f59fb05 response_code = 200 uri = /vpc-routes
19522024-12-03T23:18:47.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19532024-12-03T23:18:47.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52883 req_id = 8c8e8e9c-6ebc-4b49-b5d6-f01cc0cdc2fe response_code = 204 uri = /eip-gateways
19542024-12-03T23:18:47.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52883 req_id = e4de2bde-9e6b-4276-a17c-cb4e303e27ed response_code = 204 uri = /vpc-routes
19552024-12-03T23:18:47.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55924
19562024-12-03T23:18:47.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55924 req_id = ab2ccde8-e492-48c0-a99f-e905e3e48b38 response_code = 200 uri = /v2p
19572024-12-03T23:18:47.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61740
19582024-12-03T23:18:47.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19592024-12-03T23:18:47.978ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19602024-12-03T23:18:48.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94370 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61740 req_id = d1e16ad7-4b81-4977-94c4-961ae49fa430 response_code = 204 uri = /switch-ports
19612024-12-03T23:18:48.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19622024-12-03T23:18:48.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34358
19632024-12-03T23:18:48.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55241 req_id = f9c9c0ff-8e2e-4415-82ab-b2272affc0d6 response_code = 204 uri = /eip-gateways
19642024-12-03T23:18:48.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61740 req_id = 171511cc-afd1-4947-b06c-68319e2b4973 response_code = 200 uri = /network-bootstore-config
19652024-12-03T23:18:48.037ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19662024-12-03T23:18:48.051ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55241 req_id = d4c5b283-23fb-4962-85ed-248a773f6d9f response_code = 204 uri = /vpc-routes
19672024-12-03T23:18:48.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19682024-12-03T23:18:48.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50408
19692024-12-03T23:18:48.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50408 req_id = d326376c-f5bf-4395-952e-0f2754a55c19 response_code = 200 uri = /v2p
19702024-12-03T23:18:48.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102992 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34358 req_id = c5295ac2-874a-45c0-b694-a033b4074b7c response_code = 204 uri = /switch-ports
19712024-12-03T23:18:48.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34358 req_id = 8a5629b5-7743-4a73-a565-e95f14b10072 response_code = 200 uri = /network-bootstore-config
19722024-12-03T23:19:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7117 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 27033a0a-971e-4394-b132-10bfc1274334 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
19732024-12-03T23:19:08.115ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44254
19742024-12-03T23:19:08.115ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44254 req_id = 25699889-92ce-4a74-8100-dd631145b1ee response_code = 200 uri = /baseboard
19752024-12-03T23:19:17.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62236
19762024-12-03T23:19:17.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62236 req_id = 753e7d29-488d-4374-81b6-f4bacca4ba1f response_code = 200 uri = /vpc-routes
19772024-12-03T23:19:17.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19782024-12-03T23:19:17.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62236 req_id = efd5bc20-09d8-4a49-a44a-780c4577d1a4 response_code = 204 uri = /eip-gateways
19792024-12-03T23:19:17.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62236 req_id = ab0d9c1c-df4f-4803-b551-1cfd4ed9f768 response_code = 204 uri = /vpc-routes
19802024-12-03T23:19:17.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57543
19812024-12-03T23:19:17.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57543 req_id = 9204245d-74f3-4971-8a31-fea5c1362752 response_code = 200 uri = /v2p
19822024-12-03T23:19:17.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36230
19832024-12-03T23:19:17.913ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19842024-12-03T23:19:17.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19852024-12-03T23:19:18.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36230 req_id = 990371f6-4ab7-4ca1-a5d1-202fd7fa0c2a response_code = 204 uri = /switch-ports
19862024-12-03T23:19:18.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49597
19872024-12-03T23:19:18.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49597 req_id = c5260522-8907-45b4-9acf-a635bf5e2dbb response_code = 200 uri = /vpc-routes
19882024-12-03T23:19:18.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36230 req_id = ddffa3c5-b94e-430d-89a7-7f3fac6dc3ae response_code = 200 uri = /network-bootstore-config
19892024-12-03T23:19:18.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58943
19902024-12-03T23:19:18.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58943 req_id = d97d5144-06d4-481d-ac8e-3f612c6f86d4 response_code = 200 uri = /vpc-routes
19912024-12-03T23:19:18.057ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19922024-12-03T23:19:18.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49597 req_id = fd0706da-c003-4c91-a88e-6dac39b0bdbe response_code = 204 uri = /eip-gateways
19932024-12-03T23:19:18.057ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
19942024-12-03T23:19:18.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58943 req_id = a0b4dff5-1e8b-462d-b9a4-a44339859ff3 response_code = 204 uri = /eip-gateways
19952024-12-03T23:19:18.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58943 req_id = d211d080-8ba7-48c7-a826-f0920a7cbad5 response_code = 204 uri = /vpc-routes
19962024-12-03T23:19:18.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33936
19972024-12-03T23:19:18.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33936 req_id = a59d5f42-319d-41a3-a373-46ea9d8e9a72 response_code = 200 uri = /v2p
19982024-12-03T23:19:18.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49597 req_id = d678de5f-0951-4059-8db7-9d3628342cc0 response_code = 204 uri = /vpc-routes
19992024-12-03T23:19:18.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37364
20002024-12-03T23:19:18.176ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20012024-12-03T23:19:18.213ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20022024-12-03T23:19:18.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90715 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37364 req_id = 10b560f3-b100-4520-add7-96b422c8ea93 response_code = 204 uri = /switch-ports
20032024-12-03T23:19:18.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54487
20042024-12-03T23:19:18.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54487 req_id = fed074f5-01bb-42a1-b1a6-8f2591f4f0f8 response_code = 200 uri = /v2p
20052024-12-03T23:19:18.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37364 req_id = 83064f20-b4f4-407b-9b19-4df75cb5c462 response_code = 200 uri = /network-bootstore-config
20062024-12-03T23:19:18.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48491
20072024-12-03T23:19:18.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20082024-12-03T23:19:18.386ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20092024-12-03T23:19:18.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87044 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48491 req_id = e8d699e3-58ab-4dd4-a05b-008939ee0ba8 response_code = 204 uri = /switch-ports
20102024-12-03T23:19:18.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48491 req_id = 633860ed-cbf5-4a4b-8b56-8d9f2eb3d4df response_code = 200 uri = /network-bootstore-config
20112024-12-03T23:19:30.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7482 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 1b5d2384-1649-46b2-9f87-bd1c7d9765c4 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
20122024-12-03T23:19:38.148ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58931
20132024-12-03T23:19:38.148ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58931 req_id = 43e53bcd-0340-4d07-9fde-06b6c8a12e2e response_code = 200 uri = /baseboard
20142024-12-03T23:19:47.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42336
20152024-12-03T23:19:47.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42336 req_id = 3402981a-f0f4-4e12-8127-fe97ea0be280 response_code = 200 uri = /v2p
20162024-12-03T23:19:47.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45253
20172024-12-03T23:19:47.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45253 req_id = 59b543da-b369-4031-90fa-fab8b52c6680 response_code = 200 uri = /vpc-routes
20182024-12-03T23:19:47.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60389
20192024-12-03T23:19:47.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60389 req_id = d95d6dca-ae33-4c5b-96e0-4d01fe494af4 response_code = 200 uri = /vpc-routes
20202024-12-03T23:19:47.773ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20212024-12-03T23:19:47.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60389 req_id = cb8d57ad-01da-4a69-9d75-0d0363e69f47 response_code = 204 uri = /eip-gateways
20222024-12-03T23:19:47.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60389 req_id = 62f598c4-3421-4718-907f-110c2f99a542 response_code = 204 uri = /vpc-routes
20232024-12-03T23:19:47.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20242024-12-03T23:19:47.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45253 req_id = 681deeba-07ac-403a-aca8-65822106ddbd response_code = 204 uri = /eip-gateways
20252024-12-03T23:19:47.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45253 req_id = 17c6f3ad-f3c4-4239-9d55-b9729655a174 response_code = 204 uri = /vpc-routes
20262024-12-03T23:19:47.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58561
20272024-12-03T23:19:47.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20282024-12-03T23:19:47.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20292024-12-03T23:19:47.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58561 req_id = fbe9a62d-dee1-47a2-bdb5-c169d167fee0 response_code = 204 uri = /switch-ports
20302024-12-03T23:19:47.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49700
20312024-12-03T23:19:47.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52668
20322024-12-03T23:19:47.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52668 req_id = 6a38966f-ede8-4b07-90c9-6d71edb756db response_code = 200 uri = /vpc-routes
20332024-12-03T23:19:47.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58561 req_id = 1b38d433-3988-4b8b-b6e5-3de46d111b68 response_code = 200 uri = /network-bootstore-config
20342024-12-03T23:19:47.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49700 req_id = f24601d4-add2-41c0-bff1-32618f62fb1d response_code = 200 uri = /v2p
20352024-12-03T23:19:47.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47085
20362024-12-03T23:19:47.953ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20372024-12-03T23:19:47.991ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20382024-12-03T23:19:48.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47085 req_id = 918ff49d-98e5-4298-832b-2661f7925e84 response_code = 204 uri = /switch-ports
20392024-12-03T23:19:48.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20402024-12-03T23:19:48.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52668 req_id = 713e19c7-680d-4dc1-b9e6-7eed9711aea7 response_code = 204 uri = /eip-gateways
20412024-12-03T23:19:48.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47085 req_id = 5efafa08-a03e-40ed-8d18-ce9c0fc2e8ad response_code = 200 uri = /network-bootstore-config
20422024-12-03T23:19:48.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52668 req_id = eb59eb59-75ec-4675-993e-7122e74285a8 response_code = 204 uri = /vpc-routes
20432024-12-03T23:19:48.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50237
20442024-12-03T23:19:48.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50237 req_id = c2bb582c-113c-4663-bcfb-3c2dda1861ee response_code = 200 uri = /v2p
20452024-12-03T23:19:48.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56448
20462024-12-03T23:19:48.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20472024-12-03T23:19:48.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20482024-12-03T23:19:48.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56448 req_id = e23741e1-f1df-4b58-9092-6ed24b5bc1e6 response_code = 204 uri = /switch-ports
20492024-12-03T23:19:48.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56448 req_id = e56c719c-117b-4c04-a1c0-d94c98c5f3ee response_code = 200 uri = /network-bootstore-config
20502024-12-03T23:20:00.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7424 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 29155ae2-e8c3-47e5-9904-ef2055246809 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
20512024-12-03T23:20:08.180ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36913
20522024-12-03T23:20:08.181ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36913 req_id = 1db3331a-1610-4ebf-ac96-ccb3a3306295 response_code = 200 uri = /baseboard
20532024-12-03T23:20:17.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44197
20542024-12-03T23:20:17.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44197 req_id = 52b59002-48e6-465e-91ba-bb3690036e0b response_code = 200 uri = /v2p
20552024-12-03T23:20:17.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63194
20562024-12-03T23:20:17.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63194 req_id = ff703e64-6bf8-4f0f-9a31-ca324a06066e response_code = 200 uri = /vpc-routes
20572024-12-03T23:20:17.929ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20582024-12-03T23:20:17.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63194 req_id = d84b546e-040d-4327-89ea-21a106c3065d response_code = 204 uri = /eip-gateways
20592024-12-03T23:20:17.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63194 req_id = 1ef0fa0f-643d-46a1-88f1-122bf9d195df response_code = 204 uri = /vpc-routes
20602024-12-03T23:20:18.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33067
20612024-12-03T23:20:18.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33067 req_id = 3d94c2ce-ebd5-4041-8016-8b4577bd9728 response_code = 200 uri = /vpc-routes
20622024-12-03T23:20:18.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41513
20632024-12-03T23:20:18.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41513 req_id = 2cffc3a7-893e-49c7-bd46-50cb5515def8 response_code = 200 uri = /vpc-routes
20642024-12-03T23:20:18.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44256
20652024-12-03T23:20:18.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20662024-12-03T23:20:18.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20672024-12-03T23:20:18.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44256 req_id = ebc824ee-9276-4015-8882-f59da3b23912 response_code = 204 uri = /switch-ports
20682024-12-03T23:20:18.147ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20692024-12-03T23:20:18.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3433 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44256 req_id = 48490ad5-63ca-4d20-a9a1-dac1ff3e1ef7 response_code = 200 uri = /network-bootstore-config
20702024-12-03T23:20:18.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3528 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41513 req_id = 5563a5ba-f922-4099-8f13-d11d441c7fa7 response_code = 204 uri = /eip-gateways
20712024-12-03T23:20:18.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20722024-12-03T23:20:18.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3782 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33067 req_id = bc149b74-2fc8-4926-8c76-dc66535a58fd response_code = 204 uri = /eip-gateways
20732024-12-03T23:20:18.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33067 req_id = 25248a51-978e-44a6-a128-259441d1a6c8 response_code = 204 uri = /vpc-routes
20742024-12-03T23:20:18.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52046
20752024-12-03T23:20:18.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52046 req_id = 1aff8bf4-e3be-41f7-a952-35729e47944a response_code = 200 uri = /v2p
20762024-12-03T23:20:18.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41513 req_id = 7d1c4ee4-ee7b-4ea2-ab68-c7858da17089 response_code = 204 uri = /vpc-routes
20772024-12-03T23:20:18.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41090
20782024-12-03T23:20:18.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51847
20792024-12-03T23:20:18.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41090 req_id = a472af19-109f-4e74-8679-7c945cc697e7 response_code = 200 uri = /v2p
20802024-12-03T23:20:18.189ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20812024-12-03T23:20:18.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20822024-12-03T23:20:18.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51847 req_id = 40960127-1600-4c5d-b7fb-05f3ca019425 response_code = 204 uri = /switch-ports
20832024-12-03T23:20:18.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47238
20842024-12-03T23:20:18.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51847 req_id = 4cf4a37d-5e30-43eb-8ffc-1235811b2445 response_code = 200 uri = /network-bootstore-config
20852024-12-03T23:20:18.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20862024-12-03T23:20:18.311ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20872024-12-03T23:20:18.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90137 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47238 req_id = 7ce173f1-6bfb-45e2-ab7b-69a2a9839c6f response_code = 204 uri = /switch-ports
20882024-12-03T23:20:18.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47238 req_id = 99f28203-363f-475f-82e9-b5914c05e850 response_code = 200 uri = /network-bootstore-config
20892024-12-03T23:20:30.611ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6930 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 85a1346e-8508-46a5-b1dc-3f7b9aa070de response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
20902024-12-03T23:20:38.214ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64617
20912024-12-03T23:20:38.214ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64617 req_id = b50dbd00-34ec-48cd-aeb8-4e6e227f6ff6 response_code = 200 uri = /baseboard
20922024-12-03T23:20:47.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43599
20932024-12-03T23:20:47.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43599 req_id = 20c772ad-d20e-4e53-99ad-d43a89e4dffd response_code = 200 uri = /vpc-routes
20942024-12-03T23:20:47.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
20952024-12-03T23:20:47.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43599 req_id = 179650ee-4db4-483f-b831-4e44b04d2564 response_code = 204 uri = /eip-gateways
20962024-12-03T23:20:47.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47645
20972024-12-03T23:20:47.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47645 req_id = 112e3588-288b-418a-8e92-ad748b916796 response_code = 200 uri = /v2p
20982024-12-03T23:20:47.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43599 req_id = 822b46fc-ecd8-4a65-9946-8a1de24a5baa response_code = 204 uri = /vpc-routes
20992024-12-03T23:20:47.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60106
21002024-12-03T23:20:47.815ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21012024-12-03T23:20:47.857ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21022024-12-03T23:20:47.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 71110a0a-fef5-4dfe-93b1-05cf7ab2bfcc response_code = 204 uri = /switch-ports
21032024-12-03T23:20:47.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60106 req_id = 32aade8f-ff67-42b4-8612-564d67eafaf7 response_code = 200 uri = /network-bootstore-config
21042024-12-03T23:20:47.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36407
21052024-12-03T23:20:47.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36407 req_id = 88724c66-7993-4ad8-ae5b-60dda4516947 response_code = 200 uri = /vpc-routes
21062024-12-03T23:20:47.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21072024-12-03T23:20:47.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36407 req_id = c06b650f-92e7-4579-b2d2-bc2714b5685a response_code = 204 uri = /eip-gateways
21082024-12-03T23:20:47.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36407 req_id = e8516623-9279-4f4d-8eed-b828d49cc692 response_code = 204 uri = /vpc-routes
21092024-12-03T23:20:47.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47605
21102024-12-03T23:20:47.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47605 req_id = 48c654e2-fe12-4de7-a52e-a1f7822c2437 response_code = 200 uri = /vpc-routes
21112024-12-03T23:20:47.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44503
21122024-12-03T23:20:47.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21132024-12-03T23:20:48.037ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21142024-12-03T23:20:48.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44503 req_id = 61de267d-86c3-4f67-8729-c023009de73d response_code = 204 uri = /switch-ports
21152024-12-03T23:20:48.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38497
21162024-12-03T23:20:48.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33565
21172024-12-03T23:20:48.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43033
21182024-12-03T23:20:48.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21192024-12-03T23:20:48.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44503 req_id = 847320c7-1534-46af-8f6b-bdba8e7d3cec response_code = 200 uri = /network-bootstore-config
21202024-12-03T23:20:48.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21212024-12-03T23:20:48.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47605 req_id = 5406f75a-3a86-423b-87d4-287a5027f79c response_code = 204 uri = /eip-gateways
21222024-12-03T23:20:48.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4061 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38497 req_id = 0d30196a-474c-4c56-a17c-d98fdd016c3a response_code = 200 uri = /v2p
21232024-12-03T23:20:48.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33565 req_id = bd6a771b-ead8-4fb7-af4c-d27d9f1949ad response_code = 200 uri = /v2p
21242024-12-03T23:20:48.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47605 req_id = 84caafdc-15da-4e58-9123-6453c8312c0d response_code = 204 uri = /vpc-routes
21252024-12-03T23:20:48.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21262024-12-03T23:20:48.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43033 req_id = 5c53ac7e-7fc3-4608-a6f6-aa34c8c72388 response_code = 204 uri = /switch-ports
21272024-12-03T23:20:48.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43033 req_id = 77942074-078f-4bb8-96b7-50c4dc9f58f4 response_code = 200 uri = /network-bootstore-config
21282024-12-03T23:21:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7155 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = e25d847f-8889-4a1e-8f84-e196b0e278cf response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
21292024-12-03T23:21:02.266ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
21302024-12-03T23:21:02.267ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
21312024-12-03T23:21:02.298ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 5778, tv_nsec: 984954876 } time_to_next_cleanup = 599.9999953s
21322024-12-03T23:21:08.248ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49647
21332024-12-03T23:21:08.248ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49647 req_id = 1d23b09a-1c97-4446-b9a9-036ba3432bf6 response_code = 200 uri = /baseboard
21342024-12-03T23:21:16.513ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21352024-12-03T23:21:17.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39697
21362024-12-03T23:21:17.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39697 req_id = 4ce744f3-a815-4bbc-a449-1903a486b903 response_code = 200 uri = /vpc-routes
21372024-12-03T23:21:17.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21382024-12-03T23:21:17.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39697 req_id = e81fd4a8-dc3f-4553-9caf-f8c462a26256 response_code = 204 uri = /eip-gateways
21392024-12-03T23:21:17.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39697 req_id = ca168413-4e39-440d-961f-1a584257635f response_code = 204 uri = /vpc-routes
21402024-12-03T23:21:17.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52415
21412024-12-03T23:21:17.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52415 req_id = e1a2b8f4-89eb-4461-8f8d-b0bac3a6b072 response_code = 200 uri = /vpc-routes
21422024-12-03T23:21:18.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21432024-12-03T23:21:18.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52415 req_id = f3c1c2bc-72c7-485b-a5f1-72bcba46579b response_code = 204 uri = /eip-gateways
21442024-12-03T23:21:18.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49707
21452024-12-03T23:21:18.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49707 req_id = e088c921-3a90-4ca1-8911-51d95aace772 response_code = 200 uri = /v2p
21462024-12-03T23:21:18.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52415 req_id = 4fca9418-7a4d-49c0-92b5-c2d165b4ebeb response_code = 204 uri = /vpc-routes
21472024-12-03T23:21:18.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45739
21482024-12-03T23:21:18.060ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21492024-12-03T23:21:18.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21502024-12-03T23:21:18.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45739 req_id = 1abd17c2-fe03-49f1-bbc7-ec32b636f14e response_code = 204 uri = /switch-ports
21512024-12-03T23:21:18.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54360
21522024-12-03T23:21:18.167ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21532024-12-03T23:21:18.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21542024-12-03T23:21:18.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54360 req_id = 66dca764-76a9-4abe-92ee-8523bd8625ce response_code = 204 uri = /switch-ports
21552024-12-03T23:21:18.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33970
21562024-12-03T23:21:18.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45739 req_id = 8c7afe1b-6157-4485-a82c-e7e7795febb9 response_code = 200 uri = /network-bootstore-config
21572024-12-03T23:21:18.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43374
21582024-12-03T23:21:18.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34926
21592024-12-03T23:21:18.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54360 req_id = 6a3e4064-17f8-405b-93a9-a66c614e7ab9 response_code = 200 uri = /network-bootstore-config
21602024-12-03T23:21:18.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33970 req_id = 3053caa6-7cc6-49af-bfc5-844e533eaaeb response_code = 200 uri = /v2p
21612024-12-03T23:21:18.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34926 req_id = 4f63f53f-8ce6-4ea9-bd6f-d2cd3c104ef8 response_code = 200 uri = /vpc-routes
21622024-12-03T23:21:18.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43374 req_id = 6fa21cba-c415-4838-8c62-71a9b51a4c45 response_code = 200 uri = /v2p
21632024-12-03T23:21:18.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21642024-12-03T23:21:18.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34926 req_id = ee1e04e0-6360-4686-a9d9-56c5ebfa8fab response_code = 204 uri = /eip-gateways
21652024-12-03T23:21:18.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34926 req_id = b0ce2297-e465-4115-875f-1407b2f6d3ae response_code = 204 uri = /vpc-routes
21662024-12-03T23:21:18.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58366
21672024-12-03T23:21:18.294ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21682024-12-03T23:21:18.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21692024-12-03T23:21:18.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58366 req_id = 5dd59f0f-6534-48f4-80d7-efbc665b994b response_code = 204 uri = /switch-ports
21702024-12-03T23:21:18.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58366 req_id = 1d57d015-cff8-4446-abf5-1cfbd5af63f9 response_code = 200 uri = /network-bootstore-config
21712024-12-03T23:21:30.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8231 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 9a292b5d-52fb-4168-bf04-21c928ffd765 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
21722024-12-03T23:21:38.281ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39442
21732024-12-03T23:21:38.281ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39442 req_id = a4d09e4f-084d-47e8-bc32-d524c107afd6 response_code = 200 uri = /baseboard
21742024-12-03T23:21:47.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52393
21752024-12-03T23:21:47.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52393 req_id = 6f80d93d-ef7e-4196-b806-a62d2442d1d7 response_code = 200 uri = /vpc-routes
21762024-12-03T23:21:47.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21772024-12-03T23:21:47.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52393 req_id = 21493a37-e050-4e69-a540-f366a22415c9 response_code = 204 uri = /eip-gateways
21782024-12-03T23:21:47.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52393 req_id = 5c1dfa19-7b35-4072-b48a-749a1e8e41be response_code = 204 uri = /vpc-routes
21792024-12-03T23:21:47.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52669
21802024-12-03T23:21:47.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52669 req_id = 43757d6f-6439-46cc-b5a1-e22f23012346 response_code = 200 uri = /v2p
21812024-12-03T23:21:47.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38506
21822024-12-03T23:21:47.835ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21832024-12-03T23:21:47.884ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21842024-12-03T23:21:47.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38506 req_id = 56cc6039-91d0-4593-94a2-a74f81dbc5fa response_code = 204 uri = /switch-ports
21852024-12-03T23:21:47.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60767
21862024-12-03T23:21:47.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60767 req_id = ed9d57de-5543-409e-b712-d7dff7967bbe response_code = 200 uri = /vpc-routes
21872024-12-03T23:21:47.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38506 req_id = 6d1f0a9c-d572-4413-9726-e4c3d08cb4a0 response_code = 200 uri = /network-bootstore-config
21882024-12-03T23:21:47.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40520
21892024-12-03T23:21:47.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40520 req_id = 75db85d8-eff9-4749-a6e6-1e8e564cbb17 response_code = 200 uri = /vpc-routes
21902024-12-03T23:21:47.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61824
21912024-12-03T23:21:47.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61824 req_id = b5fb2309-b31a-46eb-85b6-23e5283adddd response_code = 200 uri = /v2p
21922024-12-03T23:21:47.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
21932024-12-03T23:21:47.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40520 req_id = 3056c80b-3d87-4073-9304-613d1666db0a response_code = 204 uri = /eip-gateways
21942024-12-03T23:21:47.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55166
21952024-12-03T23:21:47.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21962024-12-03T23:21:48.026ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21972024-12-03T23:21:48.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55166 req_id = 4ad5c522-bb27-4f8f-a59e-0ab37fb62d38 response_code = 204 uri = /switch-ports
21982024-12-03T23:21:48.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55371
21992024-12-03T23:21:48.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54959
22002024-12-03T23:21:48.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22012024-12-03T23:21:48.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22022024-12-03T23:21:48.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55166 req_id = b5a9a826-e235-4ae7-83af-d8bb4fa862f6 response_code = 200 uri = /network-bootstore-config
22032024-12-03T23:21:48.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40520 req_id = dea14db4-2333-4801-b86d-ade7fa9bece6 response_code = 204 uri = /vpc-routes
22042024-12-03T23:21:48.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3007 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55371 req_id = e4115061-fca5-4653-afea-f6ba9c85e212 response_code = 200 uri = /v2p
22052024-12-03T23:21:48.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60767 req_id = 4433a542-ec38-4fe6-9557-7590c694e1eb response_code = 204 uri = /eip-gateways
22062024-12-03T23:21:48.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 824 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60767 req_id = 0acd11d7-e598-4e17-a307-f17e063d165b response_code = 204 uri = /vpc-routes
22072024-12-03T23:21:48.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22082024-12-03T23:21:48.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82735 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54959 req_id = 89d40b59-c7b6-41a5-8470-aa304fe4897c response_code = 204 uri = /switch-ports
22092024-12-03T23:21:48.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54959 req_id = 51997454-4b6c-4112-b3ca-4126b2bc112d response_code = 200 uri = /network-bootstore-config
22102024-12-03T23:22:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7334 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 501dfc22-8b09-4085-bed4-464d35c0e009 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
22112024-12-03T23:22:08.314ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64257
22122024-12-03T23:22:08.314ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64257 req_id = e078d049-8d52-4811-865e-bdce64de3f31 response_code = 200 uri = /baseboard
22132024-12-03T23:22:17.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55872
22142024-12-03T23:22:17.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55872 req_id = 3c1a1ca4-d53c-4034-8536-bf022150997a response_code = 200 uri = /vpc-routes
22152024-12-03T23:22:17.819ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22162024-12-03T23:22:17.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55872 req_id = dbbe3c8e-1630-46d7-a1f5-b29b6e9a5e06 response_code = 204 uri = /eip-gateways
22172024-12-03T23:22:17.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48781
22182024-12-03T23:22:17.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48781 req_id = 7558520f-86f8-4ca4-baea-b2dee36e5b02 response_code = 200 uri = /v2p
22192024-12-03T23:22:17.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55872 req_id = bd5848f2-ea6a-4cc5-8708-b9368fe575e2 response_code = 204 uri = /vpc-routes
22202024-12-03T23:22:17.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48241
22212024-12-03T23:22:17.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22222024-12-03T23:22:18.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22232024-12-03T23:22:18.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48241 req_id = 62620c2f-fb78-4487-8ef7-f465bbdb2e50 response_code = 204 uri = /switch-ports
22242024-12-03T23:22:18.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40496
22252024-12-03T23:22:18.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48241 req_id = 8c6e974f-9e91-41d5-a176-492c12730f49 response_code = 200 uri = /network-bootstore-config
22262024-12-03T23:22:18.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40496 req_id = b5a5675c-1434-408a-9245-3b41c21c9fa8 response_code = 200 uri = /vpc-routes
22272024-12-03T23:22:18.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22282024-12-03T23:22:18.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40496 req_id = e17e085d-3784-47a0-9834-407864a3fa14 response_code = 204 uri = /eip-gateways
22292024-12-03T23:22:18.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59005
22302024-12-03T23:22:18.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59005 req_id = 0857af90-c480-4f16-aa39-913f0478355c response_code = 200 uri = /v2p
22312024-12-03T23:22:18.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57466
22322024-12-03T23:22:18.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57466 req_id = 8be37728-cce6-43b0-8a75-3cde4d840c0f response_code = 200 uri = /vpc-routes
22332024-12-03T23:22:18.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22342024-12-03T23:22:18.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57466 req_id = 72514eed-6de6-43e2-9341-7df4770a51f3 response_code = 204 uri = /eip-gateways
22352024-12-03T23:22:18.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57466 req_id = c0ba2149-9cf4-46da-83be-67f9245599b6 response_code = 204 uri = /vpc-routes
22362024-12-03T23:22:18.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36557
22372024-12-03T23:22:18.306ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22382024-12-03T23:22:18.341ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22392024-12-03T23:22:18.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36557 req_id = 07e60466-b4b3-4df5-b28e-6bbd5b78d819 response_code = 204 uri = /switch-ports
22402024-12-03T23:22:18.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50044
22412024-12-03T23:22:18.398ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49889
22422024-12-03T23:22:18.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50044 req_id = 2206c840-ce82-4681-9e9c-4d6215719ddc response_code = 200 uri = /v2p
22432024-12-03T23:22:18.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36557 req_id = ccfdf7e9-7160-4c6a-ae60-4f8b38637abd response_code = 200 uri = /network-bootstore-config
22442024-12-03T23:22:18.398ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22452024-12-03T23:22:18.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40496 req_id = 1e27bd72-a523-41b5-8517-1fe2af658957 response_code = 204 uri = /vpc-routes
22462024-12-03T23:22:18.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22472024-12-03T23:22:18.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49889 req_id = f1b61289-6931-4a0a-a9aa-4022e217aeab response_code = 204 uri = /switch-ports
22482024-12-03T23:22:18.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49889 req_id = 219c58ee-6a1b-44c9-a3cf-9423201d8268 response_code = 200 uri = /network-bootstore-config
22492024-12-03T23:22:30.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8006 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = b888ee7e-9328-4e48-884d-2d0df8a97fbc response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
22502024-12-03T23:22:38.346ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62276
22512024-12-03T23:22:38.346ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62276 req_id = d806a057-6195-48c7-9a3a-81f7d5423a2b response_code = 200 uri = /baseboard
22522024-12-03T23:22:47.534ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53411
22532024-12-03T23:22:47.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53411 req_id = 826a633a-5b71-427e-9cd5-cb5b356f103d response_code = 200 uri = /vpc-routes
22542024-12-03T23:22:47.590ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22552024-12-03T23:22:47.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53411 req_id = ab9ebe35-0ab7-4033-9f8e-cf73216c1df0 response_code = 204 uri = /eip-gateways
22562024-12-03T23:22:47.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53411 req_id = 69322f43-9301-410e-85a1-93cee6744697 response_code = 204 uri = /vpc-routes
22572024-12-03T23:22:47.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41732
22582024-12-03T23:22:47.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41732 req_id = 869d49fb-c98f-4fa3-a4c8-8fea9432dd18 response_code = 200 uri = /v2p
22592024-12-03T23:22:47.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40699
22602024-12-03T23:22:47.799ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22612024-12-03T23:22:47.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22622024-12-03T23:22:47.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40699 req_id = b7a749ae-0841-4b86-8c60-5cda25ba0fbd response_code = 204 uri = /switch-ports
22632024-12-03T23:22:47.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50572
22642024-12-03T23:22:47.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50572 req_id = 214c4c48-c424-45a0-a209-65e76b197c02 response_code = 200 uri = /vpc-routes
22652024-12-03T23:22:47.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40699 req_id = e7d40cf6-9282-4135-92fa-ef17fbb1c6b2 response_code = 200 uri = /network-bootstore-config
22662024-12-03T23:22:47.942ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22672024-12-03T23:22:47.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50572 req_id = 40f99ad1-5b20-40d8-8c76-1b4fa9eb80b2 response_code = 204 uri = /eip-gateways
22682024-12-03T23:22:47.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63618
22692024-12-03T23:22:47.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63618 req_id = 5c257ab7-5eb9-440e-9266-abcab87d8873 response_code = 200 uri = /v2p
22702024-12-03T23:22:47.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50572 req_id = b6f438e1-69bf-436f-8027-3695548a1e91 response_code = 204 uri = /vpc-routes
22712024-12-03T23:22:47.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36005
22722024-12-03T23:22:47.989ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22732024-12-03T23:22:48.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22742024-12-03T23:22:48.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36005 req_id = b8225c31-26d1-47ac-b74b-f436f0402ffa response_code = 204 uri = /switch-ports
22752024-12-03T23:22:48.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34337
22762024-12-03T23:22:48.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34337 req_id = b6eefda1-8529-4ecb-b8c8-69db8933eac7 response_code = 200 uri = /vpc-routes
22772024-12-03T23:22:48.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36005 req_id = fee79285-f8e9-4550-8230-e9828b638f11 response_code = 200 uri = /network-bootstore-config
22782024-12-03T23:22:48.091ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22792024-12-03T23:22:48.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34337 req_id = 1add6412-8592-4e0c-8185-2a89c7aa0efc response_code = 204 uri = /eip-gateways
22802024-12-03T23:22:48.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46482
22812024-12-03T23:22:48.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46482 req_id = f1945021-a54a-46d8-8519-39931c1a03e5 response_code = 200 uri = /v2p
22822024-12-03T23:22:48.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34337 req_id = 595e266f-a5fa-4189-8052-37efd4eb87c2 response_code = 204 uri = /vpc-routes
22832024-12-03T23:22:48.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44462
22842024-12-03T23:22:48.206ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22852024-12-03T23:22:48.241ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22862024-12-03T23:22:48.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44462 req_id = 041484f7-0c7a-4fc2-abc2-0c4d0440baf9 response_code = 204 uri = /switch-ports
22872024-12-03T23:22:48.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44462 req_id = f5a09b6a-774e-4ab1-803d-86049a5f3627 response_code = 200 uri = /network-bootstore-config
22882024-12-03T23:23:00.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7789 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 8c76cd3b-eea5-4e05-9fcd-53bf61cb0b48 response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
22892024-12-03T23:23:08.380ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44930
22902024-12-03T23:23:08.380ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44930 req_id = d33cbb1e-437a-4c74-9dc5-5a57ea418b24 response_code = 200 uri = /baseboard
22912024-12-03T23:23:17.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35897
22922024-12-03T23:23:17.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35897 req_id = f0851c6b-0395-4e25-9ef3-976b17a9d9fe response_code = 200 uri = /vpc-routes
22932024-12-03T23:23:17.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
22942024-12-03T23:23:17.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35897 req_id = facbef64-0589-4dd4-a61f-488ccc662321 response_code = 204 uri = /eip-gateways
22952024-12-03T23:23:17.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35897 req_id = a6ce954f-80f7-427f-af94-42f188946d72 response_code = 204 uri = /vpc-routes
22962024-12-03T23:23:18.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49746
22972024-12-03T23:23:18.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49746 req_id = 4ae29b43-7268-4087-9f63-e02286b300d6 response_code = 200 uri = /v2p
22982024-12-03T23:23:18.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51932
22992024-12-03T23:23:18.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23002024-12-03T23:23:18.136ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23012024-12-03T23:23:18.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51932 req_id = d86f0250-84d6-4f29-bef6-b161d11122eb response_code = 204 uri = /switch-ports
23022024-12-03T23:23:18.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40987
23032024-12-03T23:23:18.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40666
23042024-12-03T23:23:18.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40987 req_id = 99e41205-33bf-4d34-97fc-ac2482dd20ba response_code = 200 uri = /vpc-routes
23052024-12-03T23:23:18.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 440 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51932 req_id = 3f733d53-8c85-4607-a883-70fa7673acbf response_code = 200 uri = /network-bootstore-config
23062024-12-03T23:23:18.193ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23072024-12-03T23:23:18.193ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23082024-12-03T23:23:18.193ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
23092024-12-03T23:23:18.193ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
23102024-12-03T23:23:18.208ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
23112024-12-03T23:23:18.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40987 req_id = d581c637-d671-46a1-ab36-04370be8e0f1 response_code = 204 uri = /eip-gateways
23122024-12-03T23:23:18.213ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23132024-12-03T23:23:18.213ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9
23142024-12-03T23:23:18.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 583 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40987 req_id = 6285a01f-3388-454f-8285-63a41e951edf response_code = 204 uri = /vpc-routes
23152024-12-03T23:23:18.244ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23162024-12-03T23:23:18.244ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_88c18331-f96d-4496-b80c-5b839f36e5ec
23172024-12-03T23:23:18.263ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41629
23182024-12-03T23:23:18.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41629 req_id = a0e8857d-e69d-46b9-b228-a6a3beb9ad5c response_code = 200 uri = /v2p
23192024-12-03T23:23:18.269ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23202024-12-03T23:23:18.269ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a
23212024-12-03T23:23:18.293ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23222024-12-03T23:23:18.293ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_477f8969-b73f-4886-851b-8d5be079baff
23232024-12-03T23:23:18.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46264
23242024-12-03T23:23:18.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46264 req_id = 91aa5ca7-2fb3-44eb-97b6-c4b223ee5ca1 response_code = 200 uri = /vpc-routes
23252024-12-03T23:23:18.315ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
23262024-12-03T23:23:18.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46264 req_id = d103fa69-3a4e-4810-83b5-7dc516fd5de8 response_code = 204 uri = /eip-gateways
23272024-12-03T23:23:18.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53231
23282024-12-03T23:23:18.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23292024-12-03T23:23:18.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23302024-12-03T23:23:18.324ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
23312024-12-03T23:23:18.324ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
23322024-12-03T23:23:18.324ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23332024-12-03T23:23:18.324ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5
23342024-12-03T23:23:18.328ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45312
23352024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23362024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23372024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23382024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23392024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23402024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23412024-12-03T23:23:18.329ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23422024-12-03T23:23:18.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45312 req_id = fe8caba0-98ed-4e9d-ae2a-851c122f5305 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23432024-12-03T23:23:18.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23442024-12-03T23:23:18.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9
23452024-12-03T23:23:18.357ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23462024-12-03T23:23:18.357ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92da16e7-325b-473a-8169-ae1c2827470d
23472024-12-03T23:23:18.382ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23482024-12-03T23:23:18.382ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b1979523-9de1-40bb-ac9e-46203987b285
23492024-12-03T23:23:18.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23502024-12-03T23:23:18.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_88c18331-f96d-4496-b80c-5b839f36e5ec
23512024-12-03T23:23:18.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45676
23522024-12-03T23:23:18.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45676 req_id = 74f3f1e1-e7bb-40e7-9932-3eba3f581fe6 response_code = 200 uri = /v2p
23532024-12-03T23:23:18.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45268
23542024-12-03T23:23:18.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23552024-12-03T23:23:18.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23562024-12-03T23:23:18.411ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/config/omicron-zones.json file = common/src/ledger.rs:177
23572024-12-03T23:23:18.411ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23582024-12-03T23:23:18.416ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1
23592024-12-03T23:23:18.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5029 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46264 req_id = cf9dc23a-94c4-4f89-b3f7-e51c8a5141a0 response_code = 204 uri = /vpc-routes
23602024-12-03T23:23:18.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51052
23612024-12-03T23:23:18.421ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/config/omicron-zones.json file = common/src/ledger.rs:177
23622024-12-03T23:23:18.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23632024-12-03T23:23:18.433ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23642024-12-03T23:23:18.433ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a
23652024-12-03T23:23:18.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62892
23662024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23672024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23682024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23692024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23702024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23712024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23722024-12-03T23:23:18.438ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23732024-12-03T23:23:18.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62892 req_id = 33dafaf6-d6e7-4165-9de4-5ba83d9cc77e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23742024-12-03T23:23:18.449ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79fb0905-996f-4ae0-9f47-4f9a399468b9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23752024-12-03T23:23:18.449ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_79fb0905-996f-4ae0-9f47-4f9a399468b9
23762024-12-03T23:23:18.465ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23772024-12-03T23:23:18.465ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d
23782024-12-03T23:23:18.472ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23792024-12-03T23:23:18.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50564
23802024-12-03T23:23:18.482ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23812024-12-03T23:23:18.482ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_477f8969-b73f-4886-851b-8d5be079baff
23822024-12-03T23:23:18.502ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 88c18331-f96d-4496-b80c-5b839f36e5ec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23832024-12-03T23:23:18.502ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_88c18331-f96d-4496-b80c-5b839f36e5ec
23842024-12-03T23:23:18.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314952 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40666 req_id = 27e2a96d-b40e-451b-8e64-10cee20fe5b2 response_code = 200 uri = /inventory
23852024-12-03T23:23:18.522ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23862024-12-03T23:23:18.522ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5
23872024-12-03T23:23:18.541ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23882024-12-03T23:23:18.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113852 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51052 req_id = f0a3467f-188b-4eae-a85a-8babb1696ffa response_code = 204 uri = /switch-ports
23892024-12-03T23:23:18.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51052 req_id = dc637002-ed6b-4a35-a03a-1aa52493de42 response_code = 200 uri = /network-bootstore-config
23902024-12-03T23:23:18.548ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23912024-12-03T23:23:18.548ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92da16e7-325b-473a-8169-ae1c2827470d
23922024-12-03T23:23:18.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8cb1c0ad-1492-43b1-ad64-5587c984b90a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
23932024-12-03T23:23:18.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_8cb1c0ad-1492-43b1-ad64-5587c984b90a
23942024-12-03T23:23:18.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34887
23952024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1d763331-c06e-44fb-86da-fae24d9ca74c, kind: Service { id: f99e1aa0-2073-4d3a-8402-3721fac4ac0a }, name: Name("external-dns-f99e1aa0-2073-4d3a-8402-3721fac4ac0a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: af34a9ff-7704-4e6c-b6e2-a91fbd86c7b9, kind: Service { id: 171286db-25de-47f2-bf8e-94bd6450ccc8 }, name: Name("external-dns-171286db-25de-47f2-bf8e-94bd6450ccc8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 168, 133])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6118c919-6dfb-453a-98cf-093a1ccaf4fd, kind: Service { id: 9f85fe03-0f74-4d11-a2fe-8ac14316d106 }, name: Name("nexus-9f85fe03-0f74-4d11-a2fe-8ac14316d106"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7e643e01-b582-4cb3-906c-1734e38c6c8a, kind: Service { id: e13fe529-56a8-4837-bfdb-ac84d9d5a41e }, name: Name("nexus-e13fe529-56a8-4837-bfdb-ac84d9d5a41e"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e7f5982f-a5c1-4835-81c3-930296e36e4c, kind: Service { id: cefcc61a-604d-424b-9499-5472a7e36656 }, name: Name("nexus-cefcc61a-604d-424b-9499-5472a7e36656"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23962024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23972024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23982024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23992024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24002024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24012024-12-03T23:23:18.573ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24022024-12-03T23:23:18.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 587 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34887 req_id = b6675ae4-38b8-4b30-9b04-7df8579ed428 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24032024-12-03T23:23:18.577ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24042024-12-03T23:23:18.577ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b1979523-9de1-40bb-ac9e-46203987b285
24052024-12-03T23:23:18.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24062024-12-03T23:23:18.592ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 477f8969-b73f-4886-851b-8d5be079baff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24072024-12-03T23:23:18.592ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_477f8969-b73f-4886-851b-8d5be079baff
24082024-12-03T23:23:18.617ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d6f63cb1-913d-444a-a6eb-da95edb279b5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24092024-12-03T23:23:18.617ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d6f63cb1-913d-444a-a6eb-da95edb279b5
24102024-12-03T23:23:18.631ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24112024-12-03T23:23:18.631ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1
24122024-12-03T23:23:18.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50564 req_id = a8dabf76-705d-475b-9450-50926da48d73 response_code = 204 uri = /switch-ports
24132024-12-03T23:23:18.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50564 req_id = 49585b63-ff52-46c2-a3c8-419f1a994823 response_code = 200 uri = /network-bootstore-config
24142024-12-03T23:23:18.650ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 92da16e7-325b-473a-8169-ae1c2827470d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24152024-12-03T23:23:18.650ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_92da16e7-325b-473a-8169-ae1c2827470d
24162024-12-03T23:23:18.668ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24172024-12-03T23:23:18.668ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d
24182024-12-03T23:23:18.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b1979523-9de1-40bb-ac9e-46203987b285 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24192024-12-03T23:23:18.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_b1979523-9de1-40bb-ac9e-46203987b285
24202024-12-03T23:23:18.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 386053 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53231 req_id = fa464190-ae55-47b2-a8c6-8848214a4a49 response_code = 200 uri = /inventory
24212024-12-03T23:23:18.708ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24222024-12-03T23:23:18.708ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1
24232024-12-03T23:23:18.735ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 426adfc9-6a99-438d-86ba-3f0e6c6abf0d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24242024-12-03T23:23:18.735ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_426adfc9-6a99-438d-86ba-3f0e6c6abf0d
24252024-12-03T23:23:18.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45268 req_id = da6bc575-5b98-41d3-83c9-52cfceeb4a46 response_code = 200 uri = /inventory
24262024-12-03T23:23:30.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7909 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = a440ef10-86c3-41a2-a968-b3c2e07a54fe response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
24272024-12-03T23:23:38.412ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51880
24282024-12-03T23:23:38.412ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51880 req_id = b7ab0093-3c55-4c10-a8ba-7049e31b4baf response_code = 200 uri = /baseboard
24292024-12-03T23:23:47.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65514
24302024-12-03T23:23:47.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65514 req_id = 4011e712-bd77-4e47-b44a-2a3be38d1b24 response_code = 200 uri = /vpc-routes
24312024-12-03T23:23:47.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
24322024-12-03T23:23:47.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65514 req_id = 8e528bc6-82a2-41a1-b086-100332e9a249 response_code = 204 uri = /eip-gateways
24332024-12-03T23:23:47.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65514 req_id = da7b20f1-9bea-4e37-8b12-499a4510ce93 response_code = 204 uri = /vpc-routes
24342024-12-03T23:23:47.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53412
24352024-12-03T23:23:47.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53412 req_id = b2122438-0928-4eef-a773-fe4af4426601 response_code = 200 uri = /v2p
24362024-12-03T23:23:47.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48603
24372024-12-03T23:23:47.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48603 req_id = 050bfa84-3f40-4058-bf81-8398cd326f1e response_code = 200 uri = /vpc-routes
24382024-12-03T23:23:47.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54142
24392024-12-03T23:23:47.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24402024-12-03T23:23:47.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24412024-12-03T23:23:47.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54142 req_id = c6563883-6526-4d99-974a-4930d349f689 response_code = 204 uri = /switch-ports
24422024-12-03T23:23:47.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35073
24432024-12-03T23:23:47.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35073 req_id = 2b12a10a-ec04-41ea-801f-5627ae35f21c response_code = 200 uri = /vpc-routes
24442024-12-03T23:23:47.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
24452024-12-03T23:23:47.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48603 req_id = f6c73721-5b34-4a5f-b1c8-ab9c49e7094f response_code = 204 uri = /eip-gateways
24462024-12-03T23:23:47.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54142 req_id = 37a7a16d-969c-4e23-af5b-df49d2c2cdf3 response_code = 200 uri = /network-bootstore-config
24472024-12-03T23:23:47.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62893
24482024-12-03T23:23:47.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62893 req_id = 61676a2f-2954-4b27-ac88-8b82d9307d99 response_code = 200 uri = /v2p
24492024-12-03T23:23:47.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 441 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48603 req_id = 176fdd5b-83c0-4926-bf87-4f148e6fa364 response_code = 204 uri = /vpc-routes
24502024-12-03T23:23:47.928ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
24512024-12-03T23:23:47.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35073 req_id = a17cdc1f-1f0e-4ca6-b51a-0b9c529aa1e6 response_code = 204 uri = /eip-gateways
24522024-12-03T23:23:47.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42477
24532024-12-03T23:23:47.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42477 req_id = 2c67afd9-d0e9-4ace-a840-60e4866ca93d response_code = 200 uri = /v2p
24542024-12-03T23:23:47.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35073 req_id = 6d782e84-5a9b-4820-9805-218c8cdb7806 response_code = 204 uri = /vpc-routes
24552024-12-03T23:23:47.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45197
24562024-12-03T23:23:47.984ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24572024-12-03T23:23:48.021ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24582024-12-03T23:23:48.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96827 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45197 req_id = a4c0fc2b-24ec-4d26-a3a9-ac1cc4011275 response_code = 204 uri = /switch-ports
24592024-12-03T23:23:48.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54194
24602024-12-03T23:23:48.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24612024-12-03T23:23:48.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24622024-12-03T23:23:48.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54194 req_id = 704d78c4-32ed-4f3c-a24b-1d1499389d19 response_code = 204 uri = /switch-ports
24632024-12-03T23:23:48.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45197 req_id = d9447376-a3ae-4147-afc7-23e08b56fb0b response_code = 200 uri = /network-bootstore-config
24642024-12-03T23:23:48.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54194 req_id = e535f921-4af4-4c4a-8796-4e08b7d01c59 response_code = 200 uri = /network-bootstore-config
24652024-12-03T23:24:00.612ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7674 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = bf490ba6-73d8-46e4-9a6d-844f67ae160b response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
24662024-12-03T23:24:08.445ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33771
24672024-12-03T23:24:08.445ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33771 req_id = ad628734-dcc8-435c-aaee-0a47157587e9 response_code = 200 uri = /baseboard
24682024-12-03T23:24:17.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53409
24692024-12-03T23:24:17.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53409 req_id = 4ca5c79e-76cf-4c36-8ec0-714ab6d2cdca response_code = 200 uri = /vpc-routes
24702024-12-03T23:24:17.853ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
24712024-12-03T23:24:17.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53409 req_id = 00412550-0ec6-4e40-aebd-05cf15a714ce response_code = 204 uri = /eip-gateways
24722024-12-03T23:24:17.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53409 req_id = 7937fce4-0026-4dcc-9b5b-fc158de3a4c3 response_code = 204 uri = /vpc-routes
24732024-12-03T23:24:17.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48588
24742024-12-03T23:24:17.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48588 req_id = 69b0d901-c33d-4d72-b62a-188a9e688c47 response_code = 200 uri = /vpc-routes
24752024-12-03T23:24:17.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
24762024-12-03T23:24:17.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48588 req_id = a8864caa-c888-4236-9542-df450f922ca7 response_code = 204 uri = /eip-gateways
24772024-12-03T23:24:17.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48588 req_id = 3ac67630-e9a3-4c6a-b34b-b97b0f433962 response_code = 204 uri = /vpc-routes
24782024-12-03T23:24:17.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61394
24792024-12-03T23:24:17.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61394 req_id = c0b1f25d-9ab0-420e-a7e8-630d78904e1b response_code = 200 uri = /v2p
24802024-12-03T23:24:17.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57484
24812024-12-03T23:24:17.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24822024-12-03T23:24:18.033ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24832024-12-03T23:24:18.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121037 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57484 req_id = c24756a0-4cbb-4480-9705-1b94b42fe7aa response_code = 204 uri = /switch-ports
24842024-12-03T23:24:18.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38960
24852024-12-03T23:24:18.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38960 req_id = 683f1112-2390-48ca-91a9-7b6db1e62e3e response_code = 200 uri = /v2p
24862024-12-03T23:24:18.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57484 req_id = 1ff6fc38-48ec-41a5-8b84-e956c27b575f response_code = 200 uri = /network-bootstore-config
24872024-12-03T23:24:18.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38337
24882024-12-03T23:24:18.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38337 req_id = 99aa688d-c16d-415f-b3e7-3155e9f6983c response_code = 200 uri = /vpc-routes
24892024-12-03T23:24:18.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42003
24902024-12-03T23:24:18.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24912024-12-03T23:24:18.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24922024-12-03T23:24:18.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42003 req_id = 96048da2-f589-4d0b-bd26-b9930ea71479 response_code = 204 uri = /switch-ports
24932024-12-03T23:24:18.305ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
24942024-12-03T23:24:18.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38337 req_id = a9ecb6e9-ea5b-4456-af33-5d9fc25c87ef response_code = 204 uri = /eip-gateways
24952024-12-03T23:24:18.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42003 req_id = e310fa06-acaf-48ba-92dc-e9259968d65c response_code = 200 uri = /network-bootstore-config
24962024-12-03T23:24:18.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34219
24972024-12-03T23:24:18.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34219 req_id = 18914d4d-d7c9-4160-a6c7-9a9f1c81298a response_code = 200 uri = /v2p
24982024-12-03T23:24:18.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38337 req_id = f60b3ad5-3ef3-4569-918b-2dd133acc833 response_code = 204 uri = /vpc-routes
24992024-12-03T23:24:18.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34702
25002024-12-03T23:24:18.517ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25012024-12-03T23:24:18.554ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25022024-12-03T23:24:18.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34702 req_id = 3c30ecee-261a-46cc-9831-4484e50e0862 response_code = 204 uri = /switch-ports
25032024-12-03T23:24:18.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34702 req_id = 298a9b27-aef4-42b0-983b-005522c26f5e response_code = 200 uri = /network-bootstore-config
25042024-12-03T23:24:30.613ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8480 local_addr = [fd00:1122:3344:101::1]:62783 method = GET remote_addr = [fd00:1122:3344:101::d]:37919 req_id = 12e8a7eb-2553-45e4-afc4-dffdd248c04e response_code = 200 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d uri = /9497a29b-1799-4726-9b95-53dee50af36d
25052024-12-03T23:24:32.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60648
25062024-12-03T23:24:32.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60648 req_id = 7b2d3b5b-f696-4a46-ba4d-f8774ee4e3e0 response_code = 200 uri = /v2p
25072024-12-03T23:24:32.794ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(10812020) }
25082024-12-03T23:24:32.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60648 req_id = 8de30b13-f532-4ee3-a855-713ccad068a2 response_code = 204 uri = /v2p
25092024-12-03T23:24:32.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39640
25102024-12-03T23:24:32.931ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10812020))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-6acb8b96180", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3afdba4c-7399-4a1b-b05e-059fce7f764b, read_only_parent: Some(Volume { block_size: 512, id: 46d6c5c9-e298-4194-8fdc-d44f90243c36, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c7041777-786f-4cd8-8dcf-47568a67477b, key: Some("wSo4SmjBjRGljSGnnaw5AM9hg+W8MRTrei5ciox73As="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3afdba4c-7399-4a1b-b05e-059fce7f764b, key: Some("d1/hdP8YPBfJlu8K1Rb5v3SUsEsoSoIr+75ZvObZp0U="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::1a]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-6acb8b96180" }] }), cloud_init_bytes: Some(..) } instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e metadata = InstanceMetadata { silo_id: 90c97dbb-2f67-4046-80e0-cd761cbfdf57, project_id: 24a758c6-54ad-4ba4-8749-645ecf6b1d17 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-03T23:24:32.920767660Z }
25112024-12-03T23:24:32.931ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e migration_id = None propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25122024-12-03T23:24:32.931ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e migration_id = None propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(10812020))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bf56e6b-7591-4da8-9623-0e3f846c09d9, kind: Instance { id: aedbc89a-cb27-431f-bb3e-64183efcbf6e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(10812020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-6acb8b96180", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 3afdba4c-7399-4a1b-b05e-059fce7f764b, read_only_parent: Some(Volume { block_size: 512, id: 46d6c5c9-e298-4194-8fdc-d44f90243c36, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c7041777-786f-4cd8-8dcf-47568a67477b, key: Some("wSo4SmjBjRGljSGnnaw5AM9hg+W8MRTrei5ciox73As="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::16]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3afdba4c-7399-4a1b-b05e-059fce7f764b, key: Some("d1/hdP8YPBfJlu8K1Rb5v3SUsEsoSoIr+75ZvObZp0U="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19000", "[fd00:1122:3344:101::1a]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-6acb8b96180" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-03T23:24:32.920767660Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
25132024-12-03T23:24:32.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11614 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39640 req_id = e7dc3b14-5d8b-44a7-976e-e02e74300010 response_code = 200 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d
25142024-12-03T23:24:33.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52258
25152024-12-03T23:24:33.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52258 req_id = d6ffb218-36c6-4439-9241-eb584dc3d95a response_code = 200 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state
25162024-12-03T23:24:33.067ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 10812020 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
25172024-12-03T23:24:33.067ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25182024-12-03T23:24:33.107ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d file = illumos-utils/src/zone.rs:325 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25192024-12-03T23:24:33.131ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d file = illumos-utils/src/zone.rs:363 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25202024-12-03T23:24:33.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54599
25212024-12-03T23:24:33.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54599 req_id = 3b22ae24-df46-4f3c-bf25-eab9407ec628 response_code = 200 uri = /vpc-routes
25222024-12-03T23:24:33.235ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {7bf56e6b-7591-4da8-9623-0e3f846c09d9: {10.151.2.176: {f5bfba89-e658-4aab-8156-db59711d205d}, 10.151.2.175: {f5bfba89-e658-4aab-8156-db59711d205d}}} }
25232024-12-03T23:24:34.783ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25242024-12-03T23:24:34.783ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d zone file = illumos-utils/src/running_zone.rs:488 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25252024-12-03T23:24:34.973ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 53.690007ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25262024-12-03T23:24:35.041ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 106.61634ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25272024-12-03T23:24:35.164ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 246.680923ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25282024-12-03T23:24:35.432ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 357.233613ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25292024-12-03T23:24:35.804ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 481.85367ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25302024-12-03T23:24:36.296ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 1.411853037s file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25312024-12-03T23:24:37.719ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 702.295537ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25322024-12-03T23:24:38.433ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 1.365858024s file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d zone = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
25332024-12-03T23:24:38.480ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38434
25342024-12-03T23:24:38.480ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38434 req_id = b9c377a4-d143-4c52-9bb3-87bffbbbc7c4 response_code = 200 uri = /baseboard
25352024-12-03T23:24:39.827ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d file = sled-agent/src/instance.rs:1786 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25362024-12-03T23:24:39.838ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 60.895246ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25372024-12-03T23:24:39.909ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 133.059217ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25382024-12-03T23:24:40.053ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 271.850493ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25392024-12-03T23:24:40.336ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d") failed: Property not found. retry in 355.483548ms file = illumos-utils/src/svc.rs:36 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25402024-12-03T23:24:40.703ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25412024-12-03T23:24:40.741ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25422024-12-03T23:24:40.882ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25432024-12-03T23:24:40.885ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-03T23:24:40.885204043Z } file = sled-agent/src/instance.rs:780 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25442024-12-03T23:24:40.885ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-03T23:24:40.885204043Z } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25452024-12-03T23:24:40.885ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-03T23:24:40.885204043Z }, migration_in: None, migration_out: None }
25462024-12-03T23:24:40.885ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
25472024-12-03T23:24:40.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7651365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54599 req_id = 9eeaf8d7-2156-4b6d-afca-7335e889137e response_code = 204 uri = /eip-gateways
25482024-12-03T23:24:40.915ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-03T23:24:40.914992035Z } file = sled-agent/src/instance.rs:780 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25492024-12-03T23:24:40.915ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-03T23:24:40.914992035Z } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25502024-12-03T23:24:40.915ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-03T23:24:40.914992035Z }, migration_in: None, migration_out: None }
25512024-12-03T23:24:40.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54599 req_id = 0d91fcf5-da96-4abf-ad08-d55f6e49f722 response_code = 204 uri = /vpc-routes
25522024-12-03T23:24:47.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41538
25532024-12-03T23:24:47.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41538 req_id = c4623144-78fa-444d-81e3-bfb2dc9f67c7 response_code = 200 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state
25542024-12-03T23:24:47.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43444
25552024-12-03T23:24:47.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43444 req_id = 0fb80f3a-591a-4f59-beb7-6ab5e2cb9700 response_code = 200 uri = /vpc-routes
25562024-12-03T23:24:47.708ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {7bf56e6b-7591-4da8-9623-0e3f846c09d9: {10.151.2.175: {f5bfba89-e658-4aab-8156-db59711d205d}, 10.151.2.176: {f5bfba89-e658-4aab-8156-db59711d205d}}} }
25572024-12-03T23:24:47.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43444 req_id = e87dce6b-d831-4a60-a393-72e78d309769 response_code = 204 uri = /eip-gateways
25582024-12-03T23:24:47.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43444 req_id = 1bac7155-13f9-4f15-a512-03f3c01657b6 response_code = 204 uri = /vpc-routes
25592024-12-03T23:24:47.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36417
25602024-12-03T23:24:47.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36417 req_id = d7786157-429d-44c6-8272-98a5e34484d8 response_code = 200 uri = /v2p
25612024-12-03T23:24:47.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56469
25622024-12-03T23:24:47.798ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25632024-12-03T23:24:47.849ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25642024-12-03T23:24:47.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121852 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56469 req_id = ffb6a433-f122-4b64-9fa2-188236daf43e response_code = 204 uri = /switch-ports
25652024-12-03T23:24:47.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44464
25662024-12-03T23:24:47.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46566
25672024-12-03T23:24:47.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46566 req_id = ff1a58a6-9bc9-4d43-9dd9-c72911f2bc18 response_code = 200 uri = /vpc-routes
25682024-12-03T23:24:47.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56469 req_id = 9e4230e5-dae1-4ed8-bc10-7e29b8534170 response_code = 200 uri = /network-bootstore-config
25692024-12-03T23:24:47.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44464 req_id = 2d0fdff8-2b7c-41c7-ae34-921f0ee251c3 response_code = 200 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state
25702024-12-03T23:24:47.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41474
25712024-12-03T23:24:47.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41474 req_id = 71001ac1-288d-490e-9233-d31a02796f66 response_code = 200 uri = /vpc-routes
25722024-12-03T23:24:47.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37831
25732024-12-03T23:24:47.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37831 req_id = c96716b4-bb0a-4b7a-9ef1-c385edc995e7 response_code = 200 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state
25742024-12-03T23:24:47.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {7bf56e6b-7591-4da8-9623-0e3f846c09d9: {10.151.2.176: {f5bfba89-e658-4aab-8156-db59711d205d}, 10.151.2.175: {f5bfba89-e658-4aab-8156-db59711d205d}}} }
25752024-12-03T23:24:47.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41474 req_id = 29a3f689-ef66-4950-b40a-21696b3644c7 response_code = 204 uri = /eip-gateways
25762024-12-03T23:24:47.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {7bf56e6b-7591-4da8-9623-0e3f846c09d9: {10.151.2.176: {f5bfba89-e658-4aab-8156-db59711d205d}, 10.151.2.175: {f5bfba89-e658-4aab-8156-db59711d205d}}} }
25772024-12-03T23:24:47.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46566 req_id = 6fa0b633-6578-40a8-bed3-f306201211a1 response_code = 204 uri = /eip-gateways
25782024-12-03T23:24:47.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41474 req_id = 436d29df-f097-47c8-87ee-8aea2494a76b response_code = 204 uri = /vpc-routes
25792024-12-03T23:24:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46566 req_id = aa9d7852-cf01-489e-b865-a39ed9718466 response_code = 204 uri = /vpc-routes
25802024-12-03T23:24:48.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45211
25812024-12-03T23:24:48.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45211 req_id = 630d885f-2823-47e1-b892-1c5c7ee32043 response_code = 200 uri = /v2p
25822024-12-03T23:24:48.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45440
25832024-12-03T23:24:48.059ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25842024-12-03T23:24:48.097ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25852024-12-03T23:24:48.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45440 req_id = 37776ead-8380-48a4-8baf-3c51fd5863f8 response_code = 204 uri = /switch-ports
25862024-12-03T23:24:48.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55553
25872024-12-03T23:24:48.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49317
25882024-12-03T23:24:48.149ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25892024-12-03T23:24:48.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3377 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55553 req_id = 20c30376-dba2-421b-b32e-e0b9200d7333 response_code = 200 uri = /v2p
25902024-12-03T23:24:48.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45440 req_id = 0a3a2ad6-8dd4-4638-9097-ed4119882fe5 response_code = 200 uri = /network-bootstore-config
25912024-12-03T23:24:48.183ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25922024-12-03T23:24:48.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86639 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49317 req_id = f8f99297-6432-46a7-81f6-a8fccac3c24c response_code = 204 uri = /switch-ports
25932024-12-03T23:24:48.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49317 req_id = f30d3754-be20-4088-a50d-836bce931082 response_code = 200 uri = /network-bootstore-config
25942024-12-03T23:24:50.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36683
25952024-12-03T23:24:50.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 598 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36683 req_id = 7ec1cdbf-f1ef-413a-b5ed-4faab98e2f3c response_code = 200 uri = /vmms/27a0a66e-7675-406b-9d40-134fc0d0af7d/state
25962024-12-03T23:24:50.558ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-03T23:24:50.557987580Z } file = sled-agent/src/instance.rs:780 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25972024-12-03T23:24:50.558ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-03T23:24:50.557987580Z } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
25982024-12-03T23:24:50.558ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-03T23:24:50.557987580Z }, migration_in: None, migration_out: None }
25992024-12-03T23:24:50.566ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopped), migration_in: None, migration_out: None, time: 2024-12-03T23:24:50.566662838Z } file = sled-agent/src/instance.rs:780 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26002024-12-03T23:24:50.566ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-03T23:24:50.566662838Z } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26012024-12-03T23:24:50.566ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(7), time_updated: 2024-12-03T23:24:50.566662838Z }, migration_in: None, migration_out: None }
26022024-12-03T23:24:50.611ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-03T23:24:50.611326126Z } file = sled-agent/src/instance.rs:780 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26032024-12-03T23:24:50.611ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-03T23:24:50.611326126Z } propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26042024-12-03T23:24:50.611ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26052024-12-03T23:24:50.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26062024-12-03T23:24:50.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26072024-12-03T23:24:50.611ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/19e69794-96f9-49bd-b112-d5d8ccde31a9/debug/bundle/zone", "/pool/int/81b3a86c-bba7-4eaf-a631-921a7ea80989/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/79fb0905-996f-4ae0-9f47-4f9a399468b9/crypt/debug", "/pool/ext/88c18331-f96d-4496-b80c-5b839f36e5ec/crypt/debug", "/pool/ext/8cb1c0ad-1492-43b1-ad64-5587c984b90a/crypt/debug", "/pool/ext/477f8969-b73f-4886-851b-8d5be079baff/crypt/debug", "/pool/ext/d6f63cb1-913d-444a-a6eb-da95edb279b5/crypt/debug", "/pool/ext/92da16e7-325b-473a-8169-ae1c2827470d/crypt/debug", "/pool/ext/b1979523-9de1-40bb-ac9e-46203987b285/crypt/debug", "/pool/ext/4d4dbca6-2e04-4c34-bb5c-dc66e0f07aa1/crypt/debug", "/pool/ext/426adfc9-6a99-438d-86ba-3f0e6c6abf0d/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d
26082024-12-03T23:24:51.254ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d", bundle_id: 768b92b3-278e-4005-836f-ca13e0475a9b }, time_created: 2024-12-03T23:24:50.612183643Z, version: 0, cause: TerminatedInstance }
26092024-12-03T23:24:51.254ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_27a0a66e-7675-406b-9d40-134fc0d0af7d file = sled-agent/src/instance.rs:1032 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26102024-12-03T23:24:53.007ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26112024-12-03T23:24:53.024ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(10812020), kind: System }
26122024-12-03T23:24:53.024ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(10812020), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
26132024-12-03T23:24:53.025ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-03T23:24:53.025332099Z }, migration_in: None, migration_out: None }
26142024-12-03T23:24:53.059ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(9), time_updated: 2024-12-03T23:24:53.025332099Z }, migration_in: None, migration_out: None }
26152024-12-03T23:24:53.064ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = aedbc89a-cb27-431f-bb3e-64183efcbf6e propolis_id = 27a0a66e-7675-406b-9d40-134fc0d0af7d
26162024-12-03T23:24:53.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37669
26172024-12-03T23:24:53.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37669 req_id = 9f350a78-8c69-44a5-8f1e-53531a741942 response_code = 200 uri = /vpc-routes
26182024-12-03T23:24:53.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44680
26192024-12-03T23:24:53.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44680 req_id = aa38bfce-a653-49b2-a850-e81233b3c9ab response_code = 200 uri = /v2p
26202024-12-03T23:24:53.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
26212024-12-03T23:24:53.772ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d
26222024-12-03T23:24:53.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37669 req_id = 2b9f0ecf-ee74-4661-8a36-97dcc5f91cc7 response_code = 204 uri = /eip-gateways
26232024-12-03T23:24:53.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37669 req_id = 6f2adcc1-9d2f-4142-bf69-31a911314273 response_code = 204 uri = /vpc-routes
26242024-12-03T23:24:54.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62915
26252024-12-03T23:24:54.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62915 req_id = 72ddb2e9-d16f-449b-ab62-faf7b843e45a response_code = 200 uri = /v2p
26262024-12-03T23:24:55.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50690
26272024-12-03T23:24:55.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50690 req_id = 5effd6a0-2284-4478-a59b-c55764722fad response_code = 200 uri = /vpc-routes
26282024-12-03T23:24:55.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
26292024-12-03T23:24:55.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50690 req_id = 292fb16a-cbec-4143-ab01-65eb5cf19e35 response_code = 204 uri = /eip-gateways
26302024-12-03T23:24:55.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50690 req_id = 7392f49f-5d7f-4a0f-97ff-66d5a73ad6f2 response_code = 204 uri = /vpc-routes
26312024-12-03T23:24:55.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55559
26322024-12-03T23:24:55.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55559 req_id = 26dfa9e7-b31e-446c-83c9-e97b527aea16 response_code = 200 uri = /vpc-routes
26332024-12-03T23:24:55.713ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 9497a29b-1799-4726-9b95-53dee50af36d values = ExternalIpGatewayMap { mappings: {} }
26342024-12-03T23:24:55.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55559 req_id = 5f201bdf-94df-4dbc-a61f-5a230ccb578d response_code = 204 uri = /eip-gateways
26352024-12-03T23:24:55.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55559 req_id = 82f58088-2aa3-4cc2-90bd-da6e44880d24 response_code = 204 uri = /vpc-routes